=== RUN   TestMultiControlPlane/serial/RestartClusterKeepsNodes

ha_test.go:456: (dbg) Run:  out/minikube-linux-amd64 node list -p ha-735960 -v=7 --alsologtostderr

ha_test.go:462: (dbg) Run:  out/minikube-linux-amd64 stop -p ha-735960 -v=7 --alsologtostderr

E0701 12:20:33.803031  637854 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/functional-377045/client.crt: no such file or directory

ha_test.go:462: (dbg) Done: out/minikube-linux-amd64 stop -p ha-735960 -v=7 --alsologtostderr: (40.842561302s)

ha_test.go:467: (dbg) Run:  out/minikube-linux-amd64 start -p ha-735960 --wait=true -v=7 --alsologtostderr

E0701 12:21:55.724202  637854 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/functional-377045/client.crt: no such file or directory

ha_test.go:467: (dbg) Non-zero exit: out/minikube-linux-amd64 start -p ha-735960 --wait=true -v=7 --alsologtostderr: exit status 90 (1m44.497689423s)

-- stdout --

	* [ha-735960] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	  - MINIKUBE_LOCATION=19166

	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	  - KUBECONFIG=/home/jenkins/minikube-integration/19166-630650/kubeconfig

	  - MINIKUBE_HOME=/home/jenkins/minikube-integration/19166-630650/.minikube

	  - MINIKUBE_BIN=out/minikube-linux-amd64

	  - MINIKUBE_FORCE_SYSTEMD=

	* Using the kvm2 driver based on existing profile

	* Starting "ha-735960" primary control-plane node in "ha-735960" cluster

	* Restarting existing kvm2 VM for "ha-735960" ...

	* Preparing Kubernetes v1.30.2 on Docker 27.0.1 ...

	* Enabled addons: 

	* Starting "ha-735960-m02" control-plane node in "ha-735960" cluster

	* Restarting existing kvm2 VM for "ha-735960-m02" ...

	* Found network options:

	  - NO_PROXY=192.168.39.16

-- /stdout --

** stderr ** 

	I0701 12:21:13.996326  652196 out.go:291] Setting OutFile to fd 1 ...

	I0701 12:21:13.996600  652196 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:21:13.996610  652196 out.go:304] Setting ErrFile to fd 2...

	I0701 12:21:13.996615  652196 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:21:13.996825  652196 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19166-630650/.minikube/bin

	I0701 12:21:13.997417  652196 out.go:298] Setting JSON to false

	I0701 12:21:13.998463  652196 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-7","uptime":7412,"bootTime":1719829062,"procs":181,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0701 12:21:13.998525  652196 start.go:139] virtualization: kvm guest

	I0701 12:21:14.000967  652196 out.go:177] * [ha-735960] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0701 12:21:14.002666  652196 out.go:177]   - MINIKUBE_LOCATION=19166

	I0701 12:21:14.002690  652196 notify.go:220] Checking for updates...

	I0701 12:21:14.005489  652196 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0701 12:21:14.006983  652196 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:14.008350  652196 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19166-630650/.minikube

	I0701 12:21:14.009593  652196 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0701 12:21:14.011091  652196 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0701 12:21:14.012857  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:14.012999  652196 driver.go:392] Setting default libvirt URI to qemu:///system

	I0701 12:21:14.013468  652196 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:21:14.013542  652196 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:21:14.028581  652196 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35775

	I0701 12:21:14.028967  652196 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:21:14.029528  652196 main.go:141] libmachine: Using API Version  1

	I0701 12:21:14.029551  652196 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:21:14.029916  652196 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:21:14.030116  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:14.065038  652196 out.go:177] * Using the kvm2 driver based on existing profile

	I0701 12:21:14.066535  652196 start.go:297] selected driver: kvm2

	I0701 12:21:14.066551  652196 start.go:901] validating driver "kvm2" against &{Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVer

sion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:fal

se efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVers

ion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:21:14.066723  652196 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0701 12:21:14.067041  652196 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0701 12:21:14.067114  652196 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19166-630650/.minikube/bin:/home/jenkins/workspace/KVM_Linux_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0701 12:21:14.082191  652196 install.go:137] /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0701 12:21:14.082920  652196 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0701 12:21:14.082959  652196 cni.go:84] Creating CNI manager for ""

	I0701 12:21:14.082966  652196 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0701 12:21:14.083026  652196 start.go:340] cluster config:

	{Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39

.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false h

elm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]

MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:21:14.083142  652196 iso.go:125] acquiring lock: {Name:mk5c70910f61bc270c83609c48670eaf9d7e0602 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0701 12:21:14.086358  652196 out.go:177] * Starting "ha-735960" primary control-plane node in "ha-735960" cluster

	I0701 12:21:14.087757  652196 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:21:14.087794  652196 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4

	I0701 12:21:14.087805  652196 cache.go:56] Caching tarball of preloaded images

	I0701 12:21:14.087882  652196 preload.go:173] Found /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0701 12:21:14.087892  652196 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on docker

	I0701 12:21:14.088044  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:14.088232  652196 start.go:360] acquireMachinesLock for ha-735960: {Name:mk43a6c0c0c15a237623df377ad65b82186c0ad8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0701 12:21:14.088271  652196 start.go:364] duration metric: took 21.615µs to acquireMachinesLock for "ha-735960"

	I0701 12:21:14.088285  652196 start.go:96] Skipping create...Using existing machine configuration

	I0701 12:21:14.088293  652196 fix.go:54] fixHost starting: 

	I0701 12:21:14.088547  652196 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:21:14.088578  652196 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:21:14.103070  652196 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42935

	I0701 12:21:14.103508  652196 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:21:14.104025  652196 main.go:141] libmachine: Using API Version  1

	I0701 12:21:14.104050  652196 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:21:14.104424  652196 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:21:14.104649  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:14.104829  652196 main.go:141] libmachine: (ha-735960) Calling .GetState

	I0701 12:21:14.106608  652196 fix.go:112] recreateIfNeeded on ha-735960: state=Stopped err=<nil>

	I0701 12:21:14.106630  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	W0701 12:21:14.106790  652196 fix.go:138] unexpected machine state, will restart: <nil>

	I0701 12:21:14.108833  652196 out.go:177] * Restarting existing kvm2 VM for "ha-735960" ...

	I0701 12:21:14.110060  652196 main.go:141] libmachine: (ha-735960) Calling .Start

	I0701 12:21:14.110234  652196 main.go:141] libmachine: (ha-735960) Ensuring networks are active...

	I0701 12:21:14.110976  652196 main.go:141] libmachine: (ha-735960) Ensuring network default is active

	I0701 12:21:14.111299  652196 main.go:141] libmachine: (ha-735960) Ensuring network mk-ha-735960 is active

	I0701 12:21:14.111665  652196 main.go:141] libmachine: (ha-735960) Getting domain xml...

	I0701 12:21:14.112420  652196 main.go:141] libmachine: (ha-735960) Creating domain...

	I0701 12:21:15.307133  652196 main.go:141] libmachine: (ha-735960) Waiting to get IP...

	I0701 12:21:15.308062  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:15.308526  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:15.308647  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:15.308493  652224 retry.go:31] will retry after 239.111405ms: waiting for machine to come up

	I0701 12:21:15.549211  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:15.549648  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:15.549679  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:15.549597  652224 retry.go:31] will retry after 248.256131ms: waiting for machine to come up

	I0701 12:21:15.799054  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:15.799481  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:15.799534  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:15.799422  652224 retry.go:31] will retry after 380.468685ms: waiting for machine to come up

	I0701 12:21:16.181969  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:16.182432  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:16.182634  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:16.182540  652224 retry.go:31] will retry after 592.847587ms: waiting for machine to come up

	I0701 12:21:16.777393  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:16.777837  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:16.777867  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:16.777790  652224 retry.go:31] will retry after 639.749416ms: waiting for machine to come up

	I0701 12:21:17.419540  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:17.419941  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:17.419965  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:17.419916  652224 retry.go:31] will retry after 891.768613ms: waiting for machine to come up

	I0701 12:21:18.312967  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:18.313455  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:18.313484  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:18.313399  652224 retry.go:31] will retry after 1.112048412s: waiting for machine to come up

	I0701 12:21:19.427190  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:19.427624  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:19.427655  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:19.427568  652224 retry.go:31] will retry after 1.150138437s: waiting for machine to come up

	I0701 12:21:20.579868  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:20.580291  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:20.580325  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:20.580216  652224 retry.go:31] will retry after 1.129763596s: waiting for machine to come up

	I0701 12:21:21.711416  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:21.711892  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:21.711924  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:21.711831  652224 retry.go:31] will retry after 2.143074349s: waiting for machine to come up

	I0701 12:21:23.858081  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:23.858617  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:23.858643  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:23.858578  652224 retry.go:31] will retry after 2.436757856s: waiting for machine to come up

	I0701 12:21:26.297727  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:26.298302  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:26.298352  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:26.298269  652224 retry.go:31] will retry after 2.609229165s: waiting for machine to come up

	I0701 12:21:28.911224  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.911698  652196 main.go:141] libmachine: (ha-735960) Found IP for machine: 192.168.39.16

	I0701 12:21:28.911722  652196 main.go:141] libmachine: (ha-735960) Reserving static IP address...

	I0701 12:21:28.911731  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has current primary IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.912401  652196 main.go:141] libmachine: (ha-735960) Reserved static IP address: 192.168.39.16

	I0701 12:21:28.912425  652196 main.go:141] libmachine: (ha-735960) Waiting for SSH to be available...

	I0701 12:21:28.912468  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "ha-735960", mac: "52:54:00:6c:20:7c", ip: "192.168.39.16"} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:28.912492  652196 main.go:141] libmachine: (ha-735960) DBG | skip adding static IP to network mk-ha-735960 - found existing host DHCP lease matching {name: "ha-735960", mac: "52:54:00:6c:20:7c", ip: "192.168.39.16"}

	I0701 12:21:28.912507  652196 main.go:141] libmachine: (ha-735960) DBG | Getting to WaitForSSH function...

	I0701 12:21:28.914934  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.915448  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:28.915478  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.915627  652196 main.go:141] libmachine: (ha-735960) DBG | Using SSH client type: external

	I0701 12:21:28.915655  652196 main.go:141] libmachine: (ha-735960) DBG | Using SSH private key: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa (-rw-------)

	I0701 12:21:28.915680  652196 main.go:141] libmachine: (ha-735960) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.16 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0701 12:21:28.915698  652196 main.go:141] libmachine: (ha-735960) DBG | About to run SSH command:

	I0701 12:21:28.915730  652196 main.go:141] libmachine: (ha-735960) DBG | exit 0

	I0701 12:21:29.042314  652196 main.go:141] libmachine: (ha-735960) DBG | SSH cmd err, output: <nil>: 

	I0701 12:21:29.042747  652196 main.go:141] libmachine: (ha-735960) Calling .GetConfigRaw

	I0701 12:21:29.043414  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:29.046291  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.046689  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.046714  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.046967  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:29.047187  652196 machine.go:94] provisionDockerMachine start ...

	I0701 12:21:29.047211  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:29.047467  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.049524  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.049899  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.049924  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.050040  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.050240  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.050477  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.050669  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.050868  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.051073  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.051086  652196 main.go:141] libmachine: About to run SSH command:

	hostname

	I0701 12:21:29.166645  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0701 12:21:29.166687  652196 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:21:29.166983  652196 buildroot.go:166] provisioning hostname "ha-735960"

	I0701 12:21:29.167013  652196 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:21:29.167232  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.169829  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.170228  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.170260  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.170403  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.170603  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.170773  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.170913  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.171082  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.171259  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.171270  652196 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-735960 && echo "ha-735960" | sudo tee /etc/hostname

	I0701 12:21:29.295697  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-735960

	I0701 12:21:29.295728  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.298625  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.299014  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.299041  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.299233  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.299434  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.299641  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.299795  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.299954  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.300149  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.300171  652196 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-735960' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-735960/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-735960' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0701 12:21:29.418489  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0701 12:21:29.418522  652196 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19166-630650/.minikube CaCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19166-630650/.minikube}

	I0701 12:21:29.418577  652196 buildroot.go:174] setting up certificates

	I0701 12:21:29.418593  652196 provision.go:84] configureAuth start

	I0701 12:21:29.418612  652196 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:21:29.418889  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:29.421815  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.422238  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.422275  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.422477  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.424787  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.425187  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.425216  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.425427  652196 provision.go:143] copyHostCerts

	I0701 12:21:29.425466  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:29.425530  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem, removing ...

	I0701 12:21:29.425542  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:29.425624  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem (1078 bytes)

	I0701 12:21:29.425732  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:29.425753  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem, removing ...

	I0701 12:21:29.425758  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:29.425798  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem (1123 bytes)

	I0701 12:21:29.425856  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:29.425872  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem, removing ...

	I0701 12:21:29.425877  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:29.425897  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem (1675 bytes)

	I0701 12:21:29.425958  652196 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem org=jenkins.ha-735960 san=[127.0.0.1 192.168.39.16 ha-735960 localhost minikube]

	I0701 12:21:29.592360  652196 provision.go:177] copyRemoteCerts

	I0701 12:21:29.592437  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0701 12:21:29.592463  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.595489  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.595884  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.595908  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.596131  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.596356  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.596515  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.596646  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:29.684124  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0701 12:21:29.684214  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I0701 12:21:29.707185  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0701 12:21:29.707254  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0701 12:21:29.729605  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0701 12:21:29.729687  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0701 12:21:29.751505  652196 provision.go:87] duration metric: took 332.894756ms to configureAuth

	I0701 12:21:29.751536  652196 buildroot.go:189] setting minikube options for container-runtime

	I0701 12:21:29.751802  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:29.751834  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:29.752179  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.754903  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.755331  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.755367  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.755494  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.755709  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.755868  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.756016  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.756168  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.756341  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.756351  652196 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0701 12:21:29.867557  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0701 12:21:29.867582  652196 buildroot.go:70] root file system type: tmpfs

	I0701 12:21:29.867738  652196 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0701 12:21:29.867768  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.870702  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.871111  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.871152  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.871294  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.871532  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.871806  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.871989  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.872177  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.872347  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.872410  652196 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0701 12:21:29.995623  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0701 12:21:29.995671  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.998574  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.998969  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.999001  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.999184  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.999403  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.999598  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.999772  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.999916  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:30.000093  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:30.000109  652196 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0701 12:21:31.849411  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0701 12:21:31.849452  652196 machine.go:97] duration metric: took 2.802248138s to provisionDockerMachine

	I0701 12:21:31.849473  652196 start.go:293] postStartSetup for "ha-735960" (driver="kvm2")

	I0701 12:21:31.849487  652196 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0701 12:21:31.849508  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:31.849934  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0701 12:21:31.849982  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:31.853029  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.853464  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:31.853494  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.853656  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:31.853877  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:31.854065  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:31.854242  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:31.948096  652196 ssh_runner.go:195] Run: cat /etc/os-release

	I0701 12:21:31.952493  652196 info.go:137] Remote host: Buildroot 2023.02.9

	I0701 12:21:31.952522  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/addons for local assets ...

	I0701 12:21:31.952580  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/files for local assets ...

	I0701 12:21:31.952654  652196 filesync.go:149] local asset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> 6378542.pem in /etc/ssl/certs

	I0701 12:21:31.952664  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /etc/ssl/certs/6378542.pem

	I0701 12:21:31.952750  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0701 12:21:31.962034  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:21:31.985898  652196 start.go:296] duration metric: took 136.407484ms for postStartSetup

	I0701 12:21:31.985953  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:31.986287  652196 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup

	I0701 12:21:31.986316  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:31.988934  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.989328  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:31.989359  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.989497  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:31.989724  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:31.989863  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:31.990038  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:32.076710  652196 machine.go:198] restoring vm config from /var/lib/minikube/backup: [etc]

	I0701 12:21:32.076807  652196 ssh_runner.go:195] Run: sudo rsync --archive --update /var/lib/minikube/backup/etc /

	I0701 12:21:32.133792  652196 fix.go:56] duration metric: took 18.045488816s for fixHost

	I0701 12:21:32.133863  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:32.136703  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.137078  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.137110  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.137321  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:32.137591  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.137793  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.137963  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:32.138201  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:32.138518  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:32.138541  652196 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0701 12:21:32.254973  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 1719836492.215186729

	I0701 12:21:32.255001  652196 fix.go:216] guest clock: 1719836492.215186729

	I0701 12:21:32.255007  652196 fix.go:229] Guest: 2024-07-01 12:21:32.215186729 +0000 UTC Remote: 2024-07-01 12:21:32.133836118 +0000 UTC m=+18.172225533 (delta=81.350611ms)

	I0701 12:21:32.255027  652196 fix.go:200] guest clock delta is within tolerance: 81.350611ms

	I0701 12:21:32.255032  652196 start.go:83] releasing machines lock for "ha-735960", held for 18.166751927s

	I0701 12:21:32.255050  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.255338  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:32.258091  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.258459  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.258481  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.258679  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.259224  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.259383  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.259520  652196 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0701 12:21:32.259564  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:32.259693  652196 ssh_runner.go:195] Run: cat /version.json

	I0701 12:21:32.259718  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:32.262127  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.262481  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.262518  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.262538  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.262653  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:32.262845  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.263031  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:32.263054  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.263074  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.263215  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:32.263229  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:32.263398  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.263547  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:32.263699  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:32.343012  652196 ssh_runner.go:195] Run: systemctl --version

	I0701 12:21:32.428409  652196 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0701 12:21:32.433742  652196 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0701 12:21:32.433815  652196 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0701 12:21:32.449052  652196 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0701 12:21:32.449087  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:32.449338  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:32.471651  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0701 12:21:32.481832  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0701 12:21:32.491470  652196 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0701 12:21:32.491548  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0701 12:21:32.501229  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:32.511119  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0701 12:21:32.520826  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:32.530559  652196 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0701 12:21:32.542109  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0701 12:21:32.551821  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0701 12:21:32.561403  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0701 12:21:32.571068  652196 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0701 12:21:32.579813  652196 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0701 12:21:32.588595  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:32.705377  652196 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0701 12:21:32.724169  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:32.724285  652196 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0701 12:21:32.739050  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:32.753169  652196 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0701 12:21:32.769805  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:32.783750  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:32.797509  652196 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0701 12:21:32.821510  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:32.835901  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:32.854192  652196 ssh_runner.go:195] Run: which cri-dockerd

	I0701 12:21:32.858039  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0701 12:21:32.867652  652196 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0701 12:21:32.884216  652196 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0701 12:21:33.001636  652196 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0701 12:21:33.121229  652196 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0701 12:21:33.121419  652196 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0701 12:21:33.138482  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:33.262395  652196 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0701 12:21:35.714549  652196 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.452099351s)

	I0701 12:21:35.714642  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0701 12:21:35.727946  652196 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I0701 12:21:35.744089  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:21:35.757426  652196 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0701 12:21:35.868089  652196 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0701 12:21:35.989857  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:36.121343  652196 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0701 12:21:36.138520  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:21:36.152026  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:36.271312  652196 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0701 12:21:36.351567  652196 start.go:541] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0701 12:21:36.351668  652196 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0701 12:21:36.357143  652196 start.go:562] Will wait 60s for crictl version

	I0701 12:21:36.357212  652196 ssh_runner.go:195] Run: which crictl

	I0701 12:21:36.361384  652196 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0701 12:21:36.400372  652196 start.go:578] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.0.1

	RuntimeApiVersion:  v1

	I0701 12:21:36.400446  652196 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:21:36.427941  652196 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:21:36.456620  652196 out.go:204] * Preparing Kubernetes v1.30.2 on Docker 27.0.1 ...

	I0701 12:21:36.456687  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:36.459384  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:36.459752  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:36.459781  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:36.459970  652196 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0701 12:21:36.463956  652196 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:21:36.476676  652196 kubeadm.go:877] updating cluster {Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Cl

usterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:fa

lse freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p200

0.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0701 12:21:36.476851  652196 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:21:36.476914  652196 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0701 12:21:36.493466  652196 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.30.2

	registry.k8s.io/kube-controller-manager:v1.30.2

	registry.k8s.io/kube-scheduler:v1.30.2

	registry.k8s.io/kube-proxy:v1.30.2

	kindest/kindnetd:v20240513-cd2ac642

	ghcr.io/kube-vip/kube-vip:v0.8.0

	registry.k8s.io/etcd:3.5.12-0

	registry.k8s.io/coredns/coredns:v1.11.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28

	-- /stdout --

	I0701 12:21:36.493530  652196 docker.go:615] Images already preloaded, skipping extraction

	I0701 12:21:36.493620  652196 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0701 12:21:36.510908  652196 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.30.2

	registry.k8s.io/kube-controller-manager:v1.30.2

	registry.k8s.io/kube-scheduler:v1.30.2

	registry.k8s.io/kube-proxy:v1.30.2

	kindest/kindnetd:v20240513-cd2ac642

	ghcr.io/kube-vip/kube-vip:v0.8.0

	registry.k8s.io/etcd:3.5.12-0

	registry.k8s.io/coredns/coredns:v1.11.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28

	-- /stdout --

	I0701 12:21:36.510939  652196 cache_images.go:84] Images are preloaded, skipping loading

	I0701 12:21:36.510952  652196 kubeadm.go:928] updating node { 192.168.39.16 8443 v1.30.2 docker true true} ...

	I0701 12:21:36.511079  652196 kubeadm.go:940] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-735960 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.16

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0701 12:21:36.511139  652196 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0701 12:21:36.536408  652196 cni.go:84] Creating CNI manager for ""

	I0701 12:21:36.536430  652196 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0701 12:21:36.536441  652196 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0701 12:21:36.536470  652196 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.16 APIServerPort:8443 KubernetesVersion:v1.30.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-735960 NodeName:ha-735960 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.16"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.16 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes

/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0701 12:21:36.536633  652196 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.16

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "ha-735960"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.16

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.16"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%"

	  nodefs.inodesFree: "0%"

	  imagefs.available: "0%"

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0701 12:21:36.536656  652196 kube-vip.go:115] generating kube-vip config ...

	I0701 12:21:36.536698  652196 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0701 12:21:36.551906  652196 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0701 12:21:36.552024  652196 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0701 12:21:36.552078  652196 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0701 12:21:36.561989  652196 binaries.go:44] Found k8s binaries, skipping transfer

	I0701 12:21:36.562059  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0701 12:21:36.571281  652196 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0701 12:21:36.587480  652196 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0701 12:21:36.603596  652196 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2154 bytes)

	I0701 12:21:36.621063  652196 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0701 12:21:36.637192  652196 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0701 12:21:36.640909  652196 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:21:36.652690  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:36.768142  652196 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0701 12:21:36.786625  652196 certs.go:68] Setting up /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960 for IP: 192.168.39.16

	I0701 12:21:36.786655  652196 certs.go:194] generating shared ca certs ...

	I0701 12:21:36.786676  652196 certs.go:226] acquiring lock for ca certs: {Name:mk34e166bfd069e523b2325e14d1812c523bff53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:36.786854  652196 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key

	I0701 12:21:36.786904  652196 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key

	I0701 12:21:36.786915  652196 certs.go:256] generating profile certs ...

	I0701 12:21:36.787017  652196 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key

	I0701 12:21:36.787046  652196 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af

	I0701 12:21:36.787059  652196 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.16 192.168.39.86 192.168.39.97 192.168.39.254]

	I0701 12:21:37.059263  652196 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af ...

	I0701 12:21:37.059305  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af: {Name:mk1be9dc4667506ac6fdcfb1e313edd1292fe7f9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.059483  652196 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af ...

	I0701 12:21:37.059496  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af: {Name:mkf9220e489bd04f035dab270c790bb3448ca6be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.059596  652196 certs.go:381] copying /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af -> /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt

	I0701 12:21:37.059809  652196 certs.go:385] copying /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af -> /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key

	I0701 12:21:37.059969  652196 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key

	I0701 12:21:37.059987  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0701 12:21:37.060000  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0701 12:21:37.060014  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0701 12:21:37.060026  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0701 12:21:37.060038  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0701 12:21:37.060054  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0701 12:21:37.060066  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0701 12:21:37.060077  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0701 12:21:37.060165  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem (1338 bytes)

	W0701 12:21:37.060197  652196 certs.go:480] ignoring /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854_empty.pem, impossibly tiny 0 bytes

	I0701 12:21:37.060207  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem (1675 bytes)

	I0701 12:21:37.060228  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem (1078 bytes)

	I0701 12:21:37.060248  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem (1123 bytes)

	I0701 12:21:37.060270  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem (1675 bytes)

	I0701 12:21:37.060305  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:21:37.060331  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem -> /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.060347  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.060359  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.061045  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0701 12:21:37.111708  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0701 12:21:37.168649  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0701 12:21:37.204675  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0701 12:21:37.241167  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)

	I0701 12:21:37.265225  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0701 12:21:37.288613  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0701 12:21:37.312645  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0701 12:21:37.337494  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem --> /usr/share/ca-certificates/637854.pem (1338 bytes)

	I0701 12:21:37.361044  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /usr/share/ca-certificates/6378542.pem (1708 bytes)

	I0701 12:21:37.385424  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0701 12:21:37.409054  652196 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0701 12:21:37.426602  652196 ssh_runner.go:195] Run: openssl version

	I0701 12:21:37.432129  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0701 12:21:37.442695  652196 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.447331  652196 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul  1 12:05 /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.447415  652196 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.453215  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0701 12:21:37.464086  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/637854.pem && ln -fs /usr/share/ca-certificates/637854.pem /etc/ssl/certs/637854.pem"

	I0701 12:21:37.474527  652196 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.479057  652196 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul  1 12:11 /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.479123  652196 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.484641  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/637854.pem /etc/ssl/certs/51391683.0"

	I0701 12:21:37.495175  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6378542.pem && ln -fs /usr/share/ca-certificates/6378542.pem /etc/ssl/certs/6378542.pem"

	I0701 12:21:37.505961  652196 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.510286  652196 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul  1 12:11 /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.510365  652196 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.516124  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/6378542.pem /etc/ssl/certs/3ec20f2e.0"

	I0701 12:21:37.527154  652196 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0701 12:21:37.532024  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I0701 12:21:37.538145  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I0701 12:21:37.544280  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I0701 12:21:37.550448  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I0701 12:21:37.556356  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I0701 12:21:37.562174  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I0701 12:21:37.568144  652196 kubeadm.go:391] StartCluster: {Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Clust

erName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false

freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L

MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:21:37.568362  652196 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0701 12:21:37.586457  652196 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	W0701 12:21:37.596129  652196 kubeadm.go:404] apiserver tunnel failed: apiserver port not set

	I0701 12:21:37.596158  652196 kubeadm.go:407] found existing configuration files, will attempt cluster restart

	I0701 12:21:37.596164  652196 kubeadm.go:587] restartPrimaryControlPlane start ...

	I0701 12:21:37.596237  652196 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I0701 12:21:37.605715  652196 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0701 12:21:37.606193  652196 kubeconfig.go:47] verify endpoint returned: get endpoint: "ha-735960" does not appear in /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:37.606354  652196 kubeconfig.go:62] /home/jenkins/minikube-integration/19166-630650/kubeconfig needs updating (will repair): [kubeconfig missing "ha-735960" cluster setting kubeconfig missing "ha-735960" context setting]

	I0701 12:21:37.606708  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/kubeconfig: {Name:mke3ef9d019eff4edd273b00c416fd77ed009242 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.607135  652196 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:37.607365  652196 kapi.go:59] client config for ha-735960: &rest.Config{Host:"https://192.168.39.16:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.crt", KeyFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key", CAFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(ni

l)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1cfbb80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0701 12:21:37.607752  652196 cert_rotation.go:137] Starting client certificate rotation controller

	I0701 12:21:37.608047  652196 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0701 12:21:37.617685  652196 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.39.16

	I0701 12:21:37.617715  652196 kubeadm.go:591] duration metric: took 21.544408ms to restartPrimaryControlPlane

	I0701 12:21:37.617725  652196 kubeadm.go:393] duration metric: took 49.593354ms to StartCluster

	I0701 12:21:37.617748  652196 settings.go:142] acquiring lock: {Name:mk6f7c85ea77a73ff0ac851454721f2e6e309153 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.617834  652196 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:37.618535  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/kubeconfig: {Name:mke3ef9d019eff4edd273b00c416fd77ed009242 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.618754  652196 start.go:232] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0701 12:21:37.618777  652196 start.go:240] waiting for startup goroutines ...

	I0701 12:21:37.618792  652196 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0701 12:21:37.619028  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:37.621683  652196 out.go:177] * Enabled addons: 

	I0701 12:21:37.622979  652196 addons.go:510] duration metric: took 4.192015ms for enable addons: enabled=[]

	I0701 12:21:37.623011  652196 start.go:245] waiting for cluster config update ...

	I0701 12:21:37.623019  652196 start.go:254] writing updated cluster config ...

	I0701 12:21:37.624600  652196 out.go:177] 

	I0701 12:21:37.626023  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:37.626124  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:37.627745  652196 out.go:177] * Starting "ha-735960-m02" control-plane node in "ha-735960" cluster

	I0701 12:21:37.628946  652196 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:21:37.628969  652196 cache.go:56] Caching tarball of preloaded images

	I0701 12:21:37.629060  652196 preload.go:173] Found /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0701 12:21:37.629072  652196 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on docker

	I0701 12:21:37.629161  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:37.629353  652196 start.go:360] acquireMachinesLock for ha-735960-m02: {Name:mk43a6c0c0c15a237623df377ad65b82186c0ad8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0701 12:21:37.629411  652196 start.go:364] duration metric: took 31.79µs to acquireMachinesLock for "ha-735960-m02"

	I0701 12:21:37.629427  652196 start.go:96] Skipping create...Using existing machine configuration

	I0701 12:21:37.629440  652196 fix.go:54] fixHost starting: m02

	I0701 12:21:37.629698  652196 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:21:37.629747  652196 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:21:37.644981  652196 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41663

	I0701 12:21:37.645473  652196 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:21:37.645947  652196 main.go:141] libmachine: Using API Version  1

	I0701 12:21:37.645969  652196 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:21:37.646284  652196 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:21:37.646523  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:37.646646  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetState

	I0701 12:21:37.648195  652196 fix.go:112] recreateIfNeeded on ha-735960-m02: state=Stopped err=<nil>

	I0701 12:21:37.648228  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	W0701 12:21:37.648406  652196 fix.go:138] unexpected machine state, will restart: <nil>

	I0701 12:21:37.650489  652196 out.go:177] * Restarting existing kvm2 VM for "ha-735960-m02" ...

	I0701 12:21:37.651975  652196 main.go:141] libmachine: (ha-735960-m02) Calling .Start

	I0701 12:21:37.652186  652196 main.go:141] libmachine: (ha-735960-m02) Ensuring networks are active...

	I0701 12:21:37.652916  652196 main.go:141] libmachine: (ha-735960-m02) Ensuring network default is active

	I0701 12:21:37.653282  652196 main.go:141] libmachine: (ha-735960-m02) Ensuring network mk-ha-735960 is active

	I0701 12:21:37.653613  652196 main.go:141] libmachine: (ha-735960-m02) Getting domain xml...

	I0701 12:21:37.654254  652196 main.go:141] libmachine: (ha-735960-m02) Creating domain...

	I0701 12:21:38.852369  652196 main.go:141] libmachine: (ha-735960-m02) Waiting to get IP...

	I0701 12:21:38.853358  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:38.853762  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:38.853832  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:38.853747  652384 retry.go:31] will retry after 295.798088ms: waiting for machine to come up

	I0701 12:21:39.151332  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:39.151886  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:39.151912  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:39.151845  652384 retry.go:31] will retry after 255.18729ms: waiting for machine to come up

	I0701 12:21:39.408310  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:39.408739  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:39.408792  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:39.408689  652384 retry.go:31] will retry after 457.740061ms: waiting for machine to come up

	I0701 12:21:39.868295  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:39.868702  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:39.868736  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:39.868629  652384 retry.go:31] will retry after 548.674851ms: waiting for machine to come up

	I0701 12:21:40.419597  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:40.420069  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:40.420100  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:40.420009  652384 retry.go:31] will retry after 755.113146ms: waiting for machine to come up

	I0701 12:21:41.176960  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:41.177380  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:41.177429  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:41.177309  652384 retry.go:31] will retry after 739.288718ms: waiting for machine to come up

	I0701 12:21:41.918305  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:41.918853  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:41.918884  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:41.918789  652384 retry.go:31] will retry after 722.041404ms: waiting for machine to come up

	I0701 12:21:42.642704  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:42.643188  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:42.643219  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:42.643113  652384 retry.go:31] will retry after 1.139279839s: waiting for machine to come up

	I0701 12:21:43.784719  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:43.785159  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:43.785193  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:43.785114  652384 retry.go:31] will retry after 1.276779849s: waiting for machine to come up

	I0701 12:21:45.063522  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:45.064026  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:45.064058  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:45.063969  652384 retry.go:31] will retry after 2.284492799s: waiting for machine to come up

	I0701 12:21:47.351530  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:47.352076  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:47.352113  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:47.351988  652384 retry.go:31] will retry after 2.171521184s: waiting for machine to come up

	I0701 12:21:49.526162  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:49.526566  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:49.526590  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:49.526523  652384 retry.go:31] will retry after 3.533181759s: waiting for machine to come up

	I0701 12:21:53.061482  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.062025  652196 main.go:141] libmachine: (ha-735960-m02) Found IP for machine: 192.168.39.86

	I0701 12:21:53.062048  652196 main.go:141] libmachine: (ha-735960-m02) Reserving static IP address...

	I0701 12:21:53.062060  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has current primary IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.062473  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "ha-735960-m02", mac: "52:54:00:0b:2f:ce", ip: "192.168.39.86"} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.062504  652196 main.go:141] libmachine: (ha-735960-m02) DBG | skip adding static IP to network mk-ha-735960 - found existing host DHCP lease matching {name: "ha-735960-m02", mac: "52:54:00:0b:2f:ce", ip: "192.168.39.86"}

	I0701 12:21:53.062534  652196 main.go:141] libmachine: (ha-735960-m02) Reserved static IP address: 192.168.39.86

	I0701 12:21:53.062554  652196 main.go:141] libmachine: (ha-735960-m02) Waiting for SSH to be available...

	I0701 12:21:53.062566  652196 main.go:141] libmachine: (ha-735960-m02) DBG | Getting to WaitForSSH function...

	I0701 12:21:53.064461  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.064796  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.064828  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.064893  652196 main.go:141] libmachine: (ha-735960-m02) DBG | Using SSH client type: external

	I0701 12:21:53.064938  652196 main.go:141] libmachine: (ha-735960-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa (-rw-------)

	I0701 12:21:53.064965  652196 main.go:141] libmachine: (ha-735960-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.86 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0701 12:21:53.064981  652196 main.go:141] libmachine: (ha-735960-m02) DBG | About to run SSH command:

	I0701 12:21:53.065000  652196 main.go:141] libmachine: (ha-735960-m02) DBG | exit 0

	I0701 12:21:53.190266  652196 main.go:141] libmachine: (ha-735960-m02) DBG | SSH cmd err, output: <nil>: 

	I0701 12:21:53.190636  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetConfigRaw

	I0701 12:21:53.191272  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:21:53.193658  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.193994  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.194027  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.194274  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:53.194544  652196 machine.go:94] provisionDockerMachine start ...

	I0701 12:21:53.194562  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:53.194814  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.196894  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.197262  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.197291  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.197414  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.197654  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.197829  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.198021  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.198185  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.198432  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.198448  652196 main.go:141] libmachine: About to run SSH command:

	hostname

	I0701 12:21:53.306480  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0701 12:21:53.306526  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:21:53.306839  652196 buildroot.go:166] provisioning hostname "ha-735960-m02"

	I0701 12:21:53.306870  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:21:53.307063  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.309645  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.310086  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.310116  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.310307  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.310514  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.310689  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.310820  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.310997  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.311210  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.311225  652196 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-735960-m02 && echo "ha-735960-m02" | sudo tee /etc/hostname

	I0701 12:21:53.434956  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-735960-m02

	I0701 12:21:53.434992  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.437612  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.438016  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.438040  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.438190  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.438418  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.438601  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.438768  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.438926  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.439106  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.439128  652196 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-735960-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-735960-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-735960-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0701 12:21:53.559115  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0701 12:21:53.559146  652196 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19166-630650/.minikube CaCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19166-630650/.minikube}

	I0701 12:21:53.559163  652196 buildroot.go:174] setting up certificates

	I0701 12:21:53.559174  652196 provision.go:84] configureAuth start

	I0701 12:21:53.559186  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:21:53.559514  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:21:53.562119  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.562516  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.562550  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.562753  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.564741  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.565063  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.565082  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.565233  652196 provision.go:143] copyHostCerts

	I0701 12:21:53.565266  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:53.565309  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem, removing ...

	I0701 12:21:53.565318  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:53.565379  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem (1078 bytes)

	I0701 12:21:53.565450  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:53.565468  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem, removing ...

	I0701 12:21:53.565474  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:53.565492  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem (1123 bytes)

	I0701 12:21:53.565533  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:53.565549  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem, removing ...

	I0701 12:21:53.565555  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:53.565570  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem (1675 bytes)

	I0701 12:21:53.565618  652196 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem org=jenkins.ha-735960-m02 san=[127.0.0.1 192.168.39.86 ha-735960-m02 localhost minikube]

	I0701 12:21:53.749696  652196 provision.go:177] copyRemoteCerts

	I0701 12:21:53.749755  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0701 12:21:53.749780  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.752460  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.752780  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.752813  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.752952  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.753159  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.753385  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.753547  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:53.835990  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0701 12:21:53.836060  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0701 12:21:53.858665  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0701 12:21:53.858753  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0701 12:21:53.880281  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0701 12:21:53.880367  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0701 12:21:53.902677  652196 provision.go:87] duration metric: took 343.48703ms to configureAuth

	I0701 12:21:53.902709  652196 buildroot.go:189] setting minikube options for container-runtime

	I0701 12:21:53.903020  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:53.903053  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:53.903351  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.905929  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.906189  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.906216  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.906438  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.906667  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.906826  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.906966  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.907119  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.907282  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.907294  652196 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0701 12:21:54.019474  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0701 12:21:54.019501  652196 buildroot.go:70] root file system type: tmpfs

	I0701 12:21:54.019656  652196 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0701 12:21:54.019681  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:54.022816  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.023184  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:54.023208  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.023371  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:54.023579  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.023787  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.023946  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:54.024146  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:54.024319  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:54.024384  652196 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %s "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment="NO_PROXY=192.168.39.16"

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0701 12:21:54.147740  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment=NO_PROXY=192.168.39.16

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0701 12:21:54.147778  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:54.150547  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.151173  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:54.151208  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.151345  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:54.151561  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.151771  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.151918  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:54.152095  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:54.152266  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:54.152281  652196 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0701 12:21:56.028628  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0701 12:21:56.028682  652196 machine.go:97] duration metric: took 2.834118436s to provisionDockerMachine

	I0701 12:21:56.028701  652196 start.go:293] postStartSetup for "ha-735960-m02" (driver="kvm2")

	I0701 12:21:56.028716  652196 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0701 12:21:56.028738  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.029099  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0701 12:21:56.029132  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.031882  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.032264  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.032289  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.032433  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.032608  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.032817  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.032971  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:56.117309  652196 ssh_runner.go:195] Run: cat /etc/os-release

	I0701 12:21:56.121231  652196 info.go:137] Remote host: Buildroot 2023.02.9

	I0701 12:21:56.121263  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/addons for local assets ...

	I0701 12:21:56.121324  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/files for local assets ...

	I0701 12:21:56.121391  652196 filesync.go:149] local asset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> 6378542.pem in /etc/ssl/certs

	I0701 12:21:56.121402  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /etc/ssl/certs/6378542.pem

	I0701 12:21:56.121478  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0701 12:21:56.130302  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:21:56.152776  652196 start.go:296] duration metric: took 124.058691ms for postStartSetup

	I0701 12:21:56.152821  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.153142  652196 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup

	I0701 12:21:56.153170  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.155689  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.156094  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.156120  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.156332  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.156555  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.156727  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.156917  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:56.240391  652196 machine.go:198] restoring vm config from /var/lib/minikube/backup: [etc]

	I0701 12:21:56.240454  652196 ssh_runner.go:195] Run: sudo rsync --archive --update /var/lib/minikube/backup/etc /

	I0701 12:21:56.280843  652196 fix.go:56] duration metric: took 18.651393475s for fixHost

	I0701 12:21:56.280895  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.283268  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.283590  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.283617  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.283860  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.284107  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.284307  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.284501  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.284686  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:56.284888  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:56.284903  652196 main.go:141] libmachine: About to run SSH command:

	date +%s.%N

	I0701 12:21:56.398873  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 1719836516.359963406

	I0701 12:21:56.398893  652196 fix.go:216] guest clock: 1719836516.359963406

	I0701 12:21:56.398901  652196 fix.go:229] Guest: 2024-07-01 12:21:56.359963406 +0000 UTC Remote: 2024-07-01 12:21:56.280872467 +0000 UTC m=+42.319261894 (delta=79.090939ms)

	I0701 12:21:56.398919  652196 fix.go:200] guest clock delta is within tolerance: 79.090939ms

	I0701 12:21:56.398924  652196 start.go:83] releasing machines lock for "ha-735960-m02", held for 18.769503298s

	I0701 12:21:56.398940  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.399198  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:21:56.401982  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.402404  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.402436  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.404680  652196 out.go:177] * Found network options:

	I0701 12:21:56.406167  652196 out.go:177]   - NO_PROXY=192.168.39.16

	W0701 12:21:56.407620  652196 proxy.go:119] fail to check proxy env: Error ip not in block

	I0701 12:21:56.407664  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.408285  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.408498  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.408606  652196 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0701 12:21:56.408647  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	W0701 12:21:56.408741  652196 proxy.go:119] fail to check proxy env: Error ip not in block

	I0701 12:21:56.408826  652196 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I0701 12:21:56.408849  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.411170  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.411559  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.411598  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.411651  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.411933  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.412130  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.412221  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.412247  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.412295  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.412519  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.412508  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:56.412720  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.412871  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.412987  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	W0701 12:21:56.492511  652196 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0701 12:21:56.492595  652196 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%p, " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0701 12:21:56.515270  652196 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0701 12:21:56.515305  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:56.515419  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:56.549004  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0701 12:21:56.560711  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0701 12:21:56.578763  652196 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0701 12:21:56.578832  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0701 12:21:56.589742  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:56.606645  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0701 12:21:56.620036  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:56.632033  652196 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0701 12:21:56.642458  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0701 12:21:56.653078  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0701 12:21:56.663035  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0701 12:21:56.673203  652196 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0701 12:21:56.682348  652196 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0701 12:21:56.691388  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:56.798709  652196 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0701 12:21:56.821386  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:56.821493  652196 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0701 12:21:56.841303  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:56.857934  652196 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0701 12:21:56.877318  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:56.889777  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:56.901844  652196 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0701 12:21:56.927595  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:56.940849  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %s "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:56.958116  652196 ssh_runner.go:195] Run: which cri-dockerd

	I0701 12:21:56.961664  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0701 12:21:56.969985  652196 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0701 12:21:56.985048  652196 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0701 12:21:57.096072  652196 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0701 12:21:57.211289  652196 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0701 12:21:57.211354  652196 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0701 12:21:57.227069  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:57.341292  652196 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0701 12:22:58.423195  652196 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1m1.08185799s)

	I0701 12:22:58.423268  652196 ssh_runner.go:195] Run: sudo journalctl --no-pager -u docker

	I0701 12:22:58.444321  652196 out.go:177] 

	W0701 12:22:58.445678  652196 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart docker: Process exited with status 1

	stdout:

	stderr:

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xeu docker.service" for details.

	sudo journalctl --no-pager -u docker:

	-- stdout --

	Jul 01 12:21:54 ha-735960-m02 systemd[1]: Starting Docker Application Container Engine...

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.524329635Z" level=info msg="Starting up"

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.525054987Z" level=info msg="containerd not running, starting managed containerd"

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.525787354Z" level=info msg="started new containerd process" address=/var/run/docker/containerd/containerd.sock module=libcontainerd pid=513

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.553695593Z" level=info msg="starting containerd" revision=ae71819c4f5e67bb4d5ae76a6b735f29cc25774e version=v1.7.18

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572290393Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572432449Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572518940Z" level=info msg="loading plugin \"io.containerd.warning.v1.deprecations\"..." type=io.containerd.warning.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572558429Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572981597Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." error="no scratch file generator: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573093539Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573355911Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573425452Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573469593Z" level=warning msg="failed to load plugin io.containerd.snapshotter.v1.devmapper" error="devmapper not configured"

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573505057Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573782642Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.574848351Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.576951334Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: FATAL: Module aufs not found in directory /lib/modules/5.10.207\\n\"): skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577031827Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577253828Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577304329Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577551634Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577624370Z" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured"

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577665230Z" level=info msg="metadata content store policy set" policy=shared

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.580979416Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581128476Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581284824Z" level=info msg="loading plugin \"io.containerd.lease.v1.manager\"..." type=io.containerd.lease.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581371031Z" level=info msg="loading plugin \"io.containerd.streaming.v1.manager\"..." type=io.containerd.streaming.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581432559Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581524784Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581996275Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582118070Z" level=info msg="loading plugin \"io.containerd.runtime.v2.shim\"..." type=io.containerd.runtime.v2

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582162131Z" level=info msg="loading plugin \"io.containerd.sandbox.store.v1.local\"..." type=io.containerd.sandbox.store.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582245548Z" level=info msg="loading plugin \"io.containerd.sandbox.controller.v1.local\"..." type=io.containerd.sandbox.controller.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582319648Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582368655Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582407448Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582445279Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582484550Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582521928Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582558472Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582601035Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582656126Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582693985Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582741537Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582779033Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582815513Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582853076Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582892671Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582938669Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582980248Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandbox-controllers\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583032987Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandboxes\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583083364Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583122445Z" level=info msg="loading plugin \"io.containerd.grpc.v1.streaming\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583161506Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583262727Z" level=info msg="loading plugin \"io.containerd.transfer.v1.local\"..." type=io.containerd.transfer.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583333396Z" level=info msg="loading plugin \"io.containerd.grpc.v1.transfer\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583373579Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583414811Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583520612Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583751718Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.tracing.processor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583800626Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583838317Z" level=info msg="skip loading plugin \"io.containerd.internal.v1.tracing\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583874340Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583912430Z" level=info msg="loading plugin \"io.containerd.nri.v1.nri\"..." type=io.containerd.nri.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583991424Z" level=info msg="NRI interface is disabled by configuration."

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584364167Z" level=info msg=serving... address=/var/run/docker/containerd/containerd-debug.sock

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584467963Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock.ttrpc

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584654486Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584785754Z" level=info msg="containerd successfully booted in 0.032655s"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.555699119Z" level=info msg="[graphdriver] trying configured driver: overlay2"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.620790434Z" level=info msg="Loading containers: start."

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.813021303Z" level=warning msg="ip6tables is enabled, but cannot set up ip6tables chains" error="failed to create NAT chain DOCKER: iptables failed: ip6tables --wait -t nat -N DOCKER: ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)\nPerhaps ip6tables or your kernel needs to be upgraded.\n (exit status 3)"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.888534738Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.940299653Z" level=info msg="Loading containers: done."

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.956534314Z" level=info msg="Docker daemon" commit=ff1e2c0 containerd-snapshotter=false storage-driver=overlay2 version=27.0.1

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.956851438Z" level=info msg="Daemon has completed initialization"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.988054435Z" level=info msg="API listen on /var/run/docker.sock"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.988129188Z" level=info msg="API listen on [::]:2376"

	Jul 01 12:21:55 ha-735960-m02 systemd[1]: Started Docker Application Container Engine.

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.316115209Z" level=info msg="Processing signal 'terminated'"

	Jul 01 12:21:57 ha-735960-m02 systemd[1]: Stopping Docker Application Container Engine...

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317321834Z" level=info msg="stopping event stream following graceful shutdown" error="<nil>" module=libcontainerd namespace=moby

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317386191Z" level=info msg="Daemon shutdown complete"

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317447382Z" level=info msg="stopping event stream following graceful shutdown" error="context canceled" module=libcontainerd namespace=plugins.moby

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317464543Z" level=info msg="stopping healthcheck following graceful shutdown" module=libcontainerd

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: docker.service: Deactivated successfully.

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: Stopped Docker Application Container Engine.

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: Starting Docker Application Container Engine...

	Jul 01 12:21:58 ha-735960-m02 dockerd[1188]: time="2024-07-01T12:21:58.364754006Z" level=info msg="Starting up"

	Jul 01 12:22:58 ha-735960-m02 dockerd[1188]: failed to start daemon: failed to dial "/run/containerd/containerd.sock": failed to dial "/run/containerd/containerd.sock": context deadline exceeded

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: docker.service: Failed with result 'exit-code'.

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: Failed to start Docker Application Container Engine.

	-- /stdout --

	X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart docker: Process exited with status 1

	stdout:

	stderr:

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xeu docker.service" for details.

	sudo journalctl --no-pager -u docker:

	-- stdout --

	Jul 01 12:21:54 ha-735960-m02 systemd[1]: Starting Docker Application Container Engine...

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.524329635Z" level=info msg="Starting up"

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.525054987Z" level=info msg="containerd not running, starting managed containerd"

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.525787354Z" level=info msg="started new containerd process" address=/var/run/docker/containerd/containerd.sock module=libcontainerd pid=513

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.553695593Z" level=info msg="starting containerd" revision=ae71819c4f5e67bb4d5ae76a6b735f29cc25774e version=v1.7.18

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572290393Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572432449Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572518940Z" level=info msg="loading plugin \"io.containerd.warning.v1.deprecations\"..." type=io.containerd.warning.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572558429Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572981597Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." error="no scratch file generator: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573093539Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573355911Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573425452Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573469593Z" level=warning msg="failed to load plugin io.containerd.snapshotter.v1.devmapper" error="devmapper not configured"

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573505057Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573782642Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.574848351Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.576951334Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: FATAL: Module aufs not found in directory /lib/modules/5.10.207\\n\"): skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577031827Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577253828Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577304329Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577551634Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577624370Z" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured"

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577665230Z" level=info msg="metadata content store policy set" policy=shared

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.580979416Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581128476Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581284824Z" level=info msg="loading plugin \"io.containerd.lease.v1.manager\"..." type=io.containerd.lease.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581371031Z" level=info msg="loading plugin \"io.containerd.streaming.v1.manager\"..." type=io.containerd.streaming.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581432559Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581524784Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581996275Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582118070Z" level=info msg="loading plugin \"io.containerd.runtime.v2.shim\"..." type=io.containerd.runtime.v2

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582162131Z" level=info msg="loading plugin \"io.containerd.sandbox.store.v1.local\"..." type=io.containerd.sandbox.store.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582245548Z" level=info msg="loading plugin \"io.containerd.sandbox.controller.v1.local\"..." type=io.containerd.sandbox.controller.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582319648Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582368655Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582407448Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582445279Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582484550Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582521928Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582558472Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582601035Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582656126Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582693985Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582741537Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582779033Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582815513Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582853076Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582892671Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582938669Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582980248Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandbox-controllers\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583032987Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandboxes\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583083364Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583122445Z" level=info msg="loading plugin \"io.containerd.grpc.v1.streaming\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583161506Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583262727Z" level=info msg="loading plugin \"io.containerd.transfer.v1.local\"..." type=io.containerd.transfer.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583333396Z" level=info msg="loading plugin \"io.containerd.grpc.v1.transfer\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583373579Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583414811Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583520612Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583751718Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.tracing.processor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583800626Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583838317Z" level=info msg="skip loading plugin \"io.containerd.internal.v1.tracing\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583874340Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583912430Z" level=info msg="loading plugin \"io.containerd.nri.v1.nri\"..." type=io.containerd.nri.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583991424Z" level=info msg="NRI interface is disabled by configuration."

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584364167Z" level=info msg=serving... address=/var/run/docker/containerd/containerd-debug.sock

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584467963Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock.ttrpc

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584654486Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584785754Z" level=info msg="containerd successfully booted in 0.032655s"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.555699119Z" level=info msg="[graphdriver] trying configured driver: overlay2"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.620790434Z" level=info msg="Loading containers: start."

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.813021303Z" level=warning msg="ip6tables is enabled, but cannot set up ip6tables chains" error="failed to create NAT chain DOCKER: iptables failed: ip6tables --wait -t nat -N DOCKER: ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)\nPerhaps ip6tables or your kernel needs to be upgraded.\n (exit status 3)"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.888534738Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.940299653Z" level=info msg="Loading containers: done."

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.956534314Z" level=info msg="Docker daemon" commit=ff1e2c0 containerd-snapshotter=false storage-driver=overlay2 version=27.0.1

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.956851438Z" level=info msg="Daemon has completed initialization"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.988054435Z" level=info msg="API listen on /var/run/docker.sock"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.988129188Z" level=info msg="API listen on [::]:2376"

	Jul 01 12:21:55 ha-735960-m02 systemd[1]: Started Docker Application Container Engine.

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.316115209Z" level=info msg="Processing signal 'terminated'"

	Jul 01 12:21:57 ha-735960-m02 systemd[1]: Stopping Docker Application Container Engine...

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317321834Z" level=info msg="stopping event stream following graceful shutdown" error="<nil>" module=libcontainerd namespace=moby

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317386191Z" level=info msg="Daemon shutdown complete"

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317447382Z" level=info msg="stopping event stream following graceful shutdown" error="context canceled" module=libcontainerd namespace=plugins.moby

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317464543Z" level=info msg="stopping healthcheck following graceful shutdown" module=libcontainerd

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: docker.service: Deactivated successfully.

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: Stopped Docker Application Container Engine.

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: Starting Docker Application Container Engine...

	Jul 01 12:21:58 ha-735960-m02 dockerd[1188]: time="2024-07-01T12:21:58.364754006Z" level=info msg="Starting up"

	Jul 01 12:22:58 ha-735960-m02 dockerd[1188]: failed to start daemon: failed to dial "/run/containerd/containerd.sock": failed to dial "/run/containerd/containerd.sock": context deadline exceeded

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: docker.service: Failed with result 'exit-code'.

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: Failed to start Docker Application Container Engine.

	-- /stdout --

	W0701 12:22:58.445741  652196 out.go:239] * 

	* 

	W0701 12:22:58.447325  652196 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0701 12:22:58.449434  652196 out.go:177] 

** /stderr **

ha_test.go:469: failed to run minikube start. args "out/minikube-linux-amd64 node list -p ha-735960 -v=7 --alsologtostderr" : exit status 90

ha_test.go:472: (dbg) Run:  out/minikube-linux-amd64 node list -p ha-735960

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-735960 -n ha-735960

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p ha-735960 -n ha-735960: exit status 2 (231.983714ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:239: status error: exit status 2 (may be ok)

helpers_test.go:244: <<< TestMultiControlPlane/serial/RestartClusterKeepsNodes FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/RestartClusterKeepsNodes]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-735960 logs -n 25

helpers_test.go:252: TestMultiControlPlane/serial/RestartClusterKeepsNodes logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| cp      | ha-735960 cp ha-735960-m03:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m02:/home/docker/cp-test_ha-735960-m03_ha-735960-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m02 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m03_ha-735960-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m03:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04:/home/docker/cp-test_ha-735960-m03_ha-735960-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m04 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m03_ha-735960-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-735960 cp testdata/cp-test.txt                                                | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile2826819896/001/cp-test_ha-735960-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960:/home/docker/cp-test_ha-735960-m04_ha-735960.txt                       |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960 sudo cat                                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m04_ha-735960.txt                                 |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m02:/home/docker/cp-test_ha-735960-m04_ha-735960-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m02 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m04_ha-735960-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m03:/home/docker/cp-test_ha-735960-m04_ha-735960-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m03 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m04_ha-735960-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-735960 node stop m02 -v=7                                                     | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | ha-735960 node start m02 -v=7                                                    | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:20 UTC |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | list -p ha-735960 -v=7                                                           | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:20 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| stop    | -p ha-735960 -v=7                                                                | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:20 UTC | 01 Jul 24 12:21 UTC |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| start   | -p ha-735960 --wait=true -v=7                                                    | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:21 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | list -p ha-735960                                                                | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:22 UTC |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/07/01 12:21:13

	Running on machine: ubuntu-20-agent-7

	Binary: Built with gc go1.22.4 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0701 12:21:13.996326  652196 out.go:291] Setting OutFile to fd 1 ...

	I0701 12:21:13.996600  652196 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:21:13.996610  652196 out.go:304] Setting ErrFile to fd 2...

	I0701 12:21:13.996615  652196 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:21:13.996825  652196 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19166-630650/.minikube/bin

	I0701 12:21:13.997417  652196 out.go:298] Setting JSON to false

	I0701 12:21:13.998463  652196 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-7","uptime":7412,"bootTime":1719829062,"procs":181,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0701 12:21:13.998525  652196 start.go:139] virtualization: kvm guest

	I0701 12:21:14.000967  652196 out.go:177] * [ha-735960] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0701 12:21:14.002666  652196 out.go:177]   - MINIKUBE_LOCATION=19166

	I0701 12:21:14.002690  652196 notify.go:220] Checking for updates...

	I0701 12:21:14.005489  652196 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0701 12:21:14.006983  652196 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:14.008350  652196 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19166-630650/.minikube

	I0701 12:21:14.009593  652196 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0701 12:21:14.011091  652196 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0701 12:21:14.012857  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:14.012999  652196 driver.go:392] Setting default libvirt URI to qemu:///system

	I0701 12:21:14.013468  652196 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:21:14.013542  652196 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:21:14.028581  652196 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35775

	I0701 12:21:14.028967  652196 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:21:14.029528  652196 main.go:141] libmachine: Using API Version  1

	I0701 12:21:14.029551  652196 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:21:14.029916  652196 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:21:14.030116  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:14.065038  652196 out.go:177] * Using the kvm2 driver based on existing profile

	I0701 12:21:14.066535  652196 start.go:297] selected driver: kvm2

	I0701 12:21:14.066551  652196 start.go:901] validating driver "kvm2" against &{Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVer

sion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:fal

se efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVers

ion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:21:14.066723  652196 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0701 12:21:14.067041  652196 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0701 12:21:14.067114  652196 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19166-630650/.minikube/bin:/home/jenkins/workspace/KVM_Linux_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0701 12:21:14.082191  652196 install.go:137] /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0701 12:21:14.082920  652196 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0701 12:21:14.082959  652196 cni.go:84] Creating CNI manager for ""

	I0701 12:21:14.082966  652196 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0701 12:21:14.083026  652196 start.go:340] cluster config:

	{Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39

.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false h

elm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]

MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:21:14.083142  652196 iso.go:125] acquiring lock: {Name:mk5c70910f61bc270c83609c48670eaf9d7e0602 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0701 12:21:14.086358  652196 out.go:177] * Starting "ha-735960" primary control-plane node in "ha-735960" cluster

	I0701 12:21:14.087757  652196 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:21:14.087794  652196 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4

	I0701 12:21:14.087805  652196 cache.go:56] Caching tarball of preloaded images

	I0701 12:21:14.087882  652196 preload.go:173] Found /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0701 12:21:14.087892  652196 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on docker

	I0701 12:21:14.088044  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:14.088232  652196 start.go:360] acquireMachinesLock for ha-735960: {Name:mk43a6c0c0c15a237623df377ad65b82186c0ad8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0701 12:21:14.088271  652196 start.go:364] duration metric: took 21.615µs to acquireMachinesLock for "ha-735960"

	I0701 12:21:14.088285  652196 start.go:96] Skipping create...Using existing machine configuration

	I0701 12:21:14.088293  652196 fix.go:54] fixHost starting: 

	I0701 12:21:14.088547  652196 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:21:14.088578  652196 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:21:14.103070  652196 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42935

	I0701 12:21:14.103508  652196 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:21:14.104025  652196 main.go:141] libmachine: Using API Version  1

	I0701 12:21:14.104050  652196 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:21:14.104424  652196 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:21:14.104649  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:14.104829  652196 main.go:141] libmachine: (ha-735960) Calling .GetState

	I0701 12:21:14.106608  652196 fix.go:112] recreateIfNeeded on ha-735960: state=Stopped err=<nil>

	I0701 12:21:14.106630  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	W0701 12:21:14.106790  652196 fix.go:138] unexpected machine state, will restart: <nil>

	I0701 12:21:14.108833  652196 out.go:177] * Restarting existing kvm2 VM for "ha-735960" ...

	I0701 12:21:14.110060  652196 main.go:141] libmachine: (ha-735960) Calling .Start

	I0701 12:21:14.110234  652196 main.go:141] libmachine: (ha-735960) Ensuring networks are active...

	I0701 12:21:14.110976  652196 main.go:141] libmachine: (ha-735960) Ensuring network default is active

	I0701 12:21:14.111299  652196 main.go:141] libmachine: (ha-735960) Ensuring network mk-ha-735960 is active

	I0701 12:21:14.111665  652196 main.go:141] libmachine: (ha-735960) Getting domain xml...

	I0701 12:21:14.112420  652196 main.go:141] libmachine: (ha-735960) Creating domain...

	I0701 12:21:15.307133  652196 main.go:141] libmachine: (ha-735960) Waiting to get IP...

	I0701 12:21:15.308062  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:15.308526  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:15.308647  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:15.308493  652224 retry.go:31] will retry after 239.111405ms: waiting for machine to come up

	I0701 12:21:15.549211  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:15.549648  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:15.549679  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:15.549597  652224 retry.go:31] will retry after 248.256131ms: waiting for machine to come up

	I0701 12:21:15.799054  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:15.799481  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:15.799534  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:15.799422  652224 retry.go:31] will retry after 380.468685ms: waiting for machine to come up

	I0701 12:21:16.181969  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:16.182432  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:16.182634  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:16.182540  652224 retry.go:31] will retry after 592.847587ms: waiting for machine to come up

	I0701 12:21:16.777393  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:16.777837  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:16.777867  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:16.777790  652224 retry.go:31] will retry after 639.749416ms: waiting for machine to come up

	I0701 12:21:17.419540  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:17.419941  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:17.419965  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:17.419916  652224 retry.go:31] will retry after 891.768613ms: waiting for machine to come up

	I0701 12:21:18.312967  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:18.313455  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:18.313484  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:18.313399  652224 retry.go:31] will retry after 1.112048412s: waiting for machine to come up

	I0701 12:21:19.427190  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:19.427624  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:19.427655  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:19.427568  652224 retry.go:31] will retry after 1.150138437s: waiting for machine to come up

	I0701 12:21:20.579868  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:20.580291  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:20.580325  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:20.580216  652224 retry.go:31] will retry after 1.129763596s: waiting for machine to come up

	I0701 12:21:21.711416  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:21.711892  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:21.711924  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:21.711831  652224 retry.go:31] will retry after 2.143074349s: waiting for machine to come up

	I0701 12:21:23.858081  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:23.858617  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:23.858643  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:23.858578  652224 retry.go:31] will retry after 2.436757856s: waiting for machine to come up

	I0701 12:21:26.297727  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:26.298302  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:26.298352  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:26.298269  652224 retry.go:31] will retry after 2.609229165s: waiting for machine to come up

	I0701 12:21:28.911224  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.911698  652196 main.go:141] libmachine: (ha-735960) Found IP for machine: 192.168.39.16

	I0701 12:21:28.911722  652196 main.go:141] libmachine: (ha-735960) Reserving static IP address...

	I0701 12:21:28.911731  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has current primary IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.912401  652196 main.go:141] libmachine: (ha-735960) Reserved static IP address: 192.168.39.16

	I0701 12:21:28.912425  652196 main.go:141] libmachine: (ha-735960) Waiting for SSH to be available...

	I0701 12:21:28.912468  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "ha-735960", mac: "52:54:00:6c:20:7c", ip: "192.168.39.16"} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:28.912492  652196 main.go:141] libmachine: (ha-735960) DBG | skip adding static IP to network mk-ha-735960 - found existing host DHCP lease matching {name: "ha-735960", mac: "52:54:00:6c:20:7c", ip: "192.168.39.16"}

	I0701 12:21:28.912507  652196 main.go:141] libmachine: (ha-735960) DBG | Getting to WaitForSSH function...

	I0701 12:21:28.914934  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.915448  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:28.915478  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.915627  652196 main.go:141] libmachine: (ha-735960) DBG | Using SSH client type: external

	I0701 12:21:28.915655  652196 main.go:141] libmachine: (ha-735960) DBG | Using SSH private key: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa (-rw-------)

	I0701 12:21:28.915680  652196 main.go:141] libmachine: (ha-735960) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.16 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0701 12:21:28.915698  652196 main.go:141] libmachine: (ha-735960) DBG | About to run SSH command:

	I0701 12:21:28.915730  652196 main.go:141] libmachine: (ha-735960) DBG | exit 0

	I0701 12:21:29.042314  652196 main.go:141] libmachine: (ha-735960) DBG | SSH cmd err, output: <nil>: 

	I0701 12:21:29.042747  652196 main.go:141] libmachine: (ha-735960) Calling .GetConfigRaw

	I0701 12:21:29.043414  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:29.046291  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.046689  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.046714  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.046967  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:29.047187  652196 machine.go:94] provisionDockerMachine start ...

	I0701 12:21:29.047211  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:29.047467  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.049524  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.049899  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.049924  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.050040  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.050240  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.050477  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.050669  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.050868  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.051073  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.051086  652196 main.go:141] libmachine: About to run SSH command:

	hostname

	I0701 12:21:29.166645  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0701 12:21:29.166687  652196 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:21:29.166983  652196 buildroot.go:166] provisioning hostname "ha-735960"

	I0701 12:21:29.167013  652196 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:21:29.167232  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.169829  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.170228  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.170260  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.170403  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.170603  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.170773  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.170913  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.171082  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.171259  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.171270  652196 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-735960 && echo "ha-735960" | sudo tee /etc/hostname

	I0701 12:21:29.295697  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-735960

	I0701 12:21:29.295728  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.298625  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.299014  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.299041  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.299233  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.299434  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.299641  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.299795  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.299954  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.300149  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.300171  652196 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-735960' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-735960/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-735960' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0701 12:21:29.418489  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0701 12:21:29.418522  652196 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19166-630650/.minikube CaCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19166-630650/.minikube}

	I0701 12:21:29.418577  652196 buildroot.go:174] setting up certificates

	I0701 12:21:29.418593  652196 provision.go:84] configureAuth start

	I0701 12:21:29.418612  652196 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:21:29.418889  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:29.421815  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.422238  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.422275  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.422477  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.424787  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.425187  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.425216  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.425427  652196 provision.go:143] copyHostCerts

	I0701 12:21:29.425466  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:29.425530  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem, removing ...

	I0701 12:21:29.425542  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:29.425624  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem (1078 bytes)

	I0701 12:21:29.425732  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:29.425753  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem, removing ...

	I0701 12:21:29.425758  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:29.425798  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem (1123 bytes)

	I0701 12:21:29.425856  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:29.425872  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem, removing ...

	I0701 12:21:29.425877  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:29.425897  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem (1675 bytes)

	I0701 12:21:29.425958  652196 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem org=jenkins.ha-735960 san=[127.0.0.1 192.168.39.16 ha-735960 localhost minikube]

	I0701 12:21:29.592360  652196 provision.go:177] copyRemoteCerts

	I0701 12:21:29.592437  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0701 12:21:29.592463  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.595489  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.595884  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.595908  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.596131  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.596356  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.596515  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.596646  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:29.684124  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0701 12:21:29.684214  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I0701 12:21:29.707185  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0701 12:21:29.707254  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0701 12:21:29.729605  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0701 12:21:29.729687  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0701 12:21:29.751505  652196 provision.go:87] duration metric: took 332.894756ms to configureAuth

	I0701 12:21:29.751536  652196 buildroot.go:189] setting minikube options for container-runtime

	I0701 12:21:29.751802  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:29.751834  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:29.752179  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.754903  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.755331  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.755367  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.755494  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.755709  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.755868  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.756016  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.756168  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.756341  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.756351  652196 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0701 12:21:29.867557  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0701 12:21:29.867582  652196 buildroot.go:70] root file system type: tmpfs

	I0701 12:21:29.867738  652196 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0701 12:21:29.867768  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.870702  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.871111  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.871152  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.871294  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.871532  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.871806  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.871989  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.872177  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.872347  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.872410  652196 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0701 12:21:29.995623  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0701 12:21:29.995671  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.998574  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.998969  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.999001  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.999184  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.999403  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.999598  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.999772  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.999916  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:30.000093  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:30.000109  652196 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0701 12:21:31.849411  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0701 12:21:31.849452  652196 machine.go:97] duration metric: took 2.802248138s to provisionDockerMachine

	I0701 12:21:31.849473  652196 start.go:293] postStartSetup for "ha-735960" (driver="kvm2")

	I0701 12:21:31.849487  652196 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0701 12:21:31.849508  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:31.849934  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0701 12:21:31.849982  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:31.853029  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.853464  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:31.853494  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.853656  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:31.853877  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:31.854065  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:31.854242  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:31.948096  652196 ssh_runner.go:195] Run: cat /etc/os-release

	I0701 12:21:31.952493  652196 info.go:137] Remote host: Buildroot 2023.02.9

	I0701 12:21:31.952522  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/addons for local assets ...

	I0701 12:21:31.952580  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/files for local assets ...

	I0701 12:21:31.952654  652196 filesync.go:149] local asset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> 6378542.pem in /etc/ssl/certs

	I0701 12:21:31.952664  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /etc/ssl/certs/6378542.pem

	I0701 12:21:31.952750  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0701 12:21:31.962034  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:21:31.985898  652196 start.go:296] duration metric: took 136.407484ms for postStartSetup

	I0701 12:21:31.985953  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:31.986287  652196 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup

	I0701 12:21:31.986316  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:31.988934  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.989328  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:31.989359  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.989497  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:31.989724  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:31.989863  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:31.990038  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:32.076710  652196 machine.go:198] restoring vm config from /var/lib/minikube/backup: [etc]

	I0701 12:21:32.076807  652196 ssh_runner.go:195] Run: sudo rsync --archive --update /var/lib/minikube/backup/etc /

	I0701 12:21:32.133792  652196 fix.go:56] duration metric: took 18.045488816s for fixHost

	I0701 12:21:32.133863  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:32.136703  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.137078  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.137110  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.137321  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:32.137591  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.137793  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.137963  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:32.138201  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:32.138518  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:32.138541  652196 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0701 12:21:32.254973  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 1719836492.215186729

	I0701 12:21:32.255001  652196 fix.go:216] guest clock: 1719836492.215186729

	I0701 12:21:32.255007  652196 fix.go:229] Guest: 2024-07-01 12:21:32.215186729 +0000 UTC Remote: 2024-07-01 12:21:32.133836118 +0000 UTC m=+18.172225533 (delta=81.350611ms)

	I0701 12:21:32.255027  652196 fix.go:200] guest clock delta is within tolerance: 81.350611ms

	I0701 12:21:32.255032  652196 start.go:83] releasing machines lock for "ha-735960", held for 18.166751927s

	I0701 12:21:32.255050  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.255338  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:32.258091  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.258459  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.258481  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.258679  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.259224  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.259383  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.259520  652196 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0701 12:21:32.259564  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:32.259693  652196 ssh_runner.go:195] Run: cat /version.json

	I0701 12:21:32.259718  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:32.262127  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.262481  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.262518  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.262538  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.262653  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:32.262845  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.263031  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:32.263054  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.263074  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.263215  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:32.263229  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:32.263398  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.263547  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:32.263699  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:32.343012  652196 ssh_runner.go:195] Run: systemctl --version

	I0701 12:21:32.428409  652196 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0701 12:21:32.433742  652196 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0701 12:21:32.433815  652196 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0701 12:21:32.449052  652196 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0701 12:21:32.449087  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:32.449338  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:32.471651  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0701 12:21:32.481832  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0701 12:21:32.491470  652196 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0701 12:21:32.491548  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0701 12:21:32.501229  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:32.511119  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0701 12:21:32.520826  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:32.530559  652196 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0701 12:21:32.542109  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0701 12:21:32.551821  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0701 12:21:32.561403  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0701 12:21:32.571068  652196 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0701 12:21:32.579813  652196 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0701 12:21:32.588595  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:32.705377  652196 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0701 12:21:32.724169  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:32.724285  652196 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0701 12:21:32.739050  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:32.753169  652196 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0701 12:21:32.769805  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:32.783750  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:32.797509  652196 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0701 12:21:32.821510  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:32.835901  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:32.854192  652196 ssh_runner.go:195] Run: which cri-dockerd

	I0701 12:21:32.858039  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0701 12:21:32.867652  652196 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0701 12:21:32.884216  652196 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0701 12:21:33.001636  652196 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0701 12:21:33.121229  652196 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0701 12:21:33.121419  652196 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0701 12:21:33.138482  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:33.262395  652196 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0701 12:21:35.714549  652196 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.452099351s)

	I0701 12:21:35.714642  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0701 12:21:35.727946  652196 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I0701 12:21:35.744089  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:21:35.757426  652196 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0701 12:21:35.868089  652196 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0701 12:21:35.989857  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:36.121343  652196 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0701 12:21:36.138520  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:21:36.152026  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:36.271312  652196 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0701 12:21:36.351567  652196 start.go:541] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0701 12:21:36.351668  652196 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0701 12:21:36.357143  652196 start.go:562] Will wait 60s for crictl version

	I0701 12:21:36.357212  652196 ssh_runner.go:195] Run: which crictl

	I0701 12:21:36.361384  652196 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0701 12:21:36.400372  652196 start.go:578] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.0.1

	RuntimeApiVersion:  v1

	I0701 12:21:36.400446  652196 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:21:36.427941  652196 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:21:36.456620  652196 out.go:204] * Preparing Kubernetes v1.30.2 on Docker 27.0.1 ...

	I0701 12:21:36.456687  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:36.459384  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:36.459752  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:36.459781  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:36.459970  652196 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0701 12:21:36.463956  652196 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:21:36.476676  652196 kubeadm.go:877] updating cluster {Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Cl

usterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:fa

lse freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p200

0.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0701 12:21:36.476851  652196 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:21:36.476914  652196 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0701 12:21:36.493466  652196 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.30.2

	registry.k8s.io/kube-controller-manager:v1.30.2

	registry.k8s.io/kube-scheduler:v1.30.2

	registry.k8s.io/kube-proxy:v1.30.2

	kindest/kindnetd:v20240513-cd2ac642

	ghcr.io/kube-vip/kube-vip:v0.8.0

	registry.k8s.io/etcd:3.5.12-0

	registry.k8s.io/coredns/coredns:v1.11.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28

	-- /stdout --

	I0701 12:21:36.493530  652196 docker.go:615] Images already preloaded, skipping extraction

	I0701 12:21:36.493620  652196 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0701 12:21:36.510908  652196 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.30.2

	registry.k8s.io/kube-controller-manager:v1.30.2

	registry.k8s.io/kube-scheduler:v1.30.2

	registry.k8s.io/kube-proxy:v1.30.2

	kindest/kindnetd:v20240513-cd2ac642

	ghcr.io/kube-vip/kube-vip:v0.8.0

	registry.k8s.io/etcd:3.5.12-0

	registry.k8s.io/coredns/coredns:v1.11.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28

	-- /stdout --

	I0701 12:21:36.510939  652196 cache_images.go:84] Images are preloaded, skipping loading

	I0701 12:21:36.510952  652196 kubeadm.go:928] updating node { 192.168.39.16 8443 v1.30.2 docker true true} ...

	I0701 12:21:36.511079  652196 kubeadm.go:940] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-735960 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.16

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0701 12:21:36.511139  652196 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0701 12:21:36.536408  652196 cni.go:84] Creating CNI manager for ""

	I0701 12:21:36.536430  652196 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0701 12:21:36.536441  652196 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0701 12:21:36.536470  652196 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.16 APIServerPort:8443 KubernetesVersion:v1.30.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-735960 NodeName:ha-735960 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.16"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.16 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes

/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0701 12:21:36.536633  652196 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.16

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "ha-735960"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.16

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.16"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0701 12:21:36.536656  652196 kube-vip.go:115] generating kube-vip config ...

	I0701 12:21:36.536698  652196 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0701 12:21:36.551906  652196 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0701 12:21:36.552024  652196 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0701 12:21:36.552078  652196 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0701 12:21:36.561989  652196 binaries.go:44] Found k8s binaries, skipping transfer

	I0701 12:21:36.562059  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0701 12:21:36.571281  652196 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0701 12:21:36.587480  652196 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0701 12:21:36.603596  652196 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2154 bytes)

	I0701 12:21:36.621063  652196 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0701 12:21:36.637192  652196 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0701 12:21:36.640909  652196 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:21:36.652690  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:36.768142  652196 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0701 12:21:36.786625  652196 certs.go:68] Setting up /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960 for IP: 192.168.39.16

	I0701 12:21:36.786655  652196 certs.go:194] generating shared ca certs ...

	I0701 12:21:36.786676  652196 certs.go:226] acquiring lock for ca certs: {Name:mk34e166bfd069e523b2325e14d1812c523bff53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:36.786854  652196 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key

	I0701 12:21:36.786904  652196 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key

	I0701 12:21:36.786915  652196 certs.go:256] generating profile certs ...

	I0701 12:21:36.787017  652196 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key

	I0701 12:21:36.787046  652196 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af

	I0701 12:21:36.787059  652196 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.16 192.168.39.86 192.168.39.97 192.168.39.254]

	I0701 12:21:37.059263  652196 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af ...

	I0701 12:21:37.059305  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af: {Name:mk1be9dc4667506ac6fdcfb1e313edd1292fe7f9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.059483  652196 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af ...

	I0701 12:21:37.059496  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af: {Name:mkf9220e489bd04f035dab270c790bb3448ca6be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.059596  652196 certs.go:381] copying /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af -> /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt

	I0701 12:21:37.059809  652196 certs.go:385] copying /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af -> /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key

	I0701 12:21:37.059969  652196 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key

	I0701 12:21:37.059987  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0701 12:21:37.060000  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0701 12:21:37.060014  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0701 12:21:37.060026  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0701 12:21:37.060038  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0701 12:21:37.060054  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0701 12:21:37.060066  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0701 12:21:37.060077  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0701 12:21:37.060165  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem (1338 bytes)

	W0701 12:21:37.060197  652196 certs.go:480] ignoring /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854_empty.pem, impossibly tiny 0 bytes

	I0701 12:21:37.060207  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem (1675 bytes)

	I0701 12:21:37.060228  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem (1078 bytes)

	I0701 12:21:37.060248  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem (1123 bytes)

	I0701 12:21:37.060270  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem (1675 bytes)

	I0701 12:21:37.060305  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:21:37.060331  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem -> /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.060347  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.060359  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.061045  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0701 12:21:37.111708  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0701 12:21:37.168649  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0701 12:21:37.204675  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0701 12:21:37.241167  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)

	I0701 12:21:37.265225  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0701 12:21:37.288613  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0701 12:21:37.312645  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0701 12:21:37.337494  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem --> /usr/share/ca-certificates/637854.pem (1338 bytes)

	I0701 12:21:37.361044  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /usr/share/ca-certificates/6378542.pem (1708 bytes)

	I0701 12:21:37.385424  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0701 12:21:37.409054  652196 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0701 12:21:37.426602  652196 ssh_runner.go:195] Run: openssl version

	I0701 12:21:37.432129  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0701 12:21:37.442695  652196 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.447331  652196 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul  1 12:05 /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.447415  652196 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.453215  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0701 12:21:37.464086  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/637854.pem && ln -fs /usr/share/ca-certificates/637854.pem /etc/ssl/certs/637854.pem"

	I0701 12:21:37.474527  652196 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.479057  652196 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul  1 12:11 /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.479123  652196 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.484641  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/637854.pem /etc/ssl/certs/51391683.0"

	I0701 12:21:37.495175  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6378542.pem && ln -fs /usr/share/ca-certificates/6378542.pem /etc/ssl/certs/6378542.pem"

	I0701 12:21:37.505961  652196 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.510286  652196 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul  1 12:11 /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.510365  652196 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.516124  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/6378542.pem /etc/ssl/certs/3ec20f2e.0"

	I0701 12:21:37.527154  652196 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0701 12:21:37.532024  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I0701 12:21:37.538145  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I0701 12:21:37.544280  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I0701 12:21:37.550448  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I0701 12:21:37.556356  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I0701 12:21:37.562174  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I0701 12:21:37.568144  652196 kubeadm.go:391] StartCluster: {Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Clust

erName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false

freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L

MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:21:37.568362  652196 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0701 12:21:37.586457  652196 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	W0701 12:21:37.596129  652196 kubeadm.go:404] apiserver tunnel failed: apiserver port not set

	I0701 12:21:37.596158  652196 kubeadm.go:407] found existing configuration files, will attempt cluster restart

	I0701 12:21:37.596164  652196 kubeadm.go:587] restartPrimaryControlPlane start ...

	I0701 12:21:37.596237  652196 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I0701 12:21:37.605715  652196 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0701 12:21:37.606193  652196 kubeconfig.go:47] verify endpoint returned: get endpoint: "ha-735960" does not appear in /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:37.606354  652196 kubeconfig.go:62] /home/jenkins/minikube-integration/19166-630650/kubeconfig needs updating (will repair): [kubeconfig missing "ha-735960" cluster setting kubeconfig missing "ha-735960" context setting]

	I0701 12:21:37.606708  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/kubeconfig: {Name:mke3ef9d019eff4edd273b00c416fd77ed009242 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.607135  652196 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:37.607365  652196 kapi.go:59] client config for ha-735960: &rest.Config{Host:"https://192.168.39.16:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.crt", KeyFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key", CAFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(ni

l)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1cfbb80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0701 12:21:37.607752  652196 cert_rotation.go:137] Starting client certificate rotation controller

	I0701 12:21:37.608047  652196 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0701 12:21:37.617685  652196 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.39.16

	I0701 12:21:37.617715  652196 kubeadm.go:591] duration metric: took 21.544408ms to restartPrimaryControlPlane

	I0701 12:21:37.617725  652196 kubeadm.go:393] duration metric: took 49.593354ms to StartCluster

	I0701 12:21:37.617748  652196 settings.go:142] acquiring lock: {Name:mk6f7c85ea77a73ff0ac851454721f2e6e309153 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.617834  652196 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:37.618535  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/kubeconfig: {Name:mke3ef9d019eff4edd273b00c416fd77ed009242 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.618754  652196 start.go:232] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0701 12:21:37.618777  652196 start.go:240] waiting for startup goroutines ...

	I0701 12:21:37.618792  652196 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0701 12:21:37.619028  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:37.621683  652196 out.go:177] * Enabled addons: 

	I0701 12:21:37.622979  652196 addons.go:510] duration metric: took 4.192015ms for enable addons: enabled=[]

	I0701 12:21:37.623011  652196 start.go:245] waiting for cluster config update ...

	I0701 12:21:37.623019  652196 start.go:254] writing updated cluster config ...

	I0701 12:21:37.624600  652196 out.go:177] 

	I0701 12:21:37.626023  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:37.626124  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:37.627745  652196 out.go:177] * Starting "ha-735960-m02" control-plane node in "ha-735960" cluster

	I0701 12:21:37.628946  652196 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:21:37.628969  652196 cache.go:56] Caching tarball of preloaded images

	I0701 12:21:37.629060  652196 preload.go:173] Found /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0701 12:21:37.629072  652196 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on docker

	I0701 12:21:37.629161  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:37.629353  652196 start.go:360] acquireMachinesLock for ha-735960-m02: {Name:mk43a6c0c0c15a237623df377ad65b82186c0ad8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0701 12:21:37.629411  652196 start.go:364] duration metric: took 31.79µs to acquireMachinesLock for "ha-735960-m02"

	I0701 12:21:37.629427  652196 start.go:96] Skipping create...Using existing machine configuration

	I0701 12:21:37.629440  652196 fix.go:54] fixHost starting: m02

	I0701 12:21:37.629698  652196 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:21:37.629747  652196 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:21:37.644981  652196 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41663

	I0701 12:21:37.645473  652196 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:21:37.645947  652196 main.go:141] libmachine: Using API Version  1

	I0701 12:21:37.645969  652196 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:21:37.646284  652196 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:21:37.646523  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:37.646646  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetState

	I0701 12:21:37.648195  652196 fix.go:112] recreateIfNeeded on ha-735960-m02: state=Stopped err=<nil>

	I0701 12:21:37.648228  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	W0701 12:21:37.648406  652196 fix.go:138] unexpected machine state, will restart: <nil>

	I0701 12:21:37.650489  652196 out.go:177] * Restarting existing kvm2 VM for "ha-735960-m02" ...

	I0701 12:21:37.651975  652196 main.go:141] libmachine: (ha-735960-m02) Calling .Start

	I0701 12:21:37.652186  652196 main.go:141] libmachine: (ha-735960-m02) Ensuring networks are active...

	I0701 12:21:37.652916  652196 main.go:141] libmachine: (ha-735960-m02) Ensuring network default is active

	I0701 12:21:37.653282  652196 main.go:141] libmachine: (ha-735960-m02) Ensuring network mk-ha-735960 is active

	I0701 12:21:37.653613  652196 main.go:141] libmachine: (ha-735960-m02) Getting domain xml...

	I0701 12:21:37.654254  652196 main.go:141] libmachine: (ha-735960-m02) Creating domain...

	I0701 12:21:38.852369  652196 main.go:141] libmachine: (ha-735960-m02) Waiting to get IP...

	I0701 12:21:38.853358  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:38.853762  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:38.853832  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:38.853747  652384 retry.go:31] will retry after 295.798088ms: waiting for machine to come up

	I0701 12:21:39.151332  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:39.151886  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:39.151912  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:39.151845  652384 retry.go:31] will retry after 255.18729ms: waiting for machine to come up

	I0701 12:21:39.408310  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:39.408739  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:39.408792  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:39.408689  652384 retry.go:31] will retry after 457.740061ms: waiting for machine to come up

	I0701 12:21:39.868295  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:39.868702  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:39.868736  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:39.868629  652384 retry.go:31] will retry after 548.674851ms: waiting for machine to come up

	I0701 12:21:40.419597  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:40.420069  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:40.420100  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:40.420009  652384 retry.go:31] will retry after 755.113146ms: waiting for machine to come up

	I0701 12:21:41.176960  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:41.177380  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:41.177429  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:41.177309  652384 retry.go:31] will retry after 739.288718ms: waiting for machine to come up

	I0701 12:21:41.918305  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:41.918853  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:41.918884  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:41.918789  652384 retry.go:31] will retry after 722.041404ms: waiting for machine to come up

	I0701 12:21:42.642704  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:42.643188  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:42.643219  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:42.643113  652384 retry.go:31] will retry after 1.139279839s: waiting for machine to come up

	I0701 12:21:43.784719  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:43.785159  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:43.785193  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:43.785114  652384 retry.go:31] will retry after 1.276779849s: waiting for machine to come up

	I0701 12:21:45.063522  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:45.064026  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:45.064058  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:45.063969  652384 retry.go:31] will retry after 2.284492799s: waiting for machine to come up

	I0701 12:21:47.351530  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:47.352076  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:47.352113  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:47.351988  652384 retry.go:31] will retry after 2.171521184s: waiting for machine to come up

	I0701 12:21:49.526162  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:49.526566  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:49.526590  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:49.526523  652384 retry.go:31] will retry after 3.533181759s: waiting for machine to come up

	I0701 12:21:53.061482  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.062025  652196 main.go:141] libmachine: (ha-735960-m02) Found IP for machine: 192.168.39.86

	I0701 12:21:53.062048  652196 main.go:141] libmachine: (ha-735960-m02) Reserving static IP address...

	I0701 12:21:53.062060  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has current primary IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.062473  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "ha-735960-m02", mac: "52:54:00:0b:2f:ce", ip: "192.168.39.86"} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.062504  652196 main.go:141] libmachine: (ha-735960-m02) DBG | skip adding static IP to network mk-ha-735960 - found existing host DHCP lease matching {name: "ha-735960-m02", mac: "52:54:00:0b:2f:ce", ip: "192.168.39.86"}

	I0701 12:21:53.062534  652196 main.go:141] libmachine: (ha-735960-m02) Reserved static IP address: 192.168.39.86

	I0701 12:21:53.062554  652196 main.go:141] libmachine: (ha-735960-m02) Waiting for SSH to be available...

	I0701 12:21:53.062566  652196 main.go:141] libmachine: (ha-735960-m02) DBG | Getting to WaitForSSH function...

	I0701 12:21:53.064461  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.064796  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.064828  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.064893  652196 main.go:141] libmachine: (ha-735960-m02) DBG | Using SSH client type: external

	I0701 12:21:53.064938  652196 main.go:141] libmachine: (ha-735960-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa (-rw-------)

	I0701 12:21:53.064965  652196 main.go:141] libmachine: (ha-735960-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.86 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0701 12:21:53.064981  652196 main.go:141] libmachine: (ha-735960-m02) DBG | About to run SSH command:

	I0701 12:21:53.065000  652196 main.go:141] libmachine: (ha-735960-m02) DBG | exit 0

	I0701 12:21:53.190266  652196 main.go:141] libmachine: (ha-735960-m02) DBG | SSH cmd err, output: <nil>: 

	I0701 12:21:53.190636  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetConfigRaw

	I0701 12:21:53.191272  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:21:53.193658  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.193994  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.194027  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.194274  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:53.194544  652196 machine.go:94] provisionDockerMachine start ...

	I0701 12:21:53.194562  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:53.194814  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.196894  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.197262  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.197291  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.197414  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.197654  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.197829  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.198021  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.198185  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.198432  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.198448  652196 main.go:141] libmachine: About to run SSH command:

	hostname

	I0701 12:21:53.306480  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0701 12:21:53.306526  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:21:53.306839  652196 buildroot.go:166] provisioning hostname "ha-735960-m02"

	I0701 12:21:53.306870  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:21:53.307063  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.309645  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.310086  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.310116  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.310307  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.310514  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.310689  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.310820  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.310997  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.311210  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.311225  652196 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-735960-m02 && echo "ha-735960-m02" | sudo tee /etc/hostname

	I0701 12:21:53.434956  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-735960-m02

	I0701 12:21:53.434992  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.437612  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.438016  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.438040  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.438190  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.438418  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.438601  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.438768  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.438926  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.439106  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.439128  652196 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-735960-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-735960-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-735960-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0701 12:21:53.559115  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0701 12:21:53.559146  652196 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19166-630650/.minikube CaCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19166-630650/.minikube}

	I0701 12:21:53.559163  652196 buildroot.go:174] setting up certificates

	I0701 12:21:53.559174  652196 provision.go:84] configureAuth start

	I0701 12:21:53.559186  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:21:53.559514  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:21:53.562119  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.562516  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.562550  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.562753  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.564741  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.565063  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.565082  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.565233  652196 provision.go:143] copyHostCerts

	I0701 12:21:53.565266  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:53.565309  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem, removing ...

	I0701 12:21:53.565318  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:53.565379  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem (1078 bytes)

	I0701 12:21:53.565450  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:53.565468  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem, removing ...

	I0701 12:21:53.565474  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:53.565492  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem (1123 bytes)

	I0701 12:21:53.565533  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:53.565549  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem, removing ...

	I0701 12:21:53.565555  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:53.565570  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem (1675 bytes)

	I0701 12:21:53.565618  652196 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem org=jenkins.ha-735960-m02 san=[127.0.0.1 192.168.39.86 ha-735960-m02 localhost minikube]

	I0701 12:21:53.749696  652196 provision.go:177] copyRemoteCerts

	I0701 12:21:53.749755  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0701 12:21:53.749780  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.752460  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.752780  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.752813  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.752952  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.753159  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.753385  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.753547  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:53.835990  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0701 12:21:53.836060  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0701 12:21:53.858665  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0701 12:21:53.858753  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0701 12:21:53.880281  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0701 12:21:53.880367  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0701 12:21:53.902677  652196 provision.go:87] duration metric: took 343.48703ms to configureAuth

	I0701 12:21:53.902709  652196 buildroot.go:189] setting minikube options for container-runtime

	I0701 12:21:53.903020  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:53.903053  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:53.903351  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.905929  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.906189  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.906216  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.906438  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.906667  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.906826  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.906966  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.907119  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.907282  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.907294  652196 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0701 12:21:54.019474  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0701 12:21:54.019501  652196 buildroot.go:70] root file system type: tmpfs

	I0701 12:21:54.019656  652196 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0701 12:21:54.019681  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:54.022816  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.023184  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:54.023208  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.023371  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:54.023579  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.023787  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.023946  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:54.024146  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:54.024319  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:54.024384  652196 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment="NO_PROXY=192.168.39.16"

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0701 12:21:54.147740  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment=NO_PROXY=192.168.39.16

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0701 12:21:54.147778  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:54.150547  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.151173  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:54.151208  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.151345  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:54.151561  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.151771  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.151918  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:54.152095  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:54.152266  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:54.152281  652196 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0701 12:21:56.028628  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0701 12:21:56.028682  652196 machine.go:97] duration metric: took 2.834118436s to provisionDockerMachine

	I0701 12:21:56.028701  652196 start.go:293] postStartSetup for "ha-735960-m02" (driver="kvm2")

	I0701 12:21:56.028716  652196 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0701 12:21:56.028738  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.029099  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0701 12:21:56.029132  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.031882  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.032264  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.032289  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.032433  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.032608  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.032817  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.032971  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:56.117309  652196 ssh_runner.go:195] Run: cat /etc/os-release

	I0701 12:21:56.121231  652196 info.go:137] Remote host: Buildroot 2023.02.9

	I0701 12:21:56.121263  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/addons for local assets ...

	I0701 12:21:56.121324  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/files for local assets ...

	I0701 12:21:56.121391  652196 filesync.go:149] local asset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> 6378542.pem in /etc/ssl/certs

	I0701 12:21:56.121402  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /etc/ssl/certs/6378542.pem

	I0701 12:21:56.121478  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0701 12:21:56.130302  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:21:56.152776  652196 start.go:296] duration metric: took 124.058691ms for postStartSetup

	I0701 12:21:56.152821  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.153142  652196 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup

	I0701 12:21:56.153170  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.155689  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.156094  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.156120  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.156332  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.156555  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.156727  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.156917  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:56.240391  652196 machine.go:198] restoring vm config from /var/lib/minikube/backup: [etc]

	I0701 12:21:56.240454  652196 ssh_runner.go:195] Run: sudo rsync --archive --update /var/lib/minikube/backup/etc /

	I0701 12:21:56.280843  652196 fix.go:56] duration metric: took 18.651393475s for fixHost

	I0701 12:21:56.280895  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.283268  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.283590  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.283617  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.283860  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.284107  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.284307  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.284501  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.284686  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:56.284888  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:56.284903  652196 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0701 12:21:56.398873  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 1719836516.359963406

	I0701 12:21:56.398893  652196 fix.go:216] guest clock: 1719836516.359963406

	I0701 12:21:56.398901  652196 fix.go:229] Guest: 2024-07-01 12:21:56.359963406 +0000 UTC Remote: 2024-07-01 12:21:56.280872467 +0000 UTC m=+42.319261894 (delta=79.090939ms)

	I0701 12:21:56.398919  652196 fix.go:200] guest clock delta is within tolerance: 79.090939ms

	I0701 12:21:56.398924  652196 start.go:83] releasing machines lock for "ha-735960-m02", held for 18.769503298s

	I0701 12:21:56.398940  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.399198  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:21:56.401982  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.402404  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.402436  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.404680  652196 out.go:177] * Found network options:

	I0701 12:21:56.406167  652196 out.go:177]   - NO_PROXY=192.168.39.16

	W0701 12:21:56.407620  652196 proxy.go:119] fail to check proxy env: Error ip not in block

	I0701 12:21:56.407664  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.408285  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.408498  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.408606  652196 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0701 12:21:56.408647  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	W0701 12:21:56.408741  652196 proxy.go:119] fail to check proxy env: Error ip not in block

	I0701 12:21:56.408826  652196 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I0701 12:21:56.408849  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.411170  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.411559  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.411598  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.411651  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.411933  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.412130  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.412221  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.412247  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.412295  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.412519  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.412508  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:56.412720  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.412871  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.412987  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	W0701 12:21:56.492511  652196 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0701 12:21:56.492595  652196 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0701 12:21:56.515270  652196 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0701 12:21:56.515305  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:56.515419  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:56.549004  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0701 12:21:56.560711  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0701 12:21:56.578763  652196 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0701 12:21:56.578832  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0701 12:21:56.589742  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:56.606645  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0701 12:21:56.620036  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:56.632033  652196 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0701 12:21:56.642458  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0701 12:21:56.653078  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0701 12:21:56.663035  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0701 12:21:56.673203  652196 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0701 12:21:56.682348  652196 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0701 12:21:56.691388  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:56.798709  652196 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0701 12:21:56.821386  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:56.821493  652196 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0701 12:21:56.841303  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:56.857934  652196 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0701 12:21:56.877318  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:56.889777  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:56.901844  652196 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0701 12:21:56.927595  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:56.940849  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:56.958116  652196 ssh_runner.go:195] Run: which cri-dockerd

	I0701 12:21:56.961664  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0701 12:21:56.969985  652196 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0701 12:21:56.985048  652196 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0701 12:21:57.096072  652196 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0701 12:21:57.211289  652196 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0701 12:21:57.211354  652196 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0701 12:21:57.227069  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:57.341292  652196 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0701 12:22:58.423195  652196 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1m1.08185799s)

	I0701 12:22:58.423268  652196 ssh_runner.go:195] Run: sudo journalctl --no-pager -u docker

	I0701 12:22:58.444321  652196 out.go:177] 

	W0701 12:22:58.445678  652196 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart docker: Process exited with status 1

	stdout:

	stderr:

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xeu docker.service" for details.

	sudo journalctl --no-pager -u docker:

	-- stdout --

	Jul 01 12:21:54 ha-735960-m02 systemd[1]: Starting Docker Application Container Engine...

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.524329635Z" level=info msg="Starting up"

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.525054987Z" level=info msg="containerd not running, starting managed containerd"

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.525787354Z" level=info msg="started new containerd process" address=/var/run/docker/containerd/containerd.sock module=libcontainerd pid=513

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.553695593Z" level=info msg="starting containerd" revision=ae71819c4f5e67bb4d5ae76a6b735f29cc25774e version=v1.7.18

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572290393Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572432449Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572518940Z" level=info msg="loading plugin \"io.containerd.warning.v1.deprecations\"..." type=io.containerd.warning.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572558429Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572981597Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." error="no scratch file generator: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573093539Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573355911Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573425452Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573469593Z" level=warning msg="failed to load plugin io.containerd.snapshotter.v1.devmapper" error="devmapper not configured"

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573505057Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573782642Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.574848351Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.576951334Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: FATAL: Module aufs not found in directory /lib/modules/5.10.207\\n\"): skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577031827Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577253828Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577304329Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577551634Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577624370Z" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured"

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577665230Z" level=info msg="metadata content store policy set" policy=shared

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.580979416Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581128476Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581284824Z" level=info msg="loading plugin \"io.containerd.lease.v1.manager\"..." type=io.containerd.lease.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581371031Z" level=info msg="loading plugin \"io.containerd.streaming.v1.manager\"..." type=io.containerd.streaming.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581432559Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581524784Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581996275Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582118070Z" level=info msg="loading plugin \"io.containerd.runtime.v2.shim\"..." type=io.containerd.runtime.v2

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582162131Z" level=info msg="loading plugin \"io.containerd.sandbox.store.v1.local\"..." type=io.containerd.sandbox.store.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582245548Z" level=info msg="loading plugin \"io.containerd.sandbox.controller.v1.local\"..." type=io.containerd.sandbox.controller.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582319648Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582368655Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582407448Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582445279Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582484550Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582521928Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582558472Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582601035Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582656126Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582693985Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582741537Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582779033Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582815513Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582853076Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582892671Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582938669Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582980248Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandbox-controllers\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583032987Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandboxes\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583083364Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583122445Z" level=info msg="loading plugin \"io.containerd.grpc.v1.streaming\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583161506Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583262727Z" level=info msg="loading plugin \"io.containerd.transfer.v1.local\"..." type=io.containerd.transfer.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583333396Z" level=info msg="loading plugin \"io.containerd.grpc.v1.transfer\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583373579Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583414811Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583520612Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583751718Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.tracing.processor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583800626Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583838317Z" level=info msg="skip loading plugin \"io.containerd.internal.v1.tracing\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583874340Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583912430Z" level=info msg="loading plugin \"io.containerd.nri.v1.nri\"..." type=io.containerd.nri.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583991424Z" level=info msg="NRI interface is disabled by configuration."

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584364167Z" level=info msg=serving... address=/var/run/docker/containerd/containerd-debug.sock

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584467963Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock.ttrpc

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584654486Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584785754Z" level=info msg="containerd successfully booted in 0.032655s"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.555699119Z" level=info msg="[graphdriver] trying configured driver: overlay2"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.620790434Z" level=info msg="Loading containers: start."

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.813021303Z" level=warning msg="ip6tables is enabled, but cannot set up ip6tables chains" error="failed to create NAT chain DOCKER: iptables failed: ip6tables --wait -t nat -N DOCKER: ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)\nPerhaps ip6tables or your kernel needs to be upgraded.\n (exit status 3)"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.888534738Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.940299653Z" level=info msg="Loading containers: done."

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.956534314Z" level=info msg="Docker daemon" commit=ff1e2c0 containerd-snapshotter=false storage-driver=overlay2 version=27.0.1

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.956851438Z" level=info msg="Daemon has completed initialization"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.988054435Z" level=info msg="API listen on /var/run/docker.sock"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.988129188Z" level=info msg="API listen on [::]:2376"

	Jul 01 12:21:55 ha-735960-m02 systemd[1]: Started Docker Application Container Engine.

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.316115209Z" level=info msg="Processing signal 'terminated'"

	Jul 01 12:21:57 ha-735960-m02 systemd[1]: Stopping Docker Application Container Engine...

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317321834Z" level=info msg="stopping event stream following graceful shutdown" error="<nil>" module=libcontainerd namespace=moby

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317386191Z" level=info msg="Daemon shutdown complete"

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317447382Z" level=info msg="stopping event stream following graceful shutdown" error="context canceled" module=libcontainerd namespace=plugins.moby

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317464543Z" level=info msg="stopping healthcheck following graceful shutdown" module=libcontainerd

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: docker.service: Deactivated successfully.

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: Stopped Docker Application Container Engine.

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: Starting Docker Application Container Engine...

	Jul 01 12:21:58 ha-735960-m02 dockerd[1188]: time="2024-07-01T12:21:58.364754006Z" level=info msg="Starting up"

	Jul 01 12:22:58 ha-735960-m02 dockerd[1188]: failed to start daemon: failed to dial "/run/containerd/containerd.sock": failed to dial "/run/containerd/containerd.sock": context deadline exceeded

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: docker.service: Failed with result 'exit-code'.

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: Failed to start Docker Application Container Engine.

	-- /stdout --

	W0701 12:22:58.445741  652196 out.go:239] * 

	W0701 12:22:58.447325  652196 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0701 12:22:58.449434  652196 out.go:177] 

	==> Docker <==

	Jul 01 12:21:44 ha-735960 dockerd[1190]: time="2024-07-01T12:21:44.208507474Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:05 ha-735960 dockerd[1184]: time="2024-07-01T12:22:05.425890009Z" level=info msg="ignoring event" container=d97b6df80577316a9cf70b2af0f8d52bb2bd7071ff932a8f1f03df9497724786 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Jul 01 12:22:05 ha-735960 dockerd[1190]: time="2024-07-01T12:22:05.426406022Z" level=info msg="shim disconnected" id=d97b6df80577316a9cf70b2af0f8d52bb2bd7071ff932a8f1f03df9497724786 namespace=moby

	Jul 01 12:22:05 ha-735960 dockerd[1190]: time="2024-07-01T12:22:05.427162251Z" level=warning msg="cleaning up after shim disconnected" id=d97b6df80577316a9cf70b2af0f8d52bb2bd7071ff932a8f1f03df9497724786 namespace=moby

	Jul 01 12:22:05 ha-735960 dockerd[1190]: time="2024-07-01T12:22:05.427275716Z" level=info msg="cleaning up dead shim" namespace=moby

	Jul 01 12:22:06 ha-735960 dockerd[1190]: time="2024-07-01T12:22:06.439101176Z" level=info msg="shim disconnected" id=ad4259a9c8ee03ff4c6910c68c5c866481fede150d57267cdc957e46aca4ef80 namespace=moby

	Jul 01 12:22:06 ha-735960 dockerd[1184]: time="2024-07-01T12:22:06.441768147Z" level=info msg="ignoring event" container=ad4259a9c8ee03ff4c6910c68c5c866481fede150d57267cdc957e46aca4ef80 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Jul 01 12:22:06 ha-735960 dockerd[1190]: time="2024-07-01T12:22:06.442054407Z" level=warning msg="cleaning up after shim disconnected" id=ad4259a9c8ee03ff4c6910c68c5c866481fede150d57267cdc957e46aca4ef80 namespace=moby

	Jul 01 12:22:06 ha-735960 dockerd[1190]: time="2024-07-01T12:22:06.442214156Z" level=info msg="cleaning up dead shim" namespace=moby

	Jul 01 12:22:24 ha-735960 dockerd[1190]: time="2024-07-01T12:22:24.071877635Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jul 01 12:22:24 ha-735960 dockerd[1190]: time="2024-07-01T12:22:24.072398316Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jul 01 12:22:24 ha-735960 dockerd[1190]: time="2024-07-01T12:22:24.072506177Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:24 ha-735960 dockerd[1190]: time="2024-07-01T12:22:24.072761669Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:27 ha-735960 dockerd[1190]: time="2024-07-01T12:22:27.091757274Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jul 01 12:22:27 ha-735960 dockerd[1190]: time="2024-07-01T12:22:27.091819785Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jul 01 12:22:27 ha-735960 dockerd[1190]: time="2024-07-01T12:22:27.091834055Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:27 ha-735960 dockerd[1190]: time="2024-07-01T12:22:27.092367194Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:47 ha-735960 dockerd[1184]: time="2024-07-01T12:22:47.577930706Z" level=info msg="ignoring event" container=e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Jul 01 12:22:47 ha-735960 dockerd[1190]: time="2024-07-01T12:22:47.578670317Z" level=info msg="shim disconnected" id=e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30 namespace=moby

	Jul 01 12:22:47 ha-735960 dockerd[1190]: time="2024-07-01T12:22:47.578983718Z" level=warning msg="cleaning up after shim disconnected" id=e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30 namespace=moby

	Jul 01 12:22:47 ha-735960 dockerd[1190]: time="2024-07-01T12:22:47.579585559Z" level=info msg="cleaning up dead shim" namespace=moby

	Jul 01 12:22:48 ha-735960 dockerd[1184]: time="2024-07-01T12:22:48.582829662Z" level=info msg="ignoring event" container=829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Jul 01 12:22:48 ha-735960 dockerd[1190]: time="2024-07-01T12:22:48.583282892Z" level=info msg="shim disconnected" id=829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d namespace=moby

	Jul 01 12:22:48 ha-735960 dockerd[1190]: time="2024-07-01T12:22:48.584157023Z" level=warning msg="cleaning up after shim disconnected" id=829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d namespace=moby

	Jul 01 12:22:48 ha-735960 dockerd[1190]: time="2024-07-01T12:22:48.584285564Z" level=info msg="cleaning up dead shim" namespace=moby

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED              STATE               NAME                      ATTEMPT             POD ID              POD

	e546c39248bc8       56ce0fd9fb532                                                                                         32 seconds ago       Exited              kube-apiserver            2                   16dae930b4edb       kube-apiserver-ha-735960

	829fe19c75ce3       e874818b3caac                                                                                         35 seconds ago       Exited              kube-controller-manager   2                   5e2a9b91be69c       kube-controller-manager-ha-735960

	cecb3dd12e16e       38af8ddebf499                                                                                         About a minute ago   Running             kube-vip                  0                   8d1562fb4b8c3       kube-vip-ha-735960

	6a200a6b49020       3861cfcd7c04c                                                                                         About a minute ago   Running             etcd                      1                   5b1097d48d724       etcd-ha-735960

	2d71437c5f06d       7820c83aa1394                                                                                         About a minute ago   Running             kube-scheduler            1                   fa7dea6a1b8bd       kube-scheduler-ha-735960

	14112a4d8f2cb       38af8ddebf499                                                                                         2 minutes ago        Exited              kube-vip                  1                   46ab74fdab7e2       kube-vip-ha-735960

	1ef6d9da6a9c5       gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12   4 minutes ago        Exited              busybox                   0                   1f5ccc7b0e655       busybox-fc5497c4f-pjfcw

	a9c30cd4b3455       cbb01a7bd410d                                                                                         6 minutes ago        Exited              coredns                   0                   7b4b4f7ec4b63       coredns-7db6d8ff4d-nk4lf

	769b0b8751350       cbb01a7bd410d                                                                                         6 minutes ago        Exited              coredns                   0                   7a349370d4f88       coredns-7db6d8ff4d-p4rtz

	97d58c94f3fdc       6e38f40d628db                                                                                         6 minutes ago        Exited              storage-provisioner       0                   9226633ad878a       storage-provisioner

	f472aef5302fd       kindest/kindnetd@sha256:9c2b5fcda3cb5a9725ecb893f3c8998a92d51a87465a886eb563e18d649383a8              6 minutes ago        Exited              kindnet-cni               0                   ab9c74a502295       kindnet-7f6hm

	6116abe6039dc       53c535741fb44                                                                                         6 minutes ago        Exited              kube-proxy                0                   da69191059798       kube-proxy-lphzn

	cb63d54411807       7820c83aa1394                                                                                         7 minutes ago        Exited              kube-scheduler            0                   19b6b0e6ed64e       kube-scheduler-ha-735960

	24c8926d2b31d       3861cfcd7c04c                                                                                         7 minutes ago        Exited              etcd                      0                   d3b914e19ca22       etcd-ha-735960

	==> coredns [769b0b875135] <==

	[INFO] 10.244.1.2:44221 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 60 0.000082797s

	[INFO] 10.244.2.2:33797 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000157729s

	[INFO] 10.244.2.2:52590 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.004055351s

	[INFO] 10.244.2.2:46983 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.003253494s

	[INFO] 10.244.2.2:56187 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000205215s

	[INFO] 10.244.2.2:41086 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000158307s

	[INFO] 10.244.0.4:47783 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000097077s

	[INFO] 10.244.0.4:50743 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.0001523s

	[INFO] 10.244.0.4:37141 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000138763s

	[INFO] 10.244.1.2:32981 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000132906s

	[INFO] 10.244.1.2:36762 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001646552s

	[INFO] 10.244.1.2:33583 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000072434s

	[INFO] 10.244.2.2:37027 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000156518s

	[INFO] 10.244.2.2:58435 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000104504s

	[INFO] 10.244.2.2:36107 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000090251s

	[INFO] 10.244.0.4:44792 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000227164s

	[INFO] 10.244.0.4:56557 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000140925s

	[INFO] 10.244.1.2:38284 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000232717s

	[INFO] 10.244.2.2:37664 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000135198s

	[INFO] 10.244.2.2:60876 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.00032392s

	[INFO] 10.244.1.2:37461 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000133264s

	[INFO] 10.244.1.2:45182 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000117372s

	[INFO] 10.244.1.2:37156 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000240093s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> coredns [a9c30cd4b345] <==

	[INFO] 10.244.0.4:57095 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.002251804s

	[INFO] 10.244.0.4:42381 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000081215s

	[INFO] 10.244.0.4:53499 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00124929s

	[INFO] 10.244.0.4:41287 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000174281s

	[INFO] 10.244.0.4:36433 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000142863s

	[INFO] 10.244.1.2:47688 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130034s

	[INFO] 10.244.1.2:40562 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00183587s

	[INFO] 10.244.1.2:35137 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.0000771s

	[INFO] 10.244.1.2:37798 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000184282s

	[INFO] 10.244.1.2:43876 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00008807s

	[INFO] 10.244.2.2:35039 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000119303s

	[INFO] 10.244.0.4:53229 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000090292s

	[INFO] 10.244.0.4:42097 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.00011308s

	[INFO] 10.244.1.2:42114 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130767s

	[INFO] 10.244.1.2:56638 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000110707s

	[INFO] 10.244.1.2:55805 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000093484s

	[INFO] 10.244.2.2:51675 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000145117s

	[INFO] 10.244.2.2:56838 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000136843s

	[INFO] 10.244.0.4:60951 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000162889s

	[INFO] 10.244.0.4:34776 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000112367s

	[INFO] 10.244.0.4:45397 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000073771s

	[INFO] 10.244.0.4:52372 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000058127s

	[INFO] 10.244.1.2:41033 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000131962s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> describe nodes <==

	command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E0701 12:22:59.377640    2586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	E0701 12:22:59.378152    2586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	E0701 12:22:59.379637    2586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	E0701 12:22:59.379997    2586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	E0701 12:22:59.381475    2586 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	==> dmesg <==

	[Jul 1 12:21] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.050877] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.036108] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.421397] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +1.628587] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +2.463440] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000007] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +4.322115] systemd-fstab-generator[476]: Ignoring "noauto" option for root device

	[  +0.057798] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.060958] systemd-fstab-generator[488]: Ignoring "noauto" option for root device

	[  +2.352578] systemd-fstab-generator[1113]: Ignoring "noauto" option for root device

	[  +0.297044] systemd-fstab-generator[1150]: Ignoring "noauto" option for root device

	[  +0.121689] systemd-fstab-generator[1162]: Ignoring "noauto" option for root device

	[  +0.127513] systemd-fstab-generator[1176]: Ignoring "noauto" option for root device

	[  +2.293985] kauditd_printk_skb: 195 callbacks suppressed

	[  +0.325101] systemd-fstab-generator[1411]: Ignoring "noauto" option for root device

	[  +0.108851] systemd-fstab-generator[1423]: Ignoring "noauto" option for root device

	[  +0.138237] systemd-fstab-generator[1435]: Ignoring "noauto" option for root device

	[  +0.156114] systemd-fstab-generator[1450]: Ignoring "noauto" option for root device

	[  +0.494872] systemd-fstab-generator[1603]: Ignoring "noauto" option for root device

	[  +6.977462] kauditd_printk_skb: 176 callbacks suppressed

	[ +11.291301] kauditd_printk_skb: 40 callbacks suppressed

	==> etcd [24c8926d2b31] <==

	{"level":"info","ts":"2024-07-01T12:21:01.297933Z","caller":"traceutil/trace.go:171","msg":"trace[249123960] range","detail":"{range_begin:/registry/leases/; range_end:/registry/leases0; }","duration":"4.106112275s","start":"2024-07-01T12:20:57.191803Z","end":"2024-07-01T12:21:01.297915Z","steps":["trace[249123960] 'agreement among raft nodes before linearized reading'  (duration: 4.10601913s)"],"step_count":1}

	{"level":"warn","ts":"2024-07-01T12:21:01.298006Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-07-01T12:20:57.191796Z","time spent":"4.106166982s","remote":"127.0.0.1:56240","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":0,"response size":0,"request content":"key:\"/registry/leases/\" range_end:\"/registry/leases0\" count_only:true "}

	2024/07/01 12:21:01 WARNING: [core] [Server #8] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	2024/07/01 12:21:01 WARNING: [core] [Server #8] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	2024/07/01 12:21:01 WARNING: [core] [Server #8] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2024-07-01T12:21:01.381902Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.39.16:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-07-01T12:21:01.38194Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.39.16:2379: use of closed network connection"}

	{"level":"info","ts":"2024-07-01T12:21:01.38203Z","caller":"etcdserver/server.go:1462","msg":"skipped leadership transfer; local server is not leader","local-member-id":"b6c76b3131c1024","current-leader-member-id":"0"}

	{"level":"info","ts":"2024-07-01T12:21:01.382382Z","caller":"rafthttp/peer.go:330","msg":"stopping remote peer","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382398Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.38247Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream Message","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382583Z","caller":"rafthttp/pipeline.go:85","msg":"stopped HTTP pipelining with remote peer","local-member-id":"b6c76b3131c1024","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382685Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"b6c76b3131c1024","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382809Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream Message","local-member-id":"b6c76b3131c1024","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382826Z","caller":"rafthttp/peer.go:335","msg":"stopped remote peer","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382832Z","caller":"rafthttp/peer.go:330","msg":"stopping remote peer","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.382882Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.3829Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream Message","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.385706Z","caller":"rafthttp/pipeline.go:85","msg":"stopped HTTP pipelining with remote peer","local-member-id":"b6c76b3131c1024","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.385804Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"b6c76b3131c1024","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.385838Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream Message","local-member-id":"b6c76b3131c1024","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.385849Z","caller":"rafthttp/peer.go:335","msg":"stopped remote peer","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.406065Z","caller":"embed/etcd.go:579","msg":"stopping serving peer traffic","address":"192.168.39.16:2380"}

	{"level":"info","ts":"2024-07-01T12:21:01.406193Z","caller":"embed/etcd.go:584","msg":"stopped serving peer traffic","address":"192.168.39.16:2380"}

	{"level":"info","ts":"2024-07-01T12:21:01.406214Z","caller":"embed/etcd.go:377","msg":"closed etcd server","name":"ha-735960","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.39.16:2380"],"advertise-client-urls":["https://192.168.39.16:2379"]}

	==> etcd [6a200a6b4902] <==

	{"level":"info","ts":"2024-07-01T12:22:54.688918Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:54.689365Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:54.689616Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:54.689896Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:54.689984Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	{"level":"warn","ts":"2024-07-01T12:22:54.766483Z","caller":"etcdserver/server.go:2089","msg":"failed to publish local member to cluster through raft","local-member-id":"b6c76b3131c1024","local-member-attributes":"{Name:ha-735960 ClientURLs:[https://192.168.39.16:2379]}","request-path":"/0/members/b6c76b3131c1024/attributes","publish-timeout":"7s","error":"etcdserver: request timed out"}

	{"level":"warn","ts":"2024-07-01T12:22:54.810935Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"c77bbbee62c21090","rtt":"0s","error":"dial tcp 192.168.39.86:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:22:54.81101Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"c77bbbee62c21090","rtt":"0s","error":"dial tcp 192.168.39.86:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:22:54.827555Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: i/o timeout"}

	{"level":"warn","ts":"2024-07-01T12:22:54.827561Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: i/o timeout"}

	{"level":"info","ts":"2024-07-01T12:22:56.088711Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:56.088779Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:56.088792Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:56.088806Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:56.088813Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:57.488845Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:57.488894Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:57.488907Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:57.488922Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:57.488929Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888088Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888193Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888234Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888281Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888295Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	==> kernel <==

	 12:22:59 up 1 min,  0 users,  load average: 0.14, 0.07, 0.02

	Linux ha-735960 5.10.207 #1 SMP Wed Jun 26 19:37:34 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [f472aef5302f] <==

	I0701 12:20:12.428842       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:20:22.443154       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:20:22.443292       1 main.go:227] handling current node

	I0701 12:20:22.443323       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:20:22.443388       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:20:22.443605       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:20:22.443653       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:20:22.443793       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:20:22.443836       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:20:32.451395       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:20:32.451431       1 main.go:227] handling current node

	I0701 12:20:32.451481       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:20:32.451486       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:20:32.451947       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:20:32.451980       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:20:32.452873       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:20:32.453015       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:20:42.470169       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:20:42.470264       1 main.go:227] handling current node

	I0701 12:20:42.470289       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:20:42.470302       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:20:42.470523       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:20:42.470616       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:20:42.470868       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:20:42.470914       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	==> kube-apiserver [e546c39248bc] <==

	I0701 12:22:27.228496       1 options.go:221] external host was not specified, using 192.168.39.16

	I0701 12:22:27.229584       1 server.go:148] Version: v1.30.2

	I0701 12:22:27.229706       1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0701 12:22:27.544729       1 shared_informer.go:313] Waiting for caches to sync for node_authorizer

	I0701 12:22:27.547846       1 shared_informer.go:313] Waiting for caches to sync for *generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]

	I0701 12:22:27.551600       1 plugins.go:157] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.

	I0701 12:22:27.551634       1 plugins.go:160] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.

	I0701 12:22:27.551982       1 instance.go:299] Using reconciler: lease

	W0701 12:22:47.544372       1 logging.go:59] [core] [Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: authentication handshake failed: context deadline exceeded"

	W0701 12:22:47.544664       1 logging.go:59] [core] [Channel #3 SubChannel #4] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: authentication handshake failed: context canceled"

	F0701 12:22:47.553171       1 instance.go:292] Error creating leases: error creating storage factory: context deadline exceeded

	==> kube-controller-manager [829fe19c75ce] <==

	I0701 12:22:24.521097       1 serving.go:380] Generated self-signed cert in-memory

	I0701 12:22:24.837441       1 controllermanager.go:189] "Starting" version="v1.30.2"

	I0701 12:22:24.837478       1 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0701 12:22:24.839276       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"

	I0701 12:22:24.839470       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"

	I0701 12:22:24.839988       1 secure_serving.go:213] Serving securely on 127.0.0.1:10257

	I0701 12:22:24.840049       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	E0701 12:22:48.561111       1 controllermanager.go:234] "Error building controller context" err="failed to wait for apiserver being healthy: timed out waiting for the condition: failed to get apiserver /healthz status: Get \"https://192.168.39.16:8443/healthz\": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:57228->192.168.39.16:8443: read: connection reset by peer"

	==> kube-proxy [6116abe6039d] <==

	I0701 12:16:09.205590       1 server_linux.go:69] "Using iptables proxy"

	I0701 12:16:09.223098       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.16"]

	I0701 12:16:09.284088       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0701 12:16:09.284134       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0701 12:16:09.284152       1 server_linux.go:165] "Using iptables Proxier"

	I0701 12:16:09.286802       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0701 12:16:09.287240       1 server.go:872] "Version info" version="v1.30.2"

	I0701 12:16:09.287274       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0701 12:16:09.288803       1 config.go:192] "Starting service config controller"

	I0701 12:16:09.288830       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0701 12:16:09.289262       1 config.go:101] "Starting endpoint slice config controller"

	I0701 12:16:09.289283       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0701 12:16:09.290101       1 config.go:319] "Starting node config controller"

	I0701 12:16:09.290125       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0701 12:16:09.389941       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0701 12:16:09.390030       1 shared_informer.go:320] Caches are synced for service config

	I0701 12:16:09.390393       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [2d71437c5f06] <==

	Trace[1841834859]: ---"Objects listed" error:Get "https://192.168.39.16:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:57242->192.168.39.16:8443: read: connection reset by peer 10642ms (12:22:48.563)

	Trace[1841834859]: [10.642423199s] [10.642423199s] END

	E0701 12:22:48.563438       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://192.168.39.16:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:57242->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563506       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: Get "https://192.168.39.16:8443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59182->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563570       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://192.168.39.16:8443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59182->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563641       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: Get "https://192.168.39.16:8443/api/v1/pods?fieldSelector=status.phase%3DSucceeded%!C(MISSING)status.phase%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59186->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563665       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: Get "https://192.168.39.16:8443/api/v1/pods?fieldSelector=status.phase%3DSucceeded%!C(MISSING)status.phase%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59186->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563724       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: Get "https://192.168.39.16:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59188->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563747       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: Get "https://192.168.39.16:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59188->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563814       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: Get "https://192.168.39.16:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59202->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563830       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: Get "https://192.168.39.16:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59202->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563886       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59238->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563907       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59238->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563967       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59262->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563982       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59262->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563997       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59210->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.564229       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59210->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.669137       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: Get "https://192.168.39.16:8443/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:22:48.669192       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: Get "https://192.168.39.16:8443/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:22:51.792652       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.16:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:22:51.792757       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.16:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:22:52.248014       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: Get "https://192.168.39.16:8443/apis/apps/v1/replicasets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:22:52.248063       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: Get "https://192.168.39.16:8443/apis/apps/v1/replicasets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:22:55.201032       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://192.168.39.16:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:22:55.201141       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://192.168.39.16:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	==> kube-scheduler [cb63d5441180] <==

	W0701 12:15:50.916180       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0701 12:15:50.916379       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0701 12:15:51.752711       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0701 12:15:51.752853       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W0701 12:15:51.794007       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0701 12:15:51.794055       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W0701 12:15:51.931391       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0701 12:15:51.931434       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0701 12:15:51.950120       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0701 12:15:51.950162       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W0701 12:15:51.968922       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0701 12:15:51.969125       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0701 12:15:51.985991       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0701 12:15:51.986032       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	W0701 12:15:52.054298       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0701 12:15:52.054329       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0701 12:15:52.260873       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0701 12:15:52.260979       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	I0701 12:15:54.206866       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0701 12:19:09.710917       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-xv95g\": pod kube-proxy-xv95g is already assigned to node \"ha-735960-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-xv95g" node="ha-735960-m04"

	E0701 12:19:09.713930       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-xv95g\": pod kube-proxy-xv95g is already assigned to node \"ha-735960-m04\"" pod="kube-system/kube-proxy-xv95g"

	I0701 12:21:01.200143       1 secure_serving.go:258] Stopped listening on 127.0.0.1:10259

	I0701 12:21:01.200254       1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"

	I0701 12:21:01.200659       1 configmap_cafile_content.go:223] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	E0701 12:21:01.212693       1 run.go:74] "command failed" err="finished without leader elect"

	==> kubelet <==

	Jul 01 12:22:42 ha-735960 kubelet[1610]: I0701 12:22:42.360672    1610 kubelet_node_status.go:73] "Attempting to register node" node="ha-735960"

	Jul 01 12:22:44 ha-735960 kubelet[1610]: E0701 12:22:44.574795    1610 kubelet_node_status.go:96] "Unable to register node with API server" err="Post \"https://control-plane.minikube.internal:8443/api/v1/nodes\": dial tcp 192.168.39.254:8443: connect: no route to host" node="ha-735960"

	Jul 01 12:22:44 ha-735960 kubelet[1610]: E0701 12:22:44.574858    1610 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ha-735960?timeout=10s\": dial tcp 192.168.39.254:8443: connect: no route to host" interval="7s"

	Jul 01 12:22:47 ha-735960 kubelet[1610]: E0701 12:22:47.092648    1610 eviction_manager.go:282] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ha-735960\" not found"

	Jul 01 12:22:47 ha-735960 kubelet[1610]: E0701 12:22:47.646121    1610 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/api/v1/namespaces/default/events\": dial tcp 192.168.39.254:8443: connect: no route to host" event="&Event{ObjectMeta:{ha-735960.17de162e90ad8f5f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ha-735960,UID:ha-735960,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ha-735960,},FirstTimestamp:2024-07-01 12:21:36.953708383 +0000 UTC m=+0.183371310,LastTimestamp:2024-07-01 12:21:36.953708383 +0000 UTC m=+0.183371310,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ha-735960,}"

	Jul 01 12:22:48 ha-735960 kubelet[1610]: I0701 12:22:48.159877    1610 scope.go:117] "RemoveContainer" containerID="d97b6df80577316a9cf70b2af0f8d52bb2bd7071ff932a8f1f03df9497724786"

	Jul 01 12:22:48 ha-735960 kubelet[1610]: I0701 12:22:48.161197    1610 scope.go:117] "RemoveContainer" containerID="e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30"

	Jul 01 12:22:48 ha-735960 kubelet[1610]: E0701 12:22:48.162173    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver pod=kube-apiserver-ha-735960_kube-system(858bfcad8b1d02b8cdc3dc83c4af060c)\"" pod="kube-system/kube-apiserver-ha-735960" podUID="858bfcad8b1d02b8cdc3dc83c4af060c"

	Jul 01 12:22:49 ha-735960 kubelet[1610]: I0701 12:22:49.180032    1610 scope.go:117] "RemoveContainer" containerID="ad4259a9c8ee03ff4c6910c68c5c866481fede150d57267cdc957e46aca4ef80"

	Jul 01 12:22:49 ha-735960 kubelet[1610]: I0701 12:22:49.181799    1610 scope.go:117] "RemoveContainer" containerID="829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d"

	Jul 01 12:22:49 ha-735960 kubelet[1610]: E0701 12:22:49.182112    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-ha-735960_kube-system(9a545edc3c0d885e2370d3a24ff8ac4b)\"" pod="kube-system/kube-controller-manager-ha-735960" podUID="9a545edc3c0d885e2370d3a24ff8ac4b"

	Jul 01 12:22:50 ha-735960 kubelet[1610]: I0701 12:22:50.089167    1610 scope.go:117] "RemoveContainer" containerID="e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30"

	Jul 01 12:22:50 ha-735960 kubelet[1610]: E0701 12:22:50.089722    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver pod=kube-apiserver-ha-735960_kube-system(858bfcad8b1d02b8cdc3dc83c4af060c)\"" pod="kube-system/kube-apiserver-ha-735960" podUID="858bfcad8b1d02b8cdc3dc83c4af060c"

	Jul 01 12:22:50 ha-735960 kubelet[1610]: I0701 12:22:50.202365    1610 scope.go:117] "RemoveContainer" containerID="829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d"

	Jul 01 12:22:50 ha-735960 kubelet[1610]: E0701 12:22:50.202700    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-ha-735960_kube-system(9a545edc3c0d885e2370d3a24ff8ac4b)\"" pod="kube-system/kube-controller-manager-ha-735960" podUID="9a545edc3c0d885e2370d3a24ff8ac4b"

	Jul 01 12:22:51 ha-735960 kubelet[1610]: I0701 12:22:51.209935    1610 scope.go:117] "RemoveContainer" containerID="829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d"

	Jul 01 12:22:51 ha-735960 kubelet[1610]: E0701 12:22:51.210647    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-ha-735960_kube-system(9a545edc3c0d885e2370d3a24ff8ac4b)\"" pod="kube-system/kube-controller-manager-ha-735960" podUID="9a545edc3c0d885e2370d3a24ff8ac4b"

	Jul 01 12:22:51 ha-735960 kubelet[1610]: I0701 12:22:51.576067    1610 kubelet_node_status.go:73] "Attempting to register node" node="ha-735960"

	Jul 01 12:22:53 ha-735960 kubelet[1610]: I0701 12:22:53.728933    1610 scope.go:117] "RemoveContainer" containerID="e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30"

	Jul 01 12:22:53 ha-735960 kubelet[1610]: E0701 12:22:53.729329    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver pod=kube-apiserver-ha-735960_kube-system(858bfcad8b1d02b8cdc3dc83c4af060c)\"" pod="kube-system/kube-apiserver-ha-735960" podUID="858bfcad8b1d02b8cdc3dc83c4af060c"

	Jul 01 12:22:53 ha-735960 kubelet[1610]: E0701 12:22:53.789831    1610 kubelet_node_status.go:96] "Unable to register node with API server" err="Post \"https://control-plane.minikube.internal:8443/api/v1/nodes\": dial tcp 192.168.39.254:8443: connect: no route to host" node="ha-735960"

	Jul 01 12:22:53 ha-735960 kubelet[1610]: E0701 12:22:53.790000    1610 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ha-735960?timeout=10s\": dial tcp 192.168.39.254:8443: connect: no route to host" interval="7s"

	Jul 01 12:22:56 ha-735960 kubelet[1610]: W0701 12:22:56.862031    1610 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://control-plane.minikube.internal:8443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:22:56 ha-735960 kubelet[1610]: E0701 12:22:56.862122    1610 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get "https://control-plane.minikube.internal:8443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:22:57 ha-735960 kubelet[1610]: E0701 12:22:57.094040    1610 eviction_manager.go:282] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ha-735960\" not found"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-735960 -n ha-735960

helpers_test.go:254: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-735960 -n ha-735960: exit status 2 (229.492615ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:254: status error: exit status 2 (may be ok)

helpers_test.go:256: "ha-735960" apiserver is not running, skipping kubectl commands (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/RestartClusterKeepsNodes (146.89s)

=== RUN   TestMultiControlPlane/serial/DeleteSecondaryNode

ha_test.go:487: (dbg) Run:  out/minikube-linux-amd64 -p ha-735960 node delete m03 -v=7 --alsologtostderr

ha_test.go:487: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-735960 node delete m03 -v=7 --alsologtostderr: exit status 83 (138.543693ms)

-- stdout --

	* The control-plane node ha-735960-m03 host is not running: state=Stopped

	  To start a cluster, run: "minikube start -p ha-735960"

-- /stdout --

** stderr ** 

	I0701 12:22:59.997400  652837 out.go:291] Setting OutFile to fd 1 ...

	I0701 12:22:59.997920  652837 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:22:59.997937  652837 out.go:304] Setting ErrFile to fd 2...

	I0701 12:22:59.997944  652837 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:22:59.998423  652837 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19166-630650/.minikube/bin

	I0701 12:22:59.998939  652837 mustload.go:65] Loading cluster: ha-735960

	I0701 12:22:59.999343  652837 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:22:59.999732  652837 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:22:59.999771  652837 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:23:00.014934  652837 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34811

	I0701 12:23:00.015389  652837 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:23:00.015967  652837 main.go:141] libmachine: Using API Version  1

	I0701 12:23:00.015997  652837 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:23:00.016376  652837 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:23:00.016590  652837 main.go:141] libmachine: (ha-735960) Calling .GetState

	I0701 12:23:00.017995  652837 host.go:66] Checking if "ha-735960" exists ...

	I0701 12:23:00.018287  652837 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:23:00.018321  652837 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:23:00.033284  652837 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46519

	I0701 12:23:00.033734  652837 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:23:00.034298  652837 main.go:141] libmachine: Using API Version  1

	I0701 12:23:00.034323  652837 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:23:00.034672  652837 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:23:00.034875  652837 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:23:00.035429  652837 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:23:00.035476  652837 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:23:00.050393  652837 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34175

	I0701 12:23:00.050873  652837 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:23:00.051381  652837 main.go:141] libmachine: Using API Version  1

	I0701 12:23:00.051414  652837 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:23:00.051789  652837 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:23:00.051992  652837 main.go:141] libmachine: (ha-735960-m02) Calling .GetState

	I0701 12:23:00.053687  652837 host.go:66] Checking if "ha-735960-m02" exists ...

	I0701 12:23:00.054013  652837 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:23:00.054072  652837 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:23:00.068829  652837 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41803

	I0701 12:23:00.069300  652837 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:23:00.069787  652837 main.go:141] libmachine: Using API Version  1

	I0701 12:23:00.069810  652837 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:23:00.070146  652837 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:23:00.070384  652837 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:23:00.070866  652837 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:23:00.070909  652837 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:23:00.086011  652837 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43627

	I0701 12:23:00.086440  652837 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:23:00.086872  652837 main.go:141] libmachine: Using API Version  1

	I0701 12:23:00.086888  652837 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:23:00.087190  652837 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:23:00.087393  652837 main.go:141] libmachine: (ha-735960-m03) Calling .GetState

	I0701 12:23:00.091431  652837 out.go:177] * The control-plane node ha-735960-m03 host is not running: state=Stopped

	I0701 12:23:00.093084  652837 out.go:177]   To start a cluster, run: "minikube start -p ha-735960"

** /stderr **

ha_test.go:489: node delete returned an error. args "out/minikube-linux-amd64 -p ha-735960 node delete m03 -v=7 --alsologtostderr": exit status 83

ha_test.go:493: (dbg) Run:  out/minikube-linux-amd64 -p ha-735960 status -v=7 --alsologtostderr

ha_test.go:493: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-735960 status -v=7 --alsologtostderr: exit status 7 (431.945043ms)

-- stdout --

	ha-735960

	type: Control Plane

	host: Running

	kubelet: Running

	apiserver: Stopped

	kubeconfig: Configured

	ha-735960-m02

	type: Control Plane

	host: Running

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Configured

	ha-735960-m03

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-735960-m04

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr ** 

	I0701 12:23:00.137810  652879 out.go:291] Setting OutFile to fd 1 ...

	I0701 12:23:00.138055  652879 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:23:00.138063  652879 out.go:304] Setting ErrFile to fd 2...

	I0701 12:23:00.138067  652879 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:23:00.138286  652879 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19166-630650/.minikube/bin

	I0701 12:23:00.138496  652879 out.go:298] Setting JSON to false

	I0701 12:23:00.138527  652879 mustload.go:65] Loading cluster: ha-735960

	I0701 12:23:00.138636  652879 notify.go:220] Checking for updates...

	I0701 12:23:00.138936  652879 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:23:00.138951  652879 status.go:255] checking status of ha-735960 ...

	I0701 12:23:00.139341  652879 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:23:00.139384  652879 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:23:00.154275  652879 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:38599

	I0701 12:23:00.154698  652879 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:23:00.155310  652879 main.go:141] libmachine: Using API Version  1

	I0701 12:23:00.155340  652879 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:23:00.155717  652879 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:23:00.155908  652879 main.go:141] libmachine: (ha-735960) Calling .GetState

	I0701 12:23:00.157581  652879 status.go:330] ha-735960 host status = "Running" (err=<nil>)

	I0701 12:23:00.157600  652879 host.go:66] Checking if "ha-735960" exists ...

	I0701 12:23:00.157979  652879 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:23:00.158024  652879 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:23:00.173033  652879 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41453

	I0701 12:23:00.173427  652879 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:23:00.173915  652879 main.go:141] libmachine: Using API Version  1

	I0701 12:23:00.173944  652879 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:23:00.174244  652879 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:23:00.174460  652879 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:23:00.177227  652879 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:23:00.177618  652879 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:23:00.177648  652879 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:23:00.177904  652879 host.go:66] Checking if "ha-735960" exists ...

	I0701 12:23:00.178191  652879 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:23:00.178222  652879 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:23:00.193881  652879 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41881

	I0701 12:23:00.194353  652879 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:23:00.194970  652879 main.go:141] libmachine: Using API Version  1

	I0701 12:23:00.194999  652879 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:23:00.195382  652879 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:23:00.195592  652879 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:23:00.195833  652879 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0701 12:23:00.195857  652879 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:23:00.198621  652879 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:23:00.199031  652879 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:23:00.199060  652879 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:23:00.199220  652879 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:23:00.199410  652879 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:23:00.199535  652879 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:23:00.199679  652879 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:23:00.281300  652879 ssh_runner.go:195] Run: systemctl --version

	I0701 12:23:00.291876  652879 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0701 12:23:00.306208  652879 kubeconfig.go:125] found "ha-735960" server: "https://192.168.39.254:8443"

	I0701 12:23:00.306253  652879 api_server.go:166] Checking apiserver status ...

	I0701 12:23:00.306319  652879 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0701 12:23:00.318417  652879 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0701 12:23:00.318446  652879 status.go:422] ha-735960 apiserver status = Running (err=<nil>)

	I0701 12:23:00.318460  652879 status.go:257] ha-735960 status: &{Name:ha-735960 Host:Running Kubelet:Running APIServer:Stopped Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0701 12:23:00.318479  652879 status.go:255] checking status of ha-735960-m02 ...

	I0701 12:23:00.318810  652879 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:23:00.318862  652879 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:23:00.334297  652879 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45635

	I0701 12:23:00.334782  652879 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:23:00.335314  652879 main.go:141] libmachine: Using API Version  1

	I0701 12:23:00.335337  652879 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:23:00.335668  652879 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:23:00.335893  652879 main.go:141] libmachine: (ha-735960-m02) Calling .GetState

	I0701 12:23:00.337543  652879 status.go:330] ha-735960-m02 host status = "Running" (err=<nil>)

	I0701 12:23:00.337563  652879 host.go:66] Checking if "ha-735960-m02" exists ...

	I0701 12:23:00.337887  652879 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:23:00.337921  652879 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:23:00.353097  652879 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45493

	I0701 12:23:00.353530  652879 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:23:00.354008  652879 main.go:141] libmachine: Using API Version  1

	I0701 12:23:00.354027  652879 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:23:00.354346  652879 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:23:00.354534  652879 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:23:00.357351  652879 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:23:00.357793  652879 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:23:00.357815  652879 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:23:00.357985  652879 host.go:66] Checking if "ha-735960-m02" exists ...

	I0701 12:23:00.358278  652879 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:23:00.358316  652879 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:23:00.372931  652879 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33751

	I0701 12:23:00.373397  652879 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:23:00.373891  652879 main.go:141] libmachine: Using API Version  1

	I0701 12:23:00.373911  652879 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:23:00.374244  652879 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:23:00.374526  652879 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:23:00.374731  652879 ssh_runner.go:195] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"

	I0701 12:23:00.374753  652879 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:23:00.377513  652879 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:23:00.377962  652879 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:23:00.377987  652879 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:23:00.378133  652879 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:23:00.378305  652879 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:23:00.378483  652879 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:23:00.378609  652879 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:23:00.460937  652879 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0701 12:23:00.475673  652879 kubeconfig.go:125] found "ha-735960" server: "https://192.168.39.254:8443"

	I0701 12:23:00.475705  652879 api_server.go:166] Checking apiserver status ...

	I0701 12:23:00.475744  652879 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	W0701 12:23:00.487918  652879 api_server.go:170] stopped: unable to get apiserver pid: sudo pgrep -xnf kube-apiserver.*minikube.*: Process exited with status 1

	stdout:

	stderr:

	I0701 12:23:00.487945  652879 status.go:422] ha-735960-m02 apiserver status = Stopped (err=<nil>)

	I0701 12:23:00.487958  652879 status.go:257] ha-735960-m02 status: &{Name:ha-735960-m02 Host:Running Kubelet:Stopped APIServer:Stopped Kubeconfig:Configured Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0701 12:23:00.487979  652879 status.go:255] checking status of ha-735960-m03 ...

	I0701 12:23:00.488309  652879 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:23:00.488353  652879 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:23:00.503638  652879 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41641

	I0701 12:23:00.504158  652879 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:23:00.504690  652879 main.go:141] libmachine: Using API Version  1

	I0701 12:23:00.504712  652879 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:23:00.504995  652879 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:23:00.505189  652879 main.go:141] libmachine: (ha-735960-m03) Calling .GetState

	I0701 12:23:00.506810  652879 status.go:330] ha-735960-m03 host status = "Stopped" (err=<nil>)

	I0701 12:23:00.506824  652879 status.go:343] host is not running, skipping remaining checks

	I0701 12:23:00.506830  652879 status.go:257] ha-735960-m03 status: &{Name:ha-735960-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0701 12:23:00.506853  652879 status.go:255] checking status of ha-735960-m04 ...

	I0701 12:23:00.507118  652879 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:23:00.507150  652879 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:23:00.522605  652879 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:37253

	I0701 12:23:00.523019  652879 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:23:00.523445  652879 main.go:141] libmachine: Using API Version  1

	I0701 12:23:00.523462  652879 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:23:00.523782  652879 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:23:00.524021  652879 main.go:141] libmachine: (ha-735960-m04) Calling .GetState

	I0701 12:23:00.525647  652879 status.go:330] ha-735960-m04 host status = "Stopped" (err=<nil>)

	I0701 12:23:00.525662  652879 status.go:343] host is not running, skipping remaining checks

	I0701 12:23:00.525668  652879 status.go:257] ha-735960-m04 status: &{Name:ha-735960-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:495: failed to run minikube status. args "out/minikube-linux-amd64 -p ha-735960 status -v=7 --alsologtostderr" : exit status 7

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-735960 -n ha-735960

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p ha-735960 -n ha-735960: exit status 2 (217.577453ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:239: status error: exit status 2 (may be ok)

helpers_test.go:244: <<< TestMultiControlPlane/serial/DeleteSecondaryNode FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/DeleteSecondaryNode]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-735960 logs -n 25

helpers_test.go:252: TestMultiControlPlane/serial/DeleteSecondaryNode logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m02 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m03_ha-735960-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m03:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04:/home/docker/cp-test_ha-735960-m03_ha-735960-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m04 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m03_ha-735960-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-735960 cp testdata/cp-test.txt                                                | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile2826819896/001/cp-test_ha-735960-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960:/home/docker/cp-test_ha-735960-m04_ha-735960.txt                       |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960 sudo cat                                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m04_ha-735960.txt                                 |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m02:/home/docker/cp-test_ha-735960-m04_ha-735960-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m02 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m04_ha-735960-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m03:/home/docker/cp-test_ha-735960-m04_ha-735960-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m03 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m04_ha-735960-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-735960 node stop m02 -v=7                                                     | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | ha-735960 node start m02 -v=7                                                    | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:20 UTC |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | list -p ha-735960 -v=7                                                           | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:20 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| stop    | -p ha-735960 -v=7                                                                | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:20 UTC | 01 Jul 24 12:21 UTC |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| start   | -p ha-735960 --wait=true -v=7                                                    | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:21 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | list -p ha-735960                                                                | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:22 UTC |                     |

	| node    | ha-735960 node delete m03 -v=7                                                   | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:22 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/07/01 12:21:13

	Running on machine: ubuntu-20-agent-7

	Binary: Built with gc go1.22.4 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0701 12:21:13.996326  652196 out.go:291] Setting OutFile to fd 1 ...

	I0701 12:21:13.996600  652196 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:21:13.996610  652196 out.go:304] Setting ErrFile to fd 2...

	I0701 12:21:13.996615  652196 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:21:13.996825  652196 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19166-630650/.minikube/bin

	I0701 12:21:13.997417  652196 out.go:298] Setting JSON to false

	I0701 12:21:13.998463  652196 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-7","uptime":7412,"bootTime":1719829062,"procs":181,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0701 12:21:13.998525  652196 start.go:139] virtualization: kvm guest

	I0701 12:21:14.000967  652196 out.go:177] * [ha-735960] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0701 12:21:14.002666  652196 out.go:177]   - MINIKUBE_LOCATION=19166

	I0701 12:21:14.002690  652196 notify.go:220] Checking for updates...

	I0701 12:21:14.005489  652196 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0701 12:21:14.006983  652196 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:14.008350  652196 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19166-630650/.minikube

	I0701 12:21:14.009593  652196 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0701 12:21:14.011091  652196 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0701 12:21:14.012857  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:14.012999  652196 driver.go:392] Setting default libvirt URI to qemu:///system

	I0701 12:21:14.013468  652196 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:21:14.013542  652196 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:21:14.028581  652196 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35775

	I0701 12:21:14.028967  652196 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:21:14.029528  652196 main.go:141] libmachine: Using API Version  1

	I0701 12:21:14.029551  652196 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:21:14.029916  652196 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:21:14.030116  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:14.065038  652196 out.go:177] * Using the kvm2 driver based on existing profile

	I0701 12:21:14.066535  652196 start.go:297] selected driver: kvm2

	I0701 12:21:14.066551  652196 start.go:901] validating driver "kvm2" against &{Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVer

sion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:fal

se efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVers

ion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:21:14.066723  652196 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0701 12:21:14.067041  652196 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0701 12:21:14.067114  652196 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19166-630650/.minikube/bin:/home/jenkins/workspace/KVM_Linux_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0701 12:21:14.082191  652196 install.go:137] /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0701 12:21:14.082920  652196 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0701 12:21:14.082959  652196 cni.go:84] Creating CNI manager for ""

	I0701 12:21:14.082966  652196 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0701 12:21:14.083026  652196 start.go:340] cluster config:

	{Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39

.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false h

elm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]

MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:21:14.083142  652196 iso.go:125] acquiring lock: {Name:mk5c70910f61bc270c83609c48670eaf9d7e0602 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0701 12:21:14.086358  652196 out.go:177] * Starting "ha-735960" primary control-plane node in "ha-735960" cluster

	I0701 12:21:14.087757  652196 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:21:14.087794  652196 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4

	I0701 12:21:14.087805  652196 cache.go:56] Caching tarball of preloaded images

	I0701 12:21:14.087882  652196 preload.go:173] Found /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0701 12:21:14.087892  652196 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on docker

	I0701 12:21:14.088044  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:14.088232  652196 start.go:360] acquireMachinesLock for ha-735960: {Name:mk43a6c0c0c15a237623df377ad65b82186c0ad8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0701 12:21:14.088271  652196 start.go:364] duration metric: took 21.615µs to acquireMachinesLock for "ha-735960"

	I0701 12:21:14.088285  652196 start.go:96] Skipping create...Using existing machine configuration

	I0701 12:21:14.088293  652196 fix.go:54] fixHost starting: 

	I0701 12:21:14.088547  652196 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:21:14.088578  652196 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:21:14.103070  652196 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42935

	I0701 12:21:14.103508  652196 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:21:14.104025  652196 main.go:141] libmachine: Using API Version  1

	I0701 12:21:14.104050  652196 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:21:14.104424  652196 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:21:14.104649  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:14.104829  652196 main.go:141] libmachine: (ha-735960) Calling .GetState

	I0701 12:21:14.106608  652196 fix.go:112] recreateIfNeeded on ha-735960: state=Stopped err=<nil>

	I0701 12:21:14.106630  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	W0701 12:21:14.106790  652196 fix.go:138] unexpected machine state, will restart: <nil>

	I0701 12:21:14.108833  652196 out.go:177] * Restarting existing kvm2 VM for "ha-735960" ...

	I0701 12:21:14.110060  652196 main.go:141] libmachine: (ha-735960) Calling .Start

	I0701 12:21:14.110234  652196 main.go:141] libmachine: (ha-735960) Ensuring networks are active...

	I0701 12:21:14.110976  652196 main.go:141] libmachine: (ha-735960) Ensuring network default is active

	I0701 12:21:14.111299  652196 main.go:141] libmachine: (ha-735960) Ensuring network mk-ha-735960 is active

	I0701 12:21:14.111665  652196 main.go:141] libmachine: (ha-735960) Getting domain xml...

	I0701 12:21:14.112420  652196 main.go:141] libmachine: (ha-735960) Creating domain...

	I0701 12:21:15.307133  652196 main.go:141] libmachine: (ha-735960) Waiting to get IP...

	I0701 12:21:15.308062  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:15.308526  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:15.308647  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:15.308493  652224 retry.go:31] will retry after 239.111405ms: waiting for machine to come up

	I0701 12:21:15.549211  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:15.549648  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:15.549679  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:15.549597  652224 retry.go:31] will retry after 248.256131ms: waiting for machine to come up

	I0701 12:21:15.799054  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:15.799481  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:15.799534  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:15.799422  652224 retry.go:31] will retry after 380.468685ms: waiting for machine to come up

	I0701 12:21:16.181969  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:16.182432  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:16.182634  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:16.182540  652224 retry.go:31] will retry after 592.847587ms: waiting for machine to come up

	I0701 12:21:16.777393  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:16.777837  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:16.777867  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:16.777790  652224 retry.go:31] will retry after 639.749416ms: waiting for machine to come up

	I0701 12:21:17.419540  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:17.419941  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:17.419965  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:17.419916  652224 retry.go:31] will retry after 891.768613ms: waiting for machine to come up

	I0701 12:21:18.312967  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:18.313455  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:18.313484  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:18.313399  652224 retry.go:31] will retry after 1.112048412s: waiting for machine to come up

	I0701 12:21:19.427190  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:19.427624  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:19.427655  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:19.427568  652224 retry.go:31] will retry after 1.150138437s: waiting for machine to come up

	I0701 12:21:20.579868  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:20.580291  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:20.580325  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:20.580216  652224 retry.go:31] will retry after 1.129763596s: waiting for machine to come up

	I0701 12:21:21.711416  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:21.711892  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:21.711924  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:21.711831  652224 retry.go:31] will retry after 2.143074349s: waiting for machine to come up

	I0701 12:21:23.858081  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:23.858617  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:23.858643  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:23.858578  652224 retry.go:31] will retry after 2.436757856s: waiting for machine to come up

	I0701 12:21:26.297727  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:26.298302  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:26.298352  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:26.298269  652224 retry.go:31] will retry after 2.609229165s: waiting for machine to come up

	I0701 12:21:28.911224  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.911698  652196 main.go:141] libmachine: (ha-735960) Found IP for machine: 192.168.39.16

	I0701 12:21:28.911722  652196 main.go:141] libmachine: (ha-735960) Reserving static IP address...

	I0701 12:21:28.911731  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has current primary IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.912401  652196 main.go:141] libmachine: (ha-735960) Reserved static IP address: 192.168.39.16

	I0701 12:21:28.912425  652196 main.go:141] libmachine: (ha-735960) Waiting for SSH to be available...

	I0701 12:21:28.912468  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "ha-735960", mac: "52:54:00:6c:20:7c", ip: "192.168.39.16"} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:28.912492  652196 main.go:141] libmachine: (ha-735960) DBG | skip adding static IP to network mk-ha-735960 - found existing host DHCP lease matching {name: "ha-735960", mac: "52:54:00:6c:20:7c", ip: "192.168.39.16"}

	I0701 12:21:28.912507  652196 main.go:141] libmachine: (ha-735960) DBG | Getting to WaitForSSH function...

	I0701 12:21:28.914934  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.915448  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:28.915478  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.915627  652196 main.go:141] libmachine: (ha-735960) DBG | Using SSH client type: external

	I0701 12:21:28.915655  652196 main.go:141] libmachine: (ha-735960) DBG | Using SSH private key: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa (-rw-------)

	I0701 12:21:28.915680  652196 main.go:141] libmachine: (ha-735960) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.16 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0701 12:21:28.915698  652196 main.go:141] libmachine: (ha-735960) DBG | About to run SSH command:

	I0701 12:21:28.915730  652196 main.go:141] libmachine: (ha-735960) DBG | exit 0

	I0701 12:21:29.042314  652196 main.go:141] libmachine: (ha-735960) DBG | SSH cmd err, output: <nil>: 

	I0701 12:21:29.042747  652196 main.go:141] libmachine: (ha-735960) Calling .GetConfigRaw

	I0701 12:21:29.043414  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:29.046291  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.046689  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.046714  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.046967  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:29.047187  652196 machine.go:94] provisionDockerMachine start ...

	I0701 12:21:29.047211  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:29.047467  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.049524  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.049899  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.049924  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.050040  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.050240  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.050477  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.050669  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.050868  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.051073  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.051086  652196 main.go:141] libmachine: About to run SSH command:

	hostname

	I0701 12:21:29.166645  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0701 12:21:29.166687  652196 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:21:29.166983  652196 buildroot.go:166] provisioning hostname "ha-735960"

	I0701 12:21:29.167013  652196 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:21:29.167232  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.169829  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.170228  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.170260  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.170403  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.170603  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.170773  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.170913  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.171082  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.171259  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.171270  652196 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-735960 && echo "ha-735960" | sudo tee /etc/hostname

	I0701 12:21:29.295697  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-735960

	I0701 12:21:29.295728  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.298625  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.299014  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.299041  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.299233  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.299434  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.299641  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.299795  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.299954  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.300149  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.300171  652196 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-735960' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-735960/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-735960' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0701 12:21:29.418489  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0701 12:21:29.418522  652196 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19166-630650/.minikube CaCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19166-630650/.minikube}

	I0701 12:21:29.418577  652196 buildroot.go:174] setting up certificates

	I0701 12:21:29.418593  652196 provision.go:84] configureAuth start

	I0701 12:21:29.418612  652196 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:21:29.418889  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:29.421815  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.422238  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.422275  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.422477  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.424787  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.425187  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.425216  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.425427  652196 provision.go:143] copyHostCerts

	I0701 12:21:29.425466  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:29.425530  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem, removing ...

	I0701 12:21:29.425542  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:29.425624  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem (1078 bytes)

	I0701 12:21:29.425732  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:29.425753  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem, removing ...

	I0701 12:21:29.425758  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:29.425798  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem (1123 bytes)

	I0701 12:21:29.425856  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:29.425872  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem, removing ...

	I0701 12:21:29.425877  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:29.425897  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem (1675 bytes)

	I0701 12:21:29.425958  652196 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem org=jenkins.ha-735960 san=[127.0.0.1 192.168.39.16 ha-735960 localhost minikube]

	I0701 12:21:29.592360  652196 provision.go:177] copyRemoteCerts

	I0701 12:21:29.592437  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0701 12:21:29.592463  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.595489  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.595884  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.595908  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.596131  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.596356  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.596515  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.596646  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:29.684124  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0701 12:21:29.684214  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I0701 12:21:29.707185  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0701 12:21:29.707254  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0701 12:21:29.729605  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0701 12:21:29.729687  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0701 12:21:29.751505  652196 provision.go:87] duration metric: took 332.894756ms to configureAuth

	I0701 12:21:29.751536  652196 buildroot.go:189] setting minikube options for container-runtime

	I0701 12:21:29.751802  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:29.751834  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:29.752179  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.754903  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.755331  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.755367  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.755494  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.755709  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.755868  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.756016  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.756168  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.756341  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.756351  652196 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0701 12:21:29.867557  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0701 12:21:29.867582  652196 buildroot.go:70] root file system type: tmpfs

	I0701 12:21:29.867738  652196 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0701 12:21:29.867768  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.870702  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.871111  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.871152  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.871294  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.871532  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.871806  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.871989  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.872177  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.872347  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.872410  652196 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0701 12:21:29.995623  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0701 12:21:29.995671  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.998574  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.998969  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.999001  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.999184  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.999403  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.999598  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.999772  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.999916  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:30.000093  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:30.000109  652196 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0701 12:21:31.849411  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0701 12:21:31.849452  652196 machine.go:97] duration metric: took 2.802248138s to provisionDockerMachine

	I0701 12:21:31.849473  652196 start.go:293] postStartSetup for "ha-735960" (driver="kvm2")

	I0701 12:21:31.849487  652196 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0701 12:21:31.849508  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:31.849934  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0701 12:21:31.849982  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:31.853029  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.853464  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:31.853494  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.853656  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:31.853877  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:31.854065  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:31.854242  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:31.948096  652196 ssh_runner.go:195] Run: cat /etc/os-release

	I0701 12:21:31.952493  652196 info.go:137] Remote host: Buildroot 2023.02.9

	I0701 12:21:31.952522  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/addons for local assets ...

	I0701 12:21:31.952580  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/files for local assets ...

	I0701 12:21:31.952654  652196 filesync.go:149] local asset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> 6378542.pem in /etc/ssl/certs

	I0701 12:21:31.952664  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /etc/ssl/certs/6378542.pem

	I0701 12:21:31.952750  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0701 12:21:31.962034  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:21:31.985898  652196 start.go:296] duration metric: took 136.407484ms for postStartSetup

	I0701 12:21:31.985953  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:31.986287  652196 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup

	I0701 12:21:31.986316  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:31.988934  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.989328  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:31.989359  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.989497  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:31.989724  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:31.989863  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:31.990038  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:32.076710  652196 machine.go:198] restoring vm config from /var/lib/minikube/backup: [etc]

	I0701 12:21:32.076807  652196 ssh_runner.go:195] Run: sudo rsync --archive --update /var/lib/minikube/backup/etc /

	I0701 12:21:32.133792  652196 fix.go:56] duration metric: took 18.045488816s for fixHost

	I0701 12:21:32.133863  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:32.136703  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.137078  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.137110  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.137321  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:32.137591  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.137793  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.137963  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:32.138201  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:32.138518  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:32.138541  652196 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0701 12:21:32.254973  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 1719836492.215186729

	I0701 12:21:32.255001  652196 fix.go:216] guest clock: 1719836492.215186729

	I0701 12:21:32.255007  652196 fix.go:229] Guest: 2024-07-01 12:21:32.215186729 +0000 UTC Remote: 2024-07-01 12:21:32.133836118 +0000 UTC m=+18.172225533 (delta=81.350611ms)

	I0701 12:21:32.255027  652196 fix.go:200] guest clock delta is within tolerance: 81.350611ms

	I0701 12:21:32.255032  652196 start.go:83] releasing machines lock for "ha-735960", held for 18.166751927s

	I0701 12:21:32.255050  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.255338  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:32.258091  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.258459  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.258481  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.258679  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.259224  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.259383  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.259520  652196 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0701 12:21:32.259564  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:32.259693  652196 ssh_runner.go:195] Run: cat /version.json

	I0701 12:21:32.259718  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:32.262127  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.262481  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.262518  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.262538  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.262653  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:32.262845  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.263031  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:32.263054  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.263074  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.263215  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:32.263229  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:32.263398  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.263547  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:32.263699  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:32.343012  652196 ssh_runner.go:195] Run: systemctl --version

	I0701 12:21:32.428409  652196 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0701 12:21:32.433742  652196 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0701 12:21:32.433815  652196 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0701 12:21:32.449052  652196 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0701 12:21:32.449087  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:32.449338  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:32.471651  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0701 12:21:32.481832  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0701 12:21:32.491470  652196 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0701 12:21:32.491548  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0701 12:21:32.501229  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:32.511119  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0701 12:21:32.520826  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:32.530559  652196 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0701 12:21:32.542109  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0701 12:21:32.551821  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0701 12:21:32.561403  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0701 12:21:32.571068  652196 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0701 12:21:32.579813  652196 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0701 12:21:32.588595  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:32.705377  652196 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0701 12:21:32.724169  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:32.724285  652196 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0701 12:21:32.739050  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:32.753169  652196 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0701 12:21:32.769805  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:32.783750  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:32.797509  652196 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0701 12:21:32.821510  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:32.835901  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:32.854192  652196 ssh_runner.go:195] Run: which cri-dockerd

	I0701 12:21:32.858039  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0701 12:21:32.867652  652196 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0701 12:21:32.884216  652196 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0701 12:21:33.001636  652196 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0701 12:21:33.121229  652196 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0701 12:21:33.121419  652196 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0701 12:21:33.138482  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:33.262395  652196 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0701 12:21:35.714549  652196 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.452099351s)

	I0701 12:21:35.714642  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0701 12:21:35.727946  652196 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I0701 12:21:35.744089  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:21:35.757426  652196 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0701 12:21:35.868089  652196 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0701 12:21:35.989857  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:36.121343  652196 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0701 12:21:36.138520  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:21:36.152026  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:36.271312  652196 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0701 12:21:36.351567  652196 start.go:541] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0701 12:21:36.351668  652196 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0701 12:21:36.357143  652196 start.go:562] Will wait 60s for crictl version

	I0701 12:21:36.357212  652196 ssh_runner.go:195] Run: which crictl

	I0701 12:21:36.361384  652196 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0701 12:21:36.400372  652196 start.go:578] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.0.1

	RuntimeApiVersion:  v1

	I0701 12:21:36.400446  652196 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:21:36.427941  652196 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:21:36.456620  652196 out.go:204] * Preparing Kubernetes v1.30.2 on Docker 27.0.1 ...

	I0701 12:21:36.456687  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:36.459384  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:36.459752  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:36.459781  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:36.459970  652196 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0701 12:21:36.463956  652196 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:21:36.476676  652196 kubeadm.go:877] updating cluster {Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Cl

usterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:fa

lse freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p200

0.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0701 12:21:36.476851  652196 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:21:36.476914  652196 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0701 12:21:36.493466  652196 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.30.2

	registry.k8s.io/kube-controller-manager:v1.30.2

	registry.k8s.io/kube-scheduler:v1.30.2

	registry.k8s.io/kube-proxy:v1.30.2

	kindest/kindnetd:v20240513-cd2ac642

	ghcr.io/kube-vip/kube-vip:v0.8.0

	registry.k8s.io/etcd:3.5.12-0

	registry.k8s.io/coredns/coredns:v1.11.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28

	-- /stdout --

	I0701 12:21:36.493530  652196 docker.go:615] Images already preloaded, skipping extraction

	I0701 12:21:36.493620  652196 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0701 12:21:36.510908  652196 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.30.2

	registry.k8s.io/kube-controller-manager:v1.30.2

	registry.k8s.io/kube-scheduler:v1.30.2

	registry.k8s.io/kube-proxy:v1.30.2

	kindest/kindnetd:v20240513-cd2ac642

	ghcr.io/kube-vip/kube-vip:v0.8.0

	registry.k8s.io/etcd:3.5.12-0

	registry.k8s.io/coredns/coredns:v1.11.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28

	-- /stdout --

	I0701 12:21:36.510939  652196 cache_images.go:84] Images are preloaded, skipping loading

	I0701 12:21:36.510952  652196 kubeadm.go:928] updating node { 192.168.39.16 8443 v1.30.2 docker true true} ...

	I0701 12:21:36.511079  652196 kubeadm.go:940] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-735960 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.16

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0701 12:21:36.511139  652196 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0701 12:21:36.536408  652196 cni.go:84] Creating CNI manager for ""

	I0701 12:21:36.536430  652196 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0701 12:21:36.536441  652196 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0701 12:21:36.536470  652196 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.16 APIServerPort:8443 KubernetesVersion:v1.30.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-735960 NodeName:ha-735960 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.16"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.16 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes

/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0701 12:21:36.536633  652196 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.16

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "ha-735960"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.16

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.16"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0701 12:21:36.536656  652196 kube-vip.go:115] generating kube-vip config ...

	I0701 12:21:36.536698  652196 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0701 12:21:36.551906  652196 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0701 12:21:36.552024  652196 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0701 12:21:36.552078  652196 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0701 12:21:36.561989  652196 binaries.go:44] Found k8s binaries, skipping transfer

	I0701 12:21:36.562059  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0701 12:21:36.571281  652196 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0701 12:21:36.587480  652196 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0701 12:21:36.603596  652196 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2154 bytes)

	I0701 12:21:36.621063  652196 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0701 12:21:36.637192  652196 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0701 12:21:36.640909  652196 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:21:36.652690  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:36.768142  652196 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0701 12:21:36.786625  652196 certs.go:68] Setting up /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960 for IP: 192.168.39.16

	I0701 12:21:36.786655  652196 certs.go:194] generating shared ca certs ...

	I0701 12:21:36.786676  652196 certs.go:226] acquiring lock for ca certs: {Name:mk34e166bfd069e523b2325e14d1812c523bff53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:36.786854  652196 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key

	I0701 12:21:36.786904  652196 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key

	I0701 12:21:36.786915  652196 certs.go:256] generating profile certs ...

	I0701 12:21:36.787017  652196 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key

	I0701 12:21:36.787046  652196 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af

	I0701 12:21:36.787059  652196 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.16 192.168.39.86 192.168.39.97 192.168.39.254]

	I0701 12:21:37.059263  652196 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af ...

	I0701 12:21:37.059305  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af: {Name:mk1be9dc4667506ac6fdcfb1e313edd1292fe7f9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.059483  652196 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af ...

	I0701 12:21:37.059496  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af: {Name:mkf9220e489bd04f035dab270c790bb3448ca6be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.059596  652196 certs.go:381] copying /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af -> /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt

	I0701 12:21:37.059809  652196 certs.go:385] copying /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af -> /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key

	I0701 12:21:37.059969  652196 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key

	I0701 12:21:37.059987  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0701 12:21:37.060000  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0701 12:21:37.060014  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0701 12:21:37.060026  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0701 12:21:37.060038  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0701 12:21:37.060054  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0701 12:21:37.060066  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0701 12:21:37.060077  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0701 12:21:37.060165  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem (1338 bytes)

	W0701 12:21:37.060197  652196 certs.go:480] ignoring /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854_empty.pem, impossibly tiny 0 bytes

	I0701 12:21:37.060207  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem (1675 bytes)

	I0701 12:21:37.060228  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem (1078 bytes)

	I0701 12:21:37.060248  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem (1123 bytes)

	I0701 12:21:37.060270  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem (1675 bytes)

	I0701 12:21:37.060305  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:21:37.060331  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem -> /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.060347  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.060359  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.061045  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0701 12:21:37.111708  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0701 12:21:37.168649  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0701 12:21:37.204675  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0701 12:21:37.241167  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)

	I0701 12:21:37.265225  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0701 12:21:37.288613  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0701 12:21:37.312645  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0701 12:21:37.337494  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem --> /usr/share/ca-certificates/637854.pem (1338 bytes)

	I0701 12:21:37.361044  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /usr/share/ca-certificates/6378542.pem (1708 bytes)

	I0701 12:21:37.385424  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0701 12:21:37.409054  652196 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0701 12:21:37.426602  652196 ssh_runner.go:195] Run: openssl version

	I0701 12:21:37.432129  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0701 12:21:37.442695  652196 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.447331  652196 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul  1 12:05 /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.447415  652196 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.453215  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0701 12:21:37.464086  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/637854.pem && ln -fs /usr/share/ca-certificates/637854.pem /etc/ssl/certs/637854.pem"

	I0701 12:21:37.474527  652196 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.479057  652196 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul  1 12:11 /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.479123  652196 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.484641  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/637854.pem /etc/ssl/certs/51391683.0"

	I0701 12:21:37.495175  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6378542.pem && ln -fs /usr/share/ca-certificates/6378542.pem /etc/ssl/certs/6378542.pem"

	I0701 12:21:37.505961  652196 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.510286  652196 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul  1 12:11 /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.510365  652196 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.516124  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/6378542.pem /etc/ssl/certs/3ec20f2e.0"

	I0701 12:21:37.527154  652196 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0701 12:21:37.532024  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I0701 12:21:37.538145  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I0701 12:21:37.544280  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I0701 12:21:37.550448  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I0701 12:21:37.556356  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I0701 12:21:37.562174  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I0701 12:21:37.568144  652196 kubeadm.go:391] StartCluster: {Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Clust

erName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false

freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L

MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:21:37.568362  652196 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0701 12:21:37.586457  652196 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	W0701 12:21:37.596129  652196 kubeadm.go:404] apiserver tunnel failed: apiserver port not set

	I0701 12:21:37.596158  652196 kubeadm.go:407] found existing configuration files, will attempt cluster restart

	I0701 12:21:37.596164  652196 kubeadm.go:587] restartPrimaryControlPlane start ...

	I0701 12:21:37.596237  652196 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I0701 12:21:37.605715  652196 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0701 12:21:37.606193  652196 kubeconfig.go:47] verify endpoint returned: get endpoint: "ha-735960" does not appear in /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:37.606354  652196 kubeconfig.go:62] /home/jenkins/minikube-integration/19166-630650/kubeconfig needs updating (will repair): [kubeconfig missing "ha-735960" cluster setting kubeconfig missing "ha-735960" context setting]

	I0701 12:21:37.606708  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/kubeconfig: {Name:mke3ef9d019eff4edd273b00c416fd77ed009242 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.607135  652196 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:37.607365  652196 kapi.go:59] client config for ha-735960: &rest.Config{Host:"https://192.168.39.16:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.crt", KeyFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key", CAFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(ni

l)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1cfbb80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0701 12:21:37.607752  652196 cert_rotation.go:137] Starting client certificate rotation controller

	I0701 12:21:37.608047  652196 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0701 12:21:37.617685  652196 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.39.16

	I0701 12:21:37.617715  652196 kubeadm.go:591] duration metric: took 21.544408ms to restartPrimaryControlPlane

	I0701 12:21:37.617725  652196 kubeadm.go:393] duration metric: took 49.593354ms to StartCluster

	I0701 12:21:37.617748  652196 settings.go:142] acquiring lock: {Name:mk6f7c85ea77a73ff0ac851454721f2e6e309153 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.617834  652196 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:37.618535  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/kubeconfig: {Name:mke3ef9d019eff4edd273b00c416fd77ed009242 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.618754  652196 start.go:232] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0701 12:21:37.618777  652196 start.go:240] waiting for startup goroutines ...

	I0701 12:21:37.618792  652196 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0701 12:21:37.619028  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:37.621683  652196 out.go:177] * Enabled addons: 

	I0701 12:21:37.622979  652196 addons.go:510] duration metric: took 4.192015ms for enable addons: enabled=[]

	I0701 12:21:37.623011  652196 start.go:245] waiting for cluster config update ...

	I0701 12:21:37.623019  652196 start.go:254] writing updated cluster config ...

	I0701 12:21:37.624600  652196 out.go:177] 

	I0701 12:21:37.626023  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:37.626124  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:37.627745  652196 out.go:177] * Starting "ha-735960-m02" control-plane node in "ha-735960" cluster

	I0701 12:21:37.628946  652196 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:21:37.628969  652196 cache.go:56] Caching tarball of preloaded images

	I0701 12:21:37.629060  652196 preload.go:173] Found /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0701 12:21:37.629072  652196 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on docker

	I0701 12:21:37.629161  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:37.629353  652196 start.go:360] acquireMachinesLock for ha-735960-m02: {Name:mk43a6c0c0c15a237623df377ad65b82186c0ad8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0701 12:21:37.629411  652196 start.go:364] duration metric: took 31.79µs to acquireMachinesLock for "ha-735960-m02"

	I0701 12:21:37.629427  652196 start.go:96] Skipping create...Using existing machine configuration

	I0701 12:21:37.629440  652196 fix.go:54] fixHost starting: m02

	I0701 12:21:37.629698  652196 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:21:37.629747  652196 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:21:37.644981  652196 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41663

	I0701 12:21:37.645473  652196 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:21:37.645947  652196 main.go:141] libmachine: Using API Version  1

	I0701 12:21:37.645969  652196 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:21:37.646284  652196 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:21:37.646523  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:37.646646  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetState

	I0701 12:21:37.648195  652196 fix.go:112] recreateIfNeeded on ha-735960-m02: state=Stopped err=<nil>

	I0701 12:21:37.648228  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	W0701 12:21:37.648406  652196 fix.go:138] unexpected machine state, will restart: <nil>

	I0701 12:21:37.650489  652196 out.go:177] * Restarting existing kvm2 VM for "ha-735960-m02" ...

	I0701 12:21:37.651975  652196 main.go:141] libmachine: (ha-735960-m02) Calling .Start

	I0701 12:21:37.652186  652196 main.go:141] libmachine: (ha-735960-m02) Ensuring networks are active...

	I0701 12:21:37.652916  652196 main.go:141] libmachine: (ha-735960-m02) Ensuring network default is active

	I0701 12:21:37.653282  652196 main.go:141] libmachine: (ha-735960-m02) Ensuring network mk-ha-735960 is active

	I0701 12:21:37.653613  652196 main.go:141] libmachine: (ha-735960-m02) Getting domain xml...

	I0701 12:21:37.654254  652196 main.go:141] libmachine: (ha-735960-m02) Creating domain...

	I0701 12:21:38.852369  652196 main.go:141] libmachine: (ha-735960-m02) Waiting to get IP...

	I0701 12:21:38.853358  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:38.853762  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:38.853832  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:38.853747  652384 retry.go:31] will retry after 295.798088ms: waiting for machine to come up

	I0701 12:21:39.151332  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:39.151886  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:39.151912  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:39.151845  652384 retry.go:31] will retry after 255.18729ms: waiting for machine to come up

	I0701 12:21:39.408310  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:39.408739  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:39.408792  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:39.408689  652384 retry.go:31] will retry after 457.740061ms: waiting for machine to come up

	I0701 12:21:39.868295  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:39.868702  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:39.868736  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:39.868629  652384 retry.go:31] will retry after 548.674851ms: waiting for machine to come up

	I0701 12:21:40.419597  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:40.420069  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:40.420100  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:40.420009  652384 retry.go:31] will retry after 755.113146ms: waiting for machine to come up

	I0701 12:21:41.176960  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:41.177380  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:41.177429  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:41.177309  652384 retry.go:31] will retry after 739.288718ms: waiting for machine to come up

	I0701 12:21:41.918305  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:41.918853  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:41.918884  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:41.918789  652384 retry.go:31] will retry after 722.041404ms: waiting for machine to come up

	I0701 12:21:42.642704  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:42.643188  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:42.643219  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:42.643113  652384 retry.go:31] will retry after 1.139279839s: waiting for machine to come up

	I0701 12:21:43.784719  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:43.785159  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:43.785193  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:43.785114  652384 retry.go:31] will retry after 1.276779849s: waiting for machine to come up

	I0701 12:21:45.063522  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:45.064026  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:45.064058  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:45.063969  652384 retry.go:31] will retry after 2.284492799s: waiting for machine to come up

	I0701 12:21:47.351530  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:47.352076  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:47.352113  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:47.351988  652384 retry.go:31] will retry after 2.171521184s: waiting for machine to come up

	I0701 12:21:49.526162  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:49.526566  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:49.526590  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:49.526523  652384 retry.go:31] will retry after 3.533181759s: waiting for machine to come up

	I0701 12:21:53.061482  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.062025  652196 main.go:141] libmachine: (ha-735960-m02) Found IP for machine: 192.168.39.86

	I0701 12:21:53.062048  652196 main.go:141] libmachine: (ha-735960-m02) Reserving static IP address...

	I0701 12:21:53.062060  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has current primary IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.062473  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "ha-735960-m02", mac: "52:54:00:0b:2f:ce", ip: "192.168.39.86"} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.062504  652196 main.go:141] libmachine: (ha-735960-m02) DBG | skip adding static IP to network mk-ha-735960 - found existing host DHCP lease matching {name: "ha-735960-m02", mac: "52:54:00:0b:2f:ce", ip: "192.168.39.86"}

	I0701 12:21:53.062534  652196 main.go:141] libmachine: (ha-735960-m02) Reserved static IP address: 192.168.39.86

	I0701 12:21:53.062554  652196 main.go:141] libmachine: (ha-735960-m02) Waiting for SSH to be available...

	I0701 12:21:53.062566  652196 main.go:141] libmachine: (ha-735960-m02) DBG | Getting to WaitForSSH function...

	I0701 12:21:53.064461  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.064796  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.064828  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.064893  652196 main.go:141] libmachine: (ha-735960-m02) DBG | Using SSH client type: external

	I0701 12:21:53.064938  652196 main.go:141] libmachine: (ha-735960-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa (-rw-------)

	I0701 12:21:53.064965  652196 main.go:141] libmachine: (ha-735960-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.86 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0701 12:21:53.064981  652196 main.go:141] libmachine: (ha-735960-m02) DBG | About to run SSH command:

	I0701 12:21:53.065000  652196 main.go:141] libmachine: (ha-735960-m02) DBG | exit 0

	I0701 12:21:53.190266  652196 main.go:141] libmachine: (ha-735960-m02) DBG | SSH cmd err, output: <nil>: 

	I0701 12:21:53.190636  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetConfigRaw

	I0701 12:21:53.191272  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:21:53.193658  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.193994  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.194027  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.194274  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:53.194544  652196 machine.go:94] provisionDockerMachine start ...

	I0701 12:21:53.194562  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:53.194814  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.196894  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.197262  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.197291  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.197414  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.197654  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.197829  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.198021  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.198185  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.198432  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.198448  652196 main.go:141] libmachine: About to run SSH command:

	hostname

	I0701 12:21:53.306480  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0701 12:21:53.306526  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:21:53.306839  652196 buildroot.go:166] provisioning hostname "ha-735960-m02"

	I0701 12:21:53.306870  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:21:53.307063  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.309645  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.310086  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.310116  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.310307  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.310514  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.310689  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.310820  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.310997  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.311210  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.311225  652196 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-735960-m02 && echo "ha-735960-m02" | sudo tee /etc/hostname

	I0701 12:21:53.434956  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-735960-m02

	I0701 12:21:53.434992  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.437612  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.438016  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.438040  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.438190  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.438418  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.438601  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.438768  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.438926  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.439106  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.439128  652196 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-735960-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-735960-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-735960-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0701 12:21:53.559115  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0701 12:21:53.559146  652196 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19166-630650/.minikube CaCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19166-630650/.minikube}

	I0701 12:21:53.559163  652196 buildroot.go:174] setting up certificates

	I0701 12:21:53.559174  652196 provision.go:84] configureAuth start

	I0701 12:21:53.559186  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:21:53.559514  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:21:53.562119  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.562516  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.562550  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.562753  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.564741  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.565063  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.565082  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.565233  652196 provision.go:143] copyHostCerts

	I0701 12:21:53.565266  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:53.565309  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem, removing ...

	I0701 12:21:53.565318  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:53.565379  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem (1078 bytes)

	I0701 12:21:53.565450  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:53.565468  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem, removing ...

	I0701 12:21:53.565474  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:53.565492  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem (1123 bytes)

	I0701 12:21:53.565533  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:53.565549  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem, removing ...

	I0701 12:21:53.565555  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:53.565570  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem (1675 bytes)

	I0701 12:21:53.565618  652196 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem org=jenkins.ha-735960-m02 san=[127.0.0.1 192.168.39.86 ha-735960-m02 localhost minikube]

	I0701 12:21:53.749696  652196 provision.go:177] copyRemoteCerts

	I0701 12:21:53.749755  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0701 12:21:53.749780  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.752460  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.752780  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.752813  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.752952  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.753159  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.753385  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.753547  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:53.835990  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0701 12:21:53.836060  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0701 12:21:53.858665  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0701 12:21:53.858753  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0701 12:21:53.880281  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0701 12:21:53.880367  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0701 12:21:53.902677  652196 provision.go:87] duration metric: took 343.48703ms to configureAuth

	I0701 12:21:53.902709  652196 buildroot.go:189] setting minikube options for container-runtime

	I0701 12:21:53.903020  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:53.903053  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:53.903351  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.905929  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.906189  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.906216  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.906438  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.906667  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.906826  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.906966  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.907119  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.907282  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.907294  652196 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0701 12:21:54.019474  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0701 12:21:54.019501  652196 buildroot.go:70] root file system type: tmpfs

	I0701 12:21:54.019656  652196 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0701 12:21:54.019681  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:54.022816  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.023184  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:54.023208  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.023371  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:54.023579  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.023787  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.023946  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:54.024146  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:54.024319  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:54.024384  652196 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment="NO_PROXY=192.168.39.16"

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0701 12:21:54.147740  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment=NO_PROXY=192.168.39.16

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0701 12:21:54.147778  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:54.150547  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.151173  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:54.151208  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.151345  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:54.151561  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.151771  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.151918  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:54.152095  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:54.152266  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:54.152281  652196 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0701 12:21:56.028628  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0701 12:21:56.028682  652196 machine.go:97] duration metric: took 2.834118436s to provisionDockerMachine

	I0701 12:21:56.028701  652196 start.go:293] postStartSetup for "ha-735960-m02" (driver="kvm2")

	I0701 12:21:56.028716  652196 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0701 12:21:56.028738  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.029099  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0701 12:21:56.029132  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.031882  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.032264  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.032289  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.032433  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.032608  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.032817  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.032971  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:56.117309  652196 ssh_runner.go:195] Run: cat /etc/os-release

	I0701 12:21:56.121231  652196 info.go:137] Remote host: Buildroot 2023.02.9

	I0701 12:21:56.121263  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/addons for local assets ...

	I0701 12:21:56.121324  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/files for local assets ...

	I0701 12:21:56.121391  652196 filesync.go:149] local asset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> 6378542.pem in /etc/ssl/certs

	I0701 12:21:56.121402  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /etc/ssl/certs/6378542.pem

	I0701 12:21:56.121478  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0701 12:21:56.130302  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:21:56.152776  652196 start.go:296] duration metric: took 124.058691ms for postStartSetup

	I0701 12:21:56.152821  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.153142  652196 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup

	I0701 12:21:56.153170  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.155689  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.156094  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.156120  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.156332  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.156555  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.156727  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.156917  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:56.240391  652196 machine.go:198] restoring vm config from /var/lib/minikube/backup: [etc]

	I0701 12:21:56.240454  652196 ssh_runner.go:195] Run: sudo rsync --archive --update /var/lib/minikube/backup/etc /

	I0701 12:21:56.280843  652196 fix.go:56] duration metric: took 18.651393475s for fixHost

	I0701 12:21:56.280895  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.283268  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.283590  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.283617  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.283860  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.284107  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.284307  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.284501  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.284686  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:56.284888  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:56.284903  652196 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0701 12:21:56.398873  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 1719836516.359963406

	I0701 12:21:56.398893  652196 fix.go:216] guest clock: 1719836516.359963406

	I0701 12:21:56.398901  652196 fix.go:229] Guest: 2024-07-01 12:21:56.359963406 +0000 UTC Remote: 2024-07-01 12:21:56.280872467 +0000 UTC m=+42.319261894 (delta=79.090939ms)

	I0701 12:21:56.398919  652196 fix.go:200] guest clock delta is within tolerance: 79.090939ms

	I0701 12:21:56.398924  652196 start.go:83] releasing machines lock for "ha-735960-m02", held for 18.769503298s

	I0701 12:21:56.398940  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.399198  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:21:56.401982  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.402404  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.402436  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.404680  652196 out.go:177] * Found network options:

	I0701 12:21:56.406167  652196 out.go:177]   - NO_PROXY=192.168.39.16

	W0701 12:21:56.407620  652196 proxy.go:119] fail to check proxy env: Error ip not in block

	I0701 12:21:56.407664  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.408285  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.408498  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.408606  652196 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0701 12:21:56.408647  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	W0701 12:21:56.408741  652196 proxy.go:119] fail to check proxy env: Error ip not in block

	I0701 12:21:56.408826  652196 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I0701 12:21:56.408849  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.411170  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.411559  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.411598  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.411651  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.411933  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.412130  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.412221  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.412247  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.412295  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.412519  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.412508  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:56.412720  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.412871  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.412987  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	W0701 12:21:56.492511  652196 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0701 12:21:56.492595  652196 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0701 12:21:56.515270  652196 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0701 12:21:56.515305  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:56.515419  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:56.549004  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0701 12:21:56.560711  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0701 12:21:56.578763  652196 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0701 12:21:56.578832  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0701 12:21:56.589742  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:56.606645  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0701 12:21:56.620036  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:56.632033  652196 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0701 12:21:56.642458  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0701 12:21:56.653078  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0701 12:21:56.663035  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0701 12:21:56.673203  652196 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0701 12:21:56.682348  652196 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0701 12:21:56.691388  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:56.798709  652196 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0701 12:21:56.821386  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:56.821493  652196 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0701 12:21:56.841303  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:56.857934  652196 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0701 12:21:56.877318  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:56.889777  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:56.901844  652196 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0701 12:21:56.927595  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:56.940849  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:56.958116  652196 ssh_runner.go:195] Run: which cri-dockerd

	I0701 12:21:56.961664  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0701 12:21:56.969985  652196 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0701 12:21:56.985048  652196 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0701 12:21:57.096072  652196 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0701 12:21:57.211289  652196 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0701 12:21:57.211354  652196 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0701 12:21:57.227069  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:57.341292  652196 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0701 12:22:58.423195  652196 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1m1.08185799s)

	I0701 12:22:58.423268  652196 ssh_runner.go:195] Run: sudo journalctl --no-pager -u docker

	I0701 12:22:58.444321  652196 out.go:177] 

	W0701 12:22:58.445678  652196 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart docker: Process exited with status 1

	stdout:

	stderr:

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xeu docker.service" for details.

	sudo journalctl --no-pager -u docker:

	-- stdout --

	Jul 01 12:21:54 ha-735960-m02 systemd[1]: Starting Docker Application Container Engine...

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.524329635Z" level=info msg="Starting up"

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.525054987Z" level=info msg="containerd not running, starting managed containerd"

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.525787354Z" level=info msg="started new containerd process" address=/var/run/docker/containerd/containerd.sock module=libcontainerd pid=513

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.553695593Z" level=info msg="starting containerd" revision=ae71819c4f5e67bb4d5ae76a6b735f29cc25774e version=v1.7.18

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572290393Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572432449Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572518940Z" level=info msg="loading plugin \"io.containerd.warning.v1.deprecations\"..." type=io.containerd.warning.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572558429Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572981597Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." error="no scratch file generator: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573093539Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573355911Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573425452Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573469593Z" level=warning msg="failed to load plugin io.containerd.snapshotter.v1.devmapper" error="devmapper not configured"

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573505057Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573782642Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.574848351Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.576951334Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: FATAL: Module aufs not found in directory /lib/modules/5.10.207\\n\"): skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577031827Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577253828Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577304329Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577551634Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577624370Z" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured"

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577665230Z" level=info msg="metadata content store policy set" policy=shared

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.580979416Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581128476Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581284824Z" level=info msg="loading plugin \"io.containerd.lease.v1.manager\"..." type=io.containerd.lease.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581371031Z" level=info msg="loading plugin \"io.containerd.streaming.v1.manager\"..." type=io.containerd.streaming.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581432559Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581524784Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581996275Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582118070Z" level=info msg="loading plugin \"io.containerd.runtime.v2.shim\"..." type=io.containerd.runtime.v2

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582162131Z" level=info msg="loading plugin \"io.containerd.sandbox.store.v1.local\"..." type=io.containerd.sandbox.store.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582245548Z" level=info msg="loading plugin \"io.containerd.sandbox.controller.v1.local\"..." type=io.containerd.sandbox.controller.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582319648Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582368655Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582407448Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582445279Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582484550Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582521928Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582558472Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582601035Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582656126Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582693985Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582741537Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582779033Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582815513Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582853076Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582892671Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582938669Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582980248Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandbox-controllers\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583032987Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandboxes\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583083364Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583122445Z" level=info msg="loading plugin \"io.containerd.grpc.v1.streaming\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583161506Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583262727Z" level=info msg="loading plugin \"io.containerd.transfer.v1.local\"..." type=io.containerd.transfer.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583333396Z" level=info msg="loading plugin \"io.containerd.grpc.v1.transfer\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583373579Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583414811Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583520612Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583751718Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.tracing.processor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583800626Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583838317Z" level=info msg="skip loading plugin \"io.containerd.internal.v1.tracing\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583874340Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583912430Z" level=info msg="loading plugin \"io.containerd.nri.v1.nri\"..." type=io.containerd.nri.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583991424Z" level=info msg="NRI interface is disabled by configuration."

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584364167Z" level=info msg=serving... address=/var/run/docker/containerd/containerd-debug.sock

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584467963Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock.ttrpc

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584654486Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584785754Z" level=info msg="containerd successfully booted in 0.032655s"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.555699119Z" level=info msg="[graphdriver] trying configured driver: overlay2"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.620790434Z" level=info msg="Loading containers: start."

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.813021303Z" level=warning msg="ip6tables is enabled, but cannot set up ip6tables chains" error="failed to create NAT chain DOCKER: iptables failed: ip6tables --wait -t nat -N DOCKER: ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)\nPerhaps ip6tables or your kernel needs to be upgraded.\n (exit status 3)"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.888534738Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.940299653Z" level=info msg="Loading containers: done."

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.956534314Z" level=info msg="Docker daemon" commit=ff1e2c0 containerd-snapshotter=false storage-driver=overlay2 version=27.0.1

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.956851438Z" level=info msg="Daemon has completed initialization"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.988054435Z" level=info msg="API listen on /var/run/docker.sock"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.988129188Z" level=info msg="API listen on [::]:2376"

	Jul 01 12:21:55 ha-735960-m02 systemd[1]: Started Docker Application Container Engine.

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.316115209Z" level=info msg="Processing signal 'terminated'"

	Jul 01 12:21:57 ha-735960-m02 systemd[1]: Stopping Docker Application Container Engine...

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317321834Z" level=info msg="stopping event stream following graceful shutdown" error="<nil>" module=libcontainerd namespace=moby

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317386191Z" level=info msg="Daemon shutdown complete"

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317447382Z" level=info msg="stopping event stream following graceful shutdown" error="context canceled" module=libcontainerd namespace=plugins.moby

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317464543Z" level=info msg="stopping healthcheck following graceful shutdown" module=libcontainerd

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: docker.service: Deactivated successfully.

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: Stopped Docker Application Container Engine.

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: Starting Docker Application Container Engine...

	Jul 01 12:21:58 ha-735960-m02 dockerd[1188]: time="2024-07-01T12:21:58.364754006Z" level=info msg="Starting up"

	Jul 01 12:22:58 ha-735960-m02 dockerd[1188]: failed to start daemon: failed to dial "/run/containerd/containerd.sock": failed to dial "/run/containerd/containerd.sock": context deadline exceeded

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: docker.service: Failed with result 'exit-code'.

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: Failed to start Docker Application Container Engine.

	-- /stdout --

	W0701 12:22:58.445741  652196 out.go:239] * 

	W0701 12:22:58.447325  652196 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0701 12:22:58.449434  652196 out.go:177] 

	==> Docker <==

	Jul 01 12:21:44 ha-735960 dockerd[1190]: time="2024-07-01T12:21:44.208507474Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:05 ha-735960 dockerd[1184]: time="2024-07-01T12:22:05.425890009Z" level=info msg="ignoring event" container=d97b6df80577316a9cf70b2af0f8d52bb2bd7071ff932a8f1f03df9497724786 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Jul 01 12:22:05 ha-735960 dockerd[1190]: time="2024-07-01T12:22:05.426406022Z" level=info msg="shim disconnected" id=d97b6df80577316a9cf70b2af0f8d52bb2bd7071ff932a8f1f03df9497724786 namespace=moby

	Jul 01 12:22:05 ha-735960 dockerd[1190]: time="2024-07-01T12:22:05.427162251Z" level=warning msg="cleaning up after shim disconnected" id=d97b6df80577316a9cf70b2af0f8d52bb2bd7071ff932a8f1f03df9497724786 namespace=moby

	Jul 01 12:22:05 ha-735960 dockerd[1190]: time="2024-07-01T12:22:05.427275716Z" level=info msg="cleaning up dead shim" namespace=moby

	Jul 01 12:22:06 ha-735960 dockerd[1190]: time="2024-07-01T12:22:06.439101176Z" level=info msg="shim disconnected" id=ad4259a9c8ee03ff4c6910c68c5c866481fede150d57267cdc957e46aca4ef80 namespace=moby

	Jul 01 12:22:06 ha-735960 dockerd[1184]: time="2024-07-01T12:22:06.441768147Z" level=info msg="ignoring event" container=ad4259a9c8ee03ff4c6910c68c5c866481fede150d57267cdc957e46aca4ef80 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Jul 01 12:22:06 ha-735960 dockerd[1190]: time="2024-07-01T12:22:06.442054407Z" level=warning msg="cleaning up after shim disconnected" id=ad4259a9c8ee03ff4c6910c68c5c866481fede150d57267cdc957e46aca4ef80 namespace=moby

	Jul 01 12:22:06 ha-735960 dockerd[1190]: time="2024-07-01T12:22:06.442214156Z" level=info msg="cleaning up dead shim" namespace=moby

	Jul 01 12:22:24 ha-735960 dockerd[1190]: time="2024-07-01T12:22:24.071877635Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jul 01 12:22:24 ha-735960 dockerd[1190]: time="2024-07-01T12:22:24.072398316Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jul 01 12:22:24 ha-735960 dockerd[1190]: time="2024-07-01T12:22:24.072506177Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:24 ha-735960 dockerd[1190]: time="2024-07-01T12:22:24.072761669Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:27 ha-735960 dockerd[1190]: time="2024-07-01T12:22:27.091757274Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jul 01 12:22:27 ha-735960 dockerd[1190]: time="2024-07-01T12:22:27.091819785Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jul 01 12:22:27 ha-735960 dockerd[1190]: time="2024-07-01T12:22:27.091834055Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:27 ha-735960 dockerd[1190]: time="2024-07-01T12:22:27.092367194Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:47 ha-735960 dockerd[1184]: time="2024-07-01T12:22:47.577930706Z" level=info msg="ignoring event" container=e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Jul 01 12:22:47 ha-735960 dockerd[1190]: time="2024-07-01T12:22:47.578670317Z" level=info msg="shim disconnected" id=e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30 namespace=moby

	Jul 01 12:22:47 ha-735960 dockerd[1190]: time="2024-07-01T12:22:47.578983718Z" level=warning msg="cleaning up after shim disconnected" id=e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30 namespace=moby

	Jul 01 12:22:47 ha-735960 dockerd[1190]: time="2024-07-01T12:22:47.579585559Z" level=info msg="cleaning up dead shim" namespace=moby

	Jul 01 12:22:48 ha-735960 dockerd[1184]: time="2024-07-01T12:22:48.582829662Z" level=info msg="ignoring event" container=829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Jul 01 12:22:48 ha-735960 dockerd[1190]: time="2024-07-01T12:22:48.583282892Z" level=info msg="shim disconnected" id=829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d namespace=moby

	Jul 01 12:22:48 ha-735960 dockerd[1190]: time="2024-07-01T12:22:48.584157023Z" level=warning msg="cleaning up after shim disconnected" id=829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d namespace=moby

	Jul 01 12:22:48 ha-735960 dockerd[1190]: time="2024-07-01T12:22:48.584285564Z" level=info msg="cleaning up dead shim" namespace=moby

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED              STATE               NAME                      ATTEMPT             POD ID              POD

	e546c39248bc8       56ce0fd9fb532                                                                                         34 seconds ago       Exited              kube-apiserver            2                   16dae930b4edb       kube-apiserver-ha-735960

	829fe19c75ce3       e874818b3caac                                                                                         37 seconds ago       Exited              kube-controller-manager   2                   5e2a9b91be69c       kube-controller-manager-ha-735960

	cecb3dd12e16e       38af8ddebf499                                                                                         About a minute ago   Running             kube-vip                  0                   8d1562fb4b8c3       kube-vip-ha-735960

	6a200a6b49020       3861cfcd7c04c                                                                                         About a minute ago   Running             etcd                      1                   5b1097d48d724       etcd-ha-735960

	2d71437c5f06d       7820c83aa1394                                                                                         About a minute ago   Running             kube-scheduler            1                   fa7dea6a1b8bd       kube-scheduler-ha-735960

	14112a4d8f2cb       38af8ddebf499                                                                                         2 minutes ago        Exited              kube-vip                  1                   46ab74fdab7e2       kube-vip-ha-735960

	1ef6d9da6a9c5       gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12   4 minutes ago        Exited              busybox                   0                   1f5ccc7b0e655       busybox-fc5497c4f-pjfcw

	a9c30cd4b3455       cbb01a7bd410d                                                                                         6 minutes ago        Exited              coredns                   0                   7b4b4f7ec4b63       coredns-7db6d8ff4d-nk4lf

	769b0b8751350       cbb01a7bd410d                                                                                         6 minutes ago        Exited              coredns                   0                   7a349370d4f88       coredns-7db6d8ff4d-p4rtz

	97d58c94f3fdc       6e38f40d628db                                                                                         6 minutes ago        Exited              storage-provisioner       0                   9226633ad878a       storage-provisioner

	f472aef5302fd       kindest/kindnetd@sha256:9c2b5fcda3cb5a9725ecb893f3c8998a92d51a87465a886eb563e18d649383a8              6 minutes ago        Exited              kindnet-cni               0                   ab9c74a502295       kindnet-7f6hm

	6116abe6039dc       53c535741fb44                                                                                         6 minutes ago        Exited              kube-proxy                0                   da69191059798       kube-proxy-lphzn

	cb63d54411807       7820c83aa1394                                                                                         7 minutes ago        Exited              kube-scheduler            0                   19b6b0e6ed64e       kube-scheduler-ha-735960

	24c8926d2b31d       3861cfcd7c04c                                                                                         7 minutes ago        Exited              etcd                      0                   d3b914e19ca22       etcd-ha-735960

	==> coredns [769b0b875135] <==

	[INFO] 10.244.1.2:44221 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 60 0.000082797s

	[INFO] 10.244.2.2:33797 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000157729s

	[INFO] 10.244.2.2:52590 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.004055351s

	[INFO] 10.244.2.2:46983 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.003253494s

	[INFO] 10.244.2.2:56187 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000205215s

	[INFO] 10.244.2.2:41086 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000158307s

	[INFO] 10.244.0.4:47783 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000097077s

	[INFO] 10.244.0.4:50743 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.0001523s

	[INFO] 10.244.0.4:37141 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000138763s

	[INFO] 10.244.1.2:32981 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000132906s

	[INFO] 10.244.1.2:36762 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001646552s

	[INFO] 10.244.1.2:33583 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000072434s

	[INFO] 10.244.2.2:37027 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000156518s

	[INFO] 10.244.2.2:58435 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000104504s

	[INFO] 10.244.2.2:36107 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000090251s

	[INFO] 10.244.0.4:44792 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000227164s

	[INFO] 10.244.0.4:56557 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000140925s

	[INFO] 10.244.1.2:38284 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000232717s

	[INFO] 10.244.2.2:37664 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000135198s

	[INFO] 10.244.2.2:60876 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.00032392s

	[INFO] 10.244.1.2:37461 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000133264s

	[INFO] 10.244.1.2:45182 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000117372s

	[INFO] 10.244.1.2:37156 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000240093s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> coredns [a9c30cd4b345] <==

	[INFO] 10.244.0.4:57095 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.002251804s

	[INFO] 10.244.0.4:42381 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000081215s

	[INFO] 10.244.0.4:53499 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00124929s

	[INFO] 10.244.0.4:41287 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000174281s

	[INFO] 10.244.0.4:36433 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000142863s

	[INFO] 10.244.1.2:47688 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130034s

	[INFO] 10.244.1.2:40562 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00183587s

	[INFO] 10.244.1.2:35137 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.0000771s

	[INFO] 10.244.1.2:37798 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000184282s

	[INFO] 10.244.1.2:43876 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00008807s

	[INFO] 10.244.2.2:35039 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000119303s

	[INFO] 10.244.0.4:53229 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000090292s

	[INFO] 10.244.0.4:42097 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.00011308s

	[INFO] 10.244.1.2:42114 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130767s

	[INFO] 10.244.1.2:56638 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000110707s

	[INFO] 10.244.1.2:55805 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000093484s

	[INFO] 10.244.2.2:51675 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000145117s

	[INFO] 10.244.2.2:56838 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000136843s

	[INFO] 10.244.0.4:60951 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000162889s

	[INFO] 10.244.0.4:34776 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000112367s

	[INFO] 10.244.0.4:45397 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000073771s

	[INFO] 10.244.0.4:52372 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000058127s

	[INFO] 10.244.1.2:41033 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000131962s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> describe nodes <==

	command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E0701 12:23:01.267097    2767 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	E0701 12:23:01.267595    2767 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	E0701 12:23:01.269175    2767 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	E0701 12:23:01.269477    2767 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	E0701 12:23:01.270990    2767 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	==> dmesg <==

	[Jul 1 12:21] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.050877] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.036108] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.421397] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +1.628587] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +2.463440] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000007] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +4.322115] systemd-fstab-generator[476]: Ignoring "noauto" option for root device

	[  +0.057798] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.060958] systemd-fstab-generator[488]: Ignoring "noauto" option for root device

	[  +2.352578] systemd-fstab-generator[1113]: Ignoring "noauto" option for root device

	[  +0.297044] systemd-fstab-generator[1150]: Ignoring "noauto" option for root device

	[  +0.121689] systemd-fstab-generator[1162]: Ignoring "noauto" option for root device

	[  +0.127513] systemd-fstab-generator[1176]: Ignoring "noauto" option for root device

	[  +2.293985] kauditd_printk_skb: 195 callbacks suppressed

	[  +0.325101] systemd-fstab-generator[1411]: Ignoring "noauto" option for root device

	[  +0.108851] systemd-fstab-generator[1423]: Ignoring "noauto" option for root device

	[  +0.138237] systemd-fstab-generator[1435]: Ignoring "noauto" option for root device

	[  +0.156114] systemd-fstab-generator[1450]: Ignoring "noauto" option for root device

	[  +0.494872] systemd-fstab-generator[1603]: Ignoring "noauto" option for root device

	[  +6.977462] kauditd_printk_skb: 176 callbacks suppressed

	[ +11.291301] kauditd_printk_skb: 40 callbacks suppressed

	==> etcd [24c8926d2b31] <==

	{"level":"info","ts":"2024-07-01T12:21:01.297933Z","caller":"traceutil/trace.go:171","msg":"trace[249123960] range","detail":"{range_begin:/registry/leases/; range_end:/registry/leases0; }","duration":"4.106112275s","start":"2024-07-01T12:20:57.191803Z","end":"2024-07-01T12:21:01.297915Z","steps":["trace[249123960] 'agreement among raft nodes before linearized reading'  (duration: 4.10601913s)"],"step_count":1}

	{"level":"warn","ts":"2024-07-01T12:21:01.298006Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-07-01T12:20:57.191796Z","time spent":"4.106166982s","remote":"127.0.0.1:56240","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":0,"response size":0,"request content":"key:\"/registry/leases/\" range_end:\"/registry/leases0\" count_only:true "}

	2024/07/01 12:21:01 WARNING: [core] [Server #8] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	2024/07/01 12:21:01 WARNING: [core] [Server #8] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	2024/07/01 12:21:01 WARNING: [core] [Server #8] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2024-07-01T12:21:01.381902Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.39.16:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-07-01T12:21:01.38194Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.39.16:2379: use of closed network connection"}

	{"level":"info","ts":"2024-07-01T12:21:01.38203Z","caller":"etcdserver/server.go:1462","msg":"skipped leadership transfer; local server is not leader","local-member-id":"b6c76b3131c1024","current-leader-member-id":"0"}

	{"level":"info","ts":"2024-07-01T12:21:01.382382Z","caller":"rafthttp/peer.go:330","msg":"stopping remote peer","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382398Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.38247Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream Message","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382583Z","caller":"rafthttp/pipeline.go:85","msg":"stopped HTTP pipelining with remote peer","local-member-id":"b6c76b3131c1024","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382685Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"b6c76b3131c1024","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382809Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream Message","local-member-id":"b6c76b3131c1024","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382826Z","caller":"rafthttp/peer.go:335","msg":"stopped remote peer","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382832Z","caller":"rafthttp/peer.go:330","msg":"stopping remote peer","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.382882Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.3829Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream Message","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.385706Z","caller":"rafthttp/pipeline.go:85","msg":"stopped HTTP pipelining with remote peer","local-member-id":"b6c76b3131c1024","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.385804Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"b6c76b3131c1024","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.385838Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream Message","local-member-id":"b6c76b3131c1024","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.385849Z","caller":"rafthttp/peer.go:335","msg":"stopped remote peer","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.406065Z","caller":"embed/etcd.go:579","msg":"stopping serving peer traffic","address":"192.168.39.16:2380"}

	{"level":"info","ts":"2024-07-01T12:21:01.406193Z","caller":"embed/etcd.go:584","msg":"stopped serving peer traffic","address":"192.168.39.16:2380"}

	{"level":"info","ts":"2024-07-01T12:21:01.406214Z","caller":"embed/etcd.go:377","msg":"closed etcd server","name":"ha-735960","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.39.16:2380"],"advertise-client-urls":["https://192.168.39.16:2379"]}

	==> etcd [6a200a6b4902] <==

	{"level":"warn","ts":"2024-07-01T12:22:54.827561Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: i/o timeout"}

	{"level":"info","ts":"2024-07-01T12:22:56.088711Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:56.088779Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:56.088792Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:56.088806Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:56.088813Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:57.488845Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:57.488894Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:57.488907Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:57.488922Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:57.488929Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888088Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888193Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888234Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888281Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888295Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	{"level":"warn","ts":"2024-07-01T12:22:59.811118Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"c77bbbee62c21090","rtt":"0s","error":"dial tcp 192.168.39.86:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:22:59.811186Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"c77bbbee62c21090","rtt":"0s","error":"dial tcp 192.168.39.86:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:22:59.827782Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: connect: no route to host"}

	{"level":"warn","ts":"2024-07-01T12:22:59.82782Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: connect: no route to host"}

	{"level":"info","ts":"2024-07-01T12:23:00.288491Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:00.288559Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:00.288572Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:00.288586Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:00.288593Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	==> kernel <==

	 12:23:01 up 1 min,  0 users,  load average: 0.14, 0.07, 0.02

	Linux ha-735960 5.10.207 #1 SMP Wed Jun 26 19:37:34 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [f472aef5302f] <==

	I0701 12:20:12.428842       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:20:22.443154       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:20:22.443292       1 main.go:227] handling current node

	I0701 12:20:22.443323       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:20:22.443388       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:20:22.443605       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:20:22.443653       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:20:22.443793       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:20:22.443836       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:20:32.451395       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:20:32.451431       1 main.go:227] handling current node

	I0701 12:20:32.451481       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:20:32.451486       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:20:32.451947       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:20:32.451980       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:20:32.452873       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:20:32.453015       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:20:42.470169       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:20:42.470264       1 main.go:227] handling current node

	I0701 12:20:42.470289       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:20:42.470302       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:20:42.470523       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:20:42.470616       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:20:42.470868       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:20:42.470914       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	==> kube-apiserver [e546c39248bc] <==

	I0701 12:22:27.228496       1 options.go:221] external host was not specified, using 192.168.39.16

	I0701 12:22:27.229584       1 server.go:148] Version: v1.30.2

	I0701 12:22:27.229706       1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0701 12:22:27.544729       1 shared_informer.go:313] Waiting for caches to sync for node_authorizer

	I0701 12:22:27.547846       1 shared_informer.go:313] Waiting for caches to sync for *generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]

	I0701 12:22:27.551600       1 plugins.go:157] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.

	I0701 12:22:27.551634       1 plugins.go:160] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.

	I0701 12:22:27.551982       1 instance.go:299] Using reconciler: lease

	W0701 12:22:47.544372       1 logging.go:59] [core] [Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: authentication handshake failed: context deadline exceeded"

	W0701 12:22:47.544664       1 logging.go:59] [core] [Channel #3 SubChannel #4] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: authentication handshake failed: context canceled"

	F0701 12:22:47.553171       1 instance.go:292] Error creating leases: error creating storage factory: context deadline exceeded

	==> kube-controller-manager [829fe19c75ce] <==

	I0701 12:22:24.521097       1 serving.go:380] Generated self-signed cert in-memory

	I0701 12:22:24.837441       1 controllermanager.go:189] "Starting" version="v1.30.2"

	I0701 12:22:24.837478       1 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0701 12:22:24.839276       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"

	I0701 12:22:24.839470       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"

	I0701 12:22:24.839988       1 secure_serving.go:213] Serving securely on 127.0.0.1:10257

	I0701 12:22:24.840049       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	E0701 12:22:48.561111       1 controllermanager.go:234] "Error building controller context" err="failed to wait for apiserver being healthy: timed out waiting for the condition: failed to get apiserver /healthz status: Get \"https://192.168.39.16:8443/healthz\": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:57228->192.168.39.16:8443: read: connection reset by peer"

	==> kube-proxy [6116abe6039d] <==

	I0701 12:16:09.205590       1 server_linux.go:69] "Using iptables proxy"

	I0701 12:16:09.223098       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.16"]

	I0701 12:16:09.284088       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0701 12:16:09.284134       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0701 12:16:09.284152       1 server_linux.go:165] "Using iptables Proxier"

	I0701 12:16:09.286802       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0701 12:16:09.287240       1 server.go:872] "Version info" version="v1.30.2"

	I0701 12:16:09.287274       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0701 12:16:09.288803       1 config.go:192] "Starting service config controller"

	I0701 12:16:09.288830       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0701 12:16:09.289262       1 config.go:101] "Starting endpoint slice config controller"

	I0701 12:16:09.289283       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0701 12:16:09.290101       1 config.go:319] "Starting node config controller"

	I0701 12:16:09.290125       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0701 12:16:09.389941       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0701 12:16:09.390030       1 shared_informer.go:320] Caches are synced for service config

	I0701 12:16:09.390393       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [2d71437c5f06] <==

	Trace[1841834859]: ---"Objects listed" error:Get "https://192.168.39.16:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:57242->192.168.39.16:8443: read: connection reset by peer 10642ms (12:22:48.563)

	Trace[1841834859]: [10.642423199s] [10.642423199s] END

	E0701 12:22:48.563438       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://192.168.39.16:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:57242->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563506       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: Get "https://192.168.39.16:8443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59182->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563570       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://192.168.39.16:8443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59182->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563641       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: Get "https://192.168.39.16:8443/api/v1/pods?fieldSelector=status.phase%3DSucceeded%!C(MISSING)status.phase%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59186->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563665       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: Get "https://192.168.39.16:8443/api/v1/pods?fieldSelector=status.phase%3DSucceeded%!C(MISSING)status.phase%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59186->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563724       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: Get "https://192.168.39.16:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59188->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563747       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: Get "https://192.168.39.16:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59188->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563814       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: Get "https://192.168.39.16:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59202->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563830       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: Get "https://192.168.39.16:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59202->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563886       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59238->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563907       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59238->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563967       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59262->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563982       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59262->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563997       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59210->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.564229       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59210->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.669137       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: Get "https://192.168.39.16:8443/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:22:48.669192       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: Get "https://192.168.39.16:8443/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:22:51.792652       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.16:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:22:51.792757       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.16:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:22:52.248014       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: Get "https://192.168.39.16:8443/apis/apps/v1/replicasets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:22:52.248063       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: Get "https://192.168.39.16:8443/apis/apps/v1/replicasets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:22:55.201032       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://192.168.39.16:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:22:55.201141       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://192.168.39.16:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	==> kube-scheduler [cb63d5441180] <==

	W0701 12:15:50.916180       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0701 12:15:50.916379       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0701 12:15:51.752711       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0701 12:15:51.752853       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W0701 12:15:51.794007       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0701 12:15:51.794055       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W0701 12:15:51.931391       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0701 12:15:51.931434       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0701 12:15:51.950120       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0701 12:15:51.950162       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W0701 12:15:51.968922       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0701 12:15:51.969125       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0701 12:15:51.985991       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0701 12:15:51.986032       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	W0701 12:15:52.054298       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0701 12:15:52.054329       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0701 12:15:52.260873       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0701 12:15:52.260979       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	I0701 12:15:54.206866       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0701 12:19:09.710917       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-xv95g\": pod kube-proxy-xv95g is already assigned to node \"ha-735960-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-xv95g" node="ha-735960-m04"

	E0701 12:19:09.713930       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-xv95g\": pod kube-proxy-xv95g is already assigned to node \"ha-735960-m04\"" pod="kube-system/kube-proxy-xv95g"

	I0701 12:21:01.200143       1 secure_serving.go:258] Stopped listening on 127.0.0.1:10259

	I0701 12:21:01.200254       1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"

	I0701 12:21:01.200659       1 configmap_cafile_content.go:223] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	E0701 12:21:01.212693       1 run.go:74] "command failed" err="finished without leader elect"

	==> kubelet <==

	Jul 01 12:22:48 ha-735960 kubelet[1610]: I0701 12:22:48.161197    1610 scope.go:117] "RemoveContainer" containerID="e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30"

	Jul 01 12:22:48 ha-735960 kubelet[1610]: E0701 12:22:48.162173    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver pod=kube-apiserver-ha-735960_kube-system(858bfcad8b1d02b8cdc3dc83c4af060c)\"" pod="kube-system/kube-apiserver-ha-735960" podUID="858bfcad8b1d02b8cdc3dc83c4af060c"

	Jul 01 12:22:49 ha-735960 kubelet[1610]: I0701 12:22:49.180032    1610 scope.go:117] "RemoveContainer" containerID="ad4259a9c8ee03ff4c6910c68c5c866481fede150d57267cdc957e46aca4ef80"

	Jul 01 12:22:49 ha-735960 kubelet[1610]: I0701 12:22:49.181799    1610 scope.go:117] "RemoveContainer" containerID="829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d"

	Jul 01 12:22:49 ha-735960 kubelet[1610]: E0701 12:22:49.182112    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-ha-735960_kube-system(9a545edc3c0d885e2370d3a24ff8ac4b)\"" pod="kube-system/kube-controller-manager-ha-735960" podUID="9a545edc3c0d885e2370d3a24ff8ac4b"

	Jul 01 12:22:50 ha-735960 kubelet[1610]: I0701 12:22:50.089167    1610 scope.go:117] "RemoveContainer" containerID="e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30"

	Jul 01 12:22:50 ha-735960 kubelet[1610]: E0701 12:22:50.089722    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver pod=kube-apiserver-ha-735960_kube-system(858bfcad8b1d02b8cdc3dc83c4af060c)\"" pod="kube-system/kube-apiserver-ha-735960" podUID="858bfcad8b1d02b8cdc3dc83c4af060c"

	Jul 01 12:22:50 ha-735960 kubelet[1610]: I0701 12:22:50.202365    1610 scope.go:117] "RemoveContainer" containerID="829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d"

	Jul 01 12:22:50 ha-735960 kubelet[1610]: E0701 12:22:50.202700    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-ha-735960_kube-system(9a545edc3c0d885e2370d3a24ff8ac4b)\"" pod="kube-system/kube-controller-manager-ha-735960" podUID="9a545edc3c0d885e2370d3a24ff8ac4b"

	Jul 01 12:22:51 ha-735960 kubelet[1610]: I0701 12:22:51.209935    1610 scope.go:117] "RemoveContainer" containerID="829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d"

	Jul 01 12:22:51 ha-735960 kubelet[1610]: E0701 12:22:51.210647    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-ha-735960_kube-system(9a545edc3c0d885e2370d3a24ff8ac4b)\"" pod="kube-system/kube-controller-manager-ha-735960" podUID="9a545edc3c0d885e2370d3a24ff8ac4b"

	Jul 01 12:22:51 ha-735960 kubelet[1610]: I0701 12:22:51.576067    1610 kubelet_node_status.go:73] "Attempting to register node" node="ha-735960"

	Jul 01 12:22:53 ha-735960 kubelet[1610]: I0701 12:22:53.728933    1610 scope.go:117] "RemoveContainer" containerID="e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30"

	Jul 01 12:22:53 ha-735960 kubelet[1610]: E0701 12:22:53.729329    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver pod=kube-apiserver-ha-735960_kube-system(858bfcad8b1d02b8cdc3dc83c4af060c)\"" pod="kube-system/kube-apiserver-ha-735960" podUID="858bfcad8b1d02b8cdc3dc83c4af060c"

	Jul 01 12:22:53 ha-735960 kubelet[1610]: E0701 12:22:53.789831    1610 kubelet_node_status.go:96] "Unable to register node with API server" err="Post \"https://control-plane.minikube.internal:8443/api/v1/nodes\": dial tcp 192.168.39.254:8443: connect: no route to host" node="ha-735960"

	Jul 01 12:22:53 ha-735960 kubelet[1610]: E0701 12:22:53.790000    1610 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ha-735960?timeout=10s\": dial tcp 192.168.39.254:8443: connect: no route to host" interval="7s"

	Jul 01 12:22:56 ha-735960 kubelet[1610]: W0701 12:22:56.862031    1610 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://control-plane.minikube.internal:8443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:22:56 ha-735960 kubelet[1610]: E0701 12:22:56.862122    1610 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get "https://control-plane.minikube.internal:8443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:22:57 ha-735960 kubelet[1610]: E0701 12:22:57.094040    1610 eviction_manager.go:282] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ha-735960\" not found"

	Jul 01 12:22:59 ha-735960 kubelet[1610]: W0701 12:22:59.934973    1610 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:22:59 ha-735960 kubelet[1610]: E0701 12:22:59.935046    1610 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:22:59 ha-735960 kubelet[1610]: W0701 12:22:59.935096    1610 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-735960&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:22:59 ha-735960 kubelet[1610]: E0701 12:22:59.935120    1610 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-735960&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:22:59 ha-735960 kubelet[1610]: E0701 12:22:59.935170    1610 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/api/v1/namespaces/default/events\": dial tcp 192.168.39.254:8443: connect: no route to host" event="&Event{ObjectMeta:{ha-735960.17de162e90ad8f5f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ha-735960,UID:ha-735960,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ha-735960,},FirstTimestamp:2024-07-01 12:21:36.953708383 +0000 UTC m=+0.183371310,LastTimestamp:2024-07-01 12:21:36.953708383 +0000 UTC m=+0.183371310,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ha-735960,}"

	Jul 01 12:23:00 ha-735960 kubelet[1610]: I0701 12:23:00.791239    1610 kubelet_node_status.go:73] "Attempting to register node" node="ha-735960"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-735960 -n ha-735960

helpers_test.go:254: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-735960 -n ha-735960: exit status 2 (228.697485ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:254: status error: exit status 2 (may be ok)

helpers_test.go:256: "ha-735960" apiserver is not running, skipping kubectl commands (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DeleteSecondaryNode (1.89s)

=== RUN   TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete

ha_test.go:390: (dbg) Run:  out/minikube-linux-amd64 profile list --output json

ha_test.go:413: expected profile "ha-735960" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-735960\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-735960\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"kvm2\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":

1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.30.2\",\"ClusterName\":\"ha-735960\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"192.168.39.254\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"192.168.39.16\",\"Port\":8443,\"Kub

ernetesVersion\":\"v1.30.2\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m02\",\"IP\":\"192.168.39.86\",\"Port\":8443,\"KubernetesVersion\":\"v1.30.2\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m03\",\"IP\":\"192.168.39.97\",\"Port\":8443,\"KubernetesVersion\":\"v1.30.2\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true},{\"Name\":\"m04\",\"IP\":\"192.168.39.60\",\"Port\":0,\"KubernetesVersion\":\"v1.30.2\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":false,\"Worker\":true}],\"Addons\":{\"ambassador\":false,\"auto-pause\":false,\"cloud-spanner\":false,\"csi-hostpath-driver\":false,\"dashboard\":false,\"default-storageclass\":false,\"efk\":false,\"freshpod\":false,\"gcp-auth\":false,\"gvisor\":false,\"headlamp\":false,\"helm-tiller\":false,\"inaccel\":false,\"ingress\":false,\"ingress-dns\":false,\"inspektor-gadget\":false,\"istio\":false,\"istio-provisioner\":false,\"kong\":false,\"kubeflow\":false,\"kubev

irt\":false,\"logviewer\":false,\"metallb\":false,\"metrics-server\":false,\"nvidia-device-plugin\":false,\"nvidia-driver-installer\":false,\"nvidia-gpu-device-plugin\":false,\"olm\":false,\"pod-security-policy\":false,\"portainer\":false,\"registry\":false,\"registry-aliases\":false,\"registry-creds\":false,\"storage-provisioner\":false,\"storage-provisioner-gluster\":false,\"storage-provisioner-rancher\":false,\"volcano\":false,\"volumesnapshots\":false,\"yakd\":false},\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/home/jenkins:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker

\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\":false,\"ActiveKubeContext\":true}]}"*. args: "out/minikube-linux-amd64 profile list --output json"

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-735960 -n ha-735960

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p ha-735960 -n ha-735960: exit status 2 (224.251429ms)

-- stdout --

	Running

-- /stdout --

helpers_test.go:239: status error: exit status 2 (may be ok)

helpers_test.go:244: <<< TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-735960 logs -n 25

helpers_test.go:252: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m02 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m03_ha-735960-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m03:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04:/home/docker/cp-test_ha-735960-m03_ha-735960-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m04 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m03_ha-735960-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-735960 cp testdata/cp-test.txt                                                | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile2826819896/001/cp-test_ha-735960-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960:/home/docker/cp-test_ha-735960-m04_ha-735960.txt                       |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960 sudo cat                                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m04_ha-735960.txt                                 |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m02:/home/docker/cp-test_ha-735960-m04_ha-735960-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m02 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m04_ha-735960-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m03:/home/docker/cp-test_ha-735960-m04_ha-735960-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m03 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m04_ha-735960-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-735960 node stop m02 -v=7                                                     | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | ha-735960 node start m02 -v=7                                                    | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:20 UTC |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | list -p ha-735960 -v=7                                                           | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:20 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| stop    | -p ha-735960 -v=7                                                                | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:20 UTC | 01 Jul 24 12:21 UTC |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| start   | -p ha-735960 --wait=true -v=7                                                    | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:21 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | list -p ha-735960                                                                | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:22 UTC |                     |

	| node    | ha-735960 node delete m03 -v=7                                                   | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:22 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/07/01 12:21:13

	Running on machine: ubuntu-20-agent-7

	Binary: Built with gc go1.22.4 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0701 12:21:13.996326  652196 out.go:291] Setting OutFile to fd 1 ...

	I0701 12:21:13.996600  652196 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:21:13.996610  652196 out.go:304] Setting ErrFile to fd 2...

	I0701 12:21:13.996615  652196 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:21:13.996825  652196 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19166-630650/.minikube/bin

	I0701 12:21:13.997417  652196 out.go:298] Setting JSON to false

	I0701 12:21:13.998463  652196 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-7","uptime":7412,"bootTime":1719829062,"procs":181,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0701 12:21:13.998525  652196 start.go:139] virtualization: kvm guest

	I0701 12:21:14.000967  652196 out.go:177] * [ha-735960] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0701 12:21:14.002666  652196 out.go:177]   - MINIKUBE_LOCATION=19166

	I0701 12:21:14.002690  652196 notify.go:220] Checking for updates...

	I0701 12:21:14.005489  652196 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0701 12:21:14.006983  652196 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:14.008350  652196 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19166-630650/.minikube

	I0701 12:21:14.009593  652196 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0701 12:21:14.011091  652196 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0701 12:21:14.012857  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:14.012999  652196 driver.go:392] Setting default libvirt URI to qemu:///system

	I0701 12:21:14.013468  652196 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:21:14.013542  652196 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:21:14.028581  652196 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35775

	I0701 12:21:14.028967  652196 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:21:14.029528  652196 main.go:141] libmachine: Using API Version  1

	I0701 12:21:14.029551  652196 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:21:14.029916  652196 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:21:14.030116  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:14.065038  652196 out.go:177] * Using the kvm2 driver based on existing profile

	I0701 12:21:14.066535  652196 start.go:297] selected driver: kvm2

	I0701 12:21:14.066551  652196 start.go:901] validating driver "kvm2" against &{Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVer

sion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime: ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:fal

se efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVers

ion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:21:14.066723  652196 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0701 12:21:14.067041  652196 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0701 12:21:14.067114  652196 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19166-630650/.minikube/bin:/home/jenkins/workspace/KVM_Linux_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0701 12:21:14.082191  652196 install.go:137] /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0701 12:21:14.082920  652196 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0701 12:21:14.082959  652196 cni.go:84] Creating CNI manager for ""

	I0701 12:21:14.082966  652196 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0701 12:21:14.083026  652196 start.go:340] cluster config:

	{Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39

.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false h

elm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]

MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:21:14.083142  652196 iso.go:125] acquiring lock: {Name:mk5c70910f61bc270c83609c48670eaf9d7e0602 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0701 12:21:14.086358  652196 out.go:177] * Starting "ha-735960" primary control-plane node in "ha-735960" cluster

	I0701 12:21:14.087757  652196 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:21:14.087794  652196 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4

	I0701 12:21:14.087805  652196 cache.go:56] Caching tarball of preloaded images

	I0701 12:21:14.087882  652196 preload.go:173] Found /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0701 12:21:14.087892  652196 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on docker

	I0701 12:21:14.088044  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:14.088232  652196 start.go:360] acquireMachinesLock for ha-735960: {Name:mk43a6c0c0c15a237623df377ad65b82186c0ad8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0701 12:21:14.088271  652196 start.go:364] duration metric: took 21.615µs to acquireMachinesLock for "ha-735960"

	I0701 12:21:14.088285  652196 start.go:96] Skipping create...Using existing machine configuration

	I0701 12:21:14.088293  652196 fix.go:54] fixHost starting: 

	I0701 12:21:14.088547  652196 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:21:14.088578  652196 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:21:14.103070  652196 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42935

	I0701 12:21:14.103508  652196 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:21:14.104025  652196 main.go:141] libmachine: Using API Version  1

	I0701 12:21:14.104050  652196 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:21:14.104424  652196 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:21:14.104649  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:14.104829  652196 main.go:141] libmachine: (ha-735960) Calling .GetState

	I0701 12:21:14.106608  652196 fix.go:112] recreateIfNeeded on ha-735960: state=Stopped err=<nil>

	I0701 12:21:14.106630  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	W0701 12:21:14.106790  652196 fix.go:138] unexpected machine state, will restart: <nil>

	I0701 12:21:14.108833  652196 out.go:177] * Restarting existing kvm2 VM for "ha-735960" ...

	I0701 12:21:14.110060  652196 main.go:141] libmachine: (ha-735960) Calling .Start

	I0701 12:21:14.110234  652196 main.go:141] libmachine: (ha-735960) Ensuring networks are active...

	I0701 12:21:14.110976  652196 main.go:141] libmachine: (ha-735960) Ensuring network default is active

	I0701 12:21:14.111299  652196 main.go:141] libmachine: (ha-735960) Ensuring network mk-ha-735960 is active

	I0701 12:21:14.111665  652196 main.go:141] libmachine: (ha-735960) Getting domain xml...

	I0701 12:21:14.112420  652196 main.go:141] libmachine: (ha-735960) Creating domain...

	I0701 12:21:15.307133  652196 main.go:141] libmachine: (ha-735960) Waiting to get IP...

	I0701 12:21:15.308062  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:15.308526  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:15.308647  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:15.308493  652224 retry.go:31] will retry after 239.111405ms: waiting for machine to come up

	I0701 12:21:15.549211  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:15.549648  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:15.549679  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:15.549597  652224 retry.go:31] will retry after 248.256131ms: waiting for machine to come up

	I0701 12:21:15.799054  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:15.799481  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:15.799534  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:15.799422  652224 retry.go:31] will retry after 380.468685ms: waiting for machine to come up

	I0701 12:21:16.181969  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:16.182432  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:16.182634  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:16.182540  652224 retry.go:31] will retry after 592.847587ms: waiting for machine to come up

	I0701 12:21:16.777393  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:16.777837  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:16.777867  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:16.777790  652224 retry.go:31] will retry after 639.749416ms: waiting for machine to come up

	I0701 12:21:17.419540  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:17.419941  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:17.419965  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:17.419916  652224 retry.go:31] will retry after 891.768613ms: waiting for machine to come up

	I0701 12:21:18.312967  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:18.313455  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:18.313484  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:18.313399  652224 retry.go:31] will retry after 1.112048412s: waiting for machine to come up

	I0701 12:21:19.427190  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:19.427624  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:19.427655  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:19.427568  652224 retry.go:31] will retry after 1.150138437s: waiting for machine to come up

	I0701 12:21:20.579868  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:20.580291  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:20.580325  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:20.580216  652224 retry.go:31] will retry after 1.129763596s: waiting for machine to come up

	I0701 12:21:21.711416  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:21.711892  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:21.711924  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:21.711831  652224 retry.go:31] will retry after 2.143074349s: waiting for machine to come up

	I0701 12:21:23.858081  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:23.858617  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:23.858643  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:23.858578  652224 retry.go:31] will retry after 2.436757856s: waiting for machine to come up

	I0701 12:21:26.297727  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:26.298302  652196 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:21:26.298352  652196 main.go:141] libmachine: (ha-735960) DBG | I0701 12:21:26.298269  652224 retry.go:31] will retry after 2.609229165s: waiting for machine to come up

	I0701 12:21:28.911224  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.911698  652196 main.go:141] libmachine: (ha-735960) Found IP for machine: 192.168.39.16

	I0701 12:21:28.911722  652196 main.go:141] libmachine: (ha-735960) Reserving static IP address...

	I0701 12:21:28.911731  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has current primary IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.912401  652196 main.go:141] libmachine: (ha-735960) Reserved static IP address: 192.168.39.16

	I0701 12:21:28.912425  652196 main.go:141] libmachine: (ha-735960) Waiting for SSH to be available...

	I0701 12:21:28.912468  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "ha-735960", mac: "52:54:00:6c:20:7c", ip: "192.168.39.16"} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:28.912492  652196 main.go:141] libmachine: (ha-735960) DBG | skip adding static IP to network mk-ha-735960 - found existing host DHCP lease matching {name: "ha-735960", mac: "52:54:00:6c:20:7c", ip: "192.168.39.16"}

	I0701 12:21:28.912507  652196 main.go:141] libmachine: (ha-735960) DBG | Getting to WaitForSSH function...

	I0701 12:21:28.914934  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.915448  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:28.915478  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:28.915627  652196 main.go:141] libmachine: (ha-735960) DBG | Using SSH client type: external

	I0701 12:21:28.915655  652196 main.go:141] libmachine: (ha-735960) DBG | Using SSH private key: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa (-rw-------)

	I0701 12:21:28.915680  652196 main.go:141] libmachine: (ha-735960) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.16 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0701 12:21:28.915698  652196 main.go:141] libmachine: (ha-735960) DBG | About to run SSH command:

	I0701 12:21:28.915730  652196 main.go:141] libmachine: (ha-735960) DBG | exit 0

	I0701 12:21:29.042314  652196 main.go:141] libmachine: (ha-735960) DBG | SSH cmd err, output: <nil>: 

	I0701 12:21:29.042747  652196 main.go:141] libmachine: (ha-735960) Calling .GetConfigRaw

	I0701 12:21:29.043414  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:29.046291  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.046689  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.046714  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.046967  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:29.047187  652196 machine.go:94] provisionDockerMachine start ...

	I0701 12:21:29.047211  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:29.047467  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.049524  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.049899  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.049924  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.050040  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.050240  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.050477  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.050669  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.050868  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.051073  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.051086  652196 main.go:141] libmachine: About to run SSH command:

	hostname

	I0701 12:21:29.166645  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0701 12:21:29.166687  652196 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:21:29.166983  652196 buildroot.go:166] provisioning hostname "ha-735960"

	I0701 12:21:29.167013  652196 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:21:29.167232  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.169829  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.170228  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.170260  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.170403  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.170603  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.170773  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.170913  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.171082  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.171259  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.171270  652196 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-735960 && echo "ha-735960" | sudo tee /etc/hostname

	I0701 12:21:29.295697  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-735960

	I0701 12:21:29.295728  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.298625  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.299014  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.299041  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.299233  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.299434  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.299641  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.299795  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.299954  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.300149  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.300171  652196 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-735960' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-735960/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-735960' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0701 12:21:29.418489  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0701 12:21:29.418522  652196 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19166-630650/.minikube CaCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19166-630650/.minikube}

	I0701 12:21:29.418577  652196 buildroot.go:174] setting up certificates

	I0701 12:21:29.418593  652196 provision.go:84] configureAuth start

	I0701 12:21:29.418612  652196 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:21:29.418889  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:29.421815  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.422238  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.422275  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.422477  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.424787  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.425187  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.425216  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.425427  652196 provision.go:143] copyHostCerts

	I0701 12:21:29.425466  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:29.425530  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem, removing ...

	I0701 12:21:29.425542  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:29.425624  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem (1078 bytes)

	I0701 12:21:29.425732  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:29.425753  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem, removing ...

	I0701 12:21:29.425758  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:29.425798  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem (1123 bytes)

	I0701 12:21:29.425856  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:29.425872  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem, removing ...

	I0701 12:21:29.425877  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:29.425897  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem (1675 bytes)

	I0701 12:21:29.425958  652196 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem org=jenkins.ha-735960 san=[127.0.0.1 192.168.39.16 ha-735960 localhost minikube]

	I0701 12:21:29.592360  652196 provision.go:177] copyRemoteCerts

	I0701 12:21:29.592437  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0701 12:21:29.592463  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.595489  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.595884  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.595908  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.596131  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.596356  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.596515  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.596646  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:29.684124  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0701 12:21:29.684214  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I0701 12:21:29.707185  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0701 12:21:29.707254  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0701 12:21:29.729605  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0701 12:21:29.729687  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0701 12:21:29.751505  652196 provision.go:87] duration metric: took 332.894756ms to configureAuth

	I0701 12:21:29.751536  652196 buildroot.go:189] setting minikube options for container-runtime

	I0701 12:21:29.751802  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:29.751834  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:29.752179  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.754903  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.755331  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.755367  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.755494  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.755709  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.755868  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.756016  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.756168  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.756341  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.756351  652196 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0701 12:21:29.867557  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0701 12:21:29.867582  652196 buildroot.go:70] root file system type: tmpfs

	I0701 12:21:29.867738  652196 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0701 12:21:29.867768  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.870702  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.871111  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.871152  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.871294  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.871532  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.871806  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.871989  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.872177  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:29.872347  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:29.872410  652196 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0701 12:21:29.995623  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0701 12:21:29.995671  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:29.998574  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.998969  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:29.999001  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:29.999184  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:29.999403  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.999598  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:29.999772  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:29.999916  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:30.000093  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:30.000109  652196 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0701 12:21:31.849411  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0701 12:21:31.849452  652196 machine.go:97] duration metric: took 2.802248138s to provisionDockerMachine

	I0701 12:21:31.849473  652196 start.go:293] postStartSetup for "ha-735960" (driver="kvm2")

	I0701 12:21:31.849487  652196 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0701 12:21:31.849508  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:31.849934  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0701 12:21:31.849982  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:31.853029  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.853464  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:31.853494  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.853656  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:31.853877  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:31.854065  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:31.854242  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:31.948096  652196 ssh_runner.go:195] Run: cat /etc/os-release

	I0701 12:21:31.952493  652196 info.go:137] Remote host: Buildroot 2023.02.9

	I0701 12:21:31.952522  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/addons for local assets ...

	I0701 12:21:31.952580  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/files for local assets ...

	I0701 12:21:31.952654  652196 filesync.go:149] local asset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> 6378542.pem in /etc/ssl/certs

	I0701 12:21:31.952664  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /etc/ssl/certs/6378542.pem

	I0701 12:21:31.952750  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0701 12:21:31.962034  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:21:31.985898  652196 start.go:296] duration metric: took 136.407484ms for postStartSetup

	I0701 12:21:31.985953  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:31.986287  652196 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup

	I0701 12:21:31.986316  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:31.988934  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.989328  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:31.989359  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:31.989497  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:31.989724  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:31.989863  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:31.990038  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:32.076710  652196 machine.go:198] restoring vm config from /var/lib/minikube/backup: [etc]

	I0701 12:21:32.076807  652196 ssh_runner.go:195] Run: sudo rsync --archive --update /var/lib/minikube/backup/etc /

	I0701 12:21:32.133792  652196 fix.go:56] duration metric: took 18.045488816s for fixHost

	I0701 12:21:32.133863  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:32.136703  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.137078  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.137110  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.137321  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:32.137591  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.137793  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.137963  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:32.138201  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:32.138518  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:21:32.138541  652196 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0701 12:21:32.254973  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 1719836492.215186729

	I0701 12:21:32.255001  652196 fix.go:216] guest clock: 1719836492.215186729

	I0701 12:21:32.255007  652196 fix.go:229] Guest: 2024-07-01 12:21:32.215186729 +0000 UTC Remote: 2024-07-01 12:21:32.133836118 +0000 UTC m=+18.172225533 (delta=81.350611ms)

	I0701 12:21:32.255027  652196 fix.go:200] guest clock delta is within tolerance: 81.350611ms

	I0701 12:21:32.255032  652196 start.go:83] releasing machines lock for "ha-735960", held for 18.166751927s

	I0701 12:21:32.255050  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.255338  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:32.258091  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.258459  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.258481  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.258679  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.259224  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.259383  652196 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:21:32.259520  652196 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0701 12:21:32.259564  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:32.259693  652196 ssh_runner.go:195] Run: cat /version.json

	I0701 12:21:32.259718  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:21:32.262127  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.262481  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.262518  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.262538  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.262653  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:32.262845  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.263031  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:32.263054  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:32.263074  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:32.263215  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:32.263229  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:21:32.263398  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:21:32.263547  652196 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:21:32.263699  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:21:32.343012  652196 ssh_runner.go:195] Run: systemctl --version

	I0701 12:21:32.428409  652196 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0701 12:21:32.433742  652196 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0701 12:21:32.433815  652196 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0701 12:21:32.449052  652196 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0701 12:21:32.449087  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:32.449338  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:32.471651  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0701 12:21:32.481832  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0701 12:21:32.491470  652196 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0701 12:21:32.491548  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0701 12:21:32.501229  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:32.511119  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0701 12:21:32.520826  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:32.530559  652196 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0701 12:21:32.542109  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0701 12:21:32.551821  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0701 12:21:32.561403  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0701 12:21:32.571068  652196 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0701 12:21:32.579813  652196 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0701 12:21:32.588595  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:32.705377  652196 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0701 12:21:32.724169  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:32.724285  652196 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0701 12:21:32.739050  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:32.753169  652196 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0701 12:21:32.769805  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:32.783750  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:32.797509  652196 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0701 12:21:32.821510  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:32.835901  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:32.854192  652196 ssh_runner.go:195] Run: which cri-dockerd

	I0701 12:21:32.858039  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0701 12:21:32.867652  652196 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0701 12:21:32.884216  652196 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0701 12:21:33.001636  652196 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0701 12:21:33.121229  652196 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0701 12:21:33.121419  652196 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0701 12:21:33.138482  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:33.262395  652196 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0701 12:21:35.714549  652196 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.452099351s)

	I0701 12:21:35.714642  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0701 12:21:35.727946  652196 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I0701 12:21:35.744089  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:21:35.757426  652196 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0701 12:21:35.868089  652196 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0701 12:21:35.989857  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:36.121343  652196 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0701 12:21:36.138520  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:21:36.152026  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:36.271312  652196 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0701 12:21:36.351567  652196 start.go:541] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0701 12:21:36.351668  652196 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0701 12:21:36.357143  652196 start.go:562] Will wait 60s for crictl version

	I0701 12:21:36.357212  652196 ssh_runner.go:195] Run: which crictl

	I0701 12:21:36.361384  652196 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0701 12:21:36.400372  652196 start.go:578] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.0.1

	RuntimeApiVersion:  v1

	I0701 12:21:36.400446  652196 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:21:36.427941  652196 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:21:36.456620  652196 out.go:204] * Preparing Kubernetes v1.30.2 on Docker 27.0.1 ...

	I0701 12:21:36.456687  652196 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:21:36.459384  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:36.459752  652196 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:15:18 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:21:36.459781  652196 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:21:36.459970  652196 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0701 12:21:36.463956  652196 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:21:36.476676  652196 kubeadm.go:877] updating cluster {Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Cl

usterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:fa

lse freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p200

0.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0701 12:21:36.476851  652196 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:21:36.476914  652196 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0701 12:21:36.493466  652196 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.30.2

	registry.k8s.io/kube-controller-manager:v1.30.2

	registry.k8s.io/kube-scheduler:v1.30.2

	registry.k8s.io/kube-proxy:v1.30.2

	kindest/kindnetd:v20240513-cd2ac642

	ghcr.io/kube-vip/kube-vip:v0.8.0

	registry.k8s.io/etcd:3.5.12-0

	registry.k8s.io/coredns/coredns:v1.11.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28

	-- /stdout --

	I0701 12:21:36.493530  652196 docker.go:615] Images already preloaded, skipping extraction

	I0701 12:21:36.493620  652196 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0701 12:21:36.510908  652196 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.30.2

	registry.k8s.io/kube-controller-manager:v1.30.2

	registry.k8s.io/kube-scheduler:v1.30.2

	registry.k8s.io/kube-proxy:v1.30.2

	kindest/kindnetd:v20240513-cd2ac642

	ghcr.io/kube-vip/kube-vip:v0.8.0

	registry.k8s.io/etcd:3.5.12-0

	registry.k8s.io/coredns/coredns:v1.11.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28

	-- /stdout --

	I0701 12:21:36.510939  652196 cache_images.go:84] Images are preloaded, skipping loading

	I0701 12:21:36.510952  652196 kubeadm.go:928] updating node { 192.168.39.16 8443 v1.30.2 docker true true} ...

	I0701 12:21:36.511079  652196 kubeadm.go:940] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-735960 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.16

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0701 12:21:36.511139  652196 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0701 12:21:36.536408  652196 cni.go:84] Creating CNI manager for ""

	I0701 12:21:36.536430  652196 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0701 12:21:36.536441  652196 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0701 12:21:36.536470  652196 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.16 APIServerPort:8443 KubernetesVersion:v1.30.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-735960 NodeName:ha-735960 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.16"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.16 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes

/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0701 12:21:36.536633  652196 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.16

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "ha-735960"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.16

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.16"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0701 12:21:36.536656  652196 kube-vip.go:115] generating kube-vip config ...

	I0701 12:21:36.536698  652196 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0701 12:21:36.551906  652196 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0701 12:21:36.552024  652196 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0701 12:21:36.552078  652196 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0701 12:21:36.561989  652196 binaries.go:44] Found k8s binaries, skipping transfer

	I0701 12:21:36.562059  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0701 12:21:36.571281  652196 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0701 12:21:36.587480  652196 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0701 12:21:36.603596  652196 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2154 bytes)

	I0701 12:21:36.621063  652196 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0701 12:21:36.637192  652196 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0701 12:21:36.640909  652196 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:21:36.652690  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:36.768142  652196 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0701 12:21:36.786625  652196 certs.go:68] Setting up /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960 for IP: 192.168.39.16

	I0701 12:21:36.786655  652196 certs.go:194] generating shared ca certs ...

	I0701 12:21:36.786676  652196 certs.go:226] acquiring lock for ca certs: {Name:mk34e166bfd069e523b2325e14d1812c523bff53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:36.786854  652196 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key

	I0701 12:21:36.786904  652196 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key

	I0701 12:21:36.786915  652196 certs.go:256] generating profile certs ...

	I0701 12:21:36.787017  652196 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key

	I0701 12:21:36.787046  652196 certs.go:363] generating signed profile cert for "minikube": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af

	I0701 12:21:36.787059  652196 crypto.go:68] Generating cert /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af with IP's: [10.96.0.1 127.0.0.1 10.0.0.1 192.168.39.16 192.168.39.86 192.168.39.97 192.168.39.254]

	I0701 12:21:37.059263  652196 crypto.go:156] Writing cert to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af ...

	I0701 12:21:37.059305  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af: {Name:mk1be9dc4667506ac6fdcfb1e313edd1292fe7f9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.059483  652196 crypto.go:164] Writing key to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af ...

	I0701 12:21:37.059496  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af: {Name:mkf9220e489bd04f035dab270c790bb3448ca6be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.059596  652196 certs.go:381] copying /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt.5c21f4af -> /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt

	I0701 12:21:37.059809  652196 certs.go:385] copying /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af -> /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key

	I0701 12:21:37.059969  652196 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key

	I0701 12:21:37.059987  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0701 12:21:37.060000  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0701 12:21:37.060014  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0701 12:21:37.060026  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0701 12:21:37.060038  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0701 12:21:37.060054  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0701 12:21:37.060066  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0701 12:21:37.060077  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0701 12:21:37.060165  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem (1338 bytes)

	W0701 12:21:37.060197  652196 certs.go:480] ignoring /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854_empty.pem, impossibly tiny 0 bytes

	I0701 12:21:37.060207  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem (1675 bytes)

	I0701 12:21:37.060228  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem (1078 bytes)

	I0701 12:21:37.060248  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem (1123 bytes)

	I0701 12:21:37.060270  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem (1675 bytes)

	I0701 12:21:37.060305  652196 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:21:37.060331  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem -> /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.060347  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.060359  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.061045  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0701 12:21:37.111708  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0701 12:21:37.168649  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0701 12:21:37.204675  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0701 12:21:37.241167  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)

	I0701 12:21:37.265225  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0701 12:21:37.288613  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0701 12:21:37.312645  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0701 12:21:37.337494  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem --> /usr/share/ca-certificates/637854.pem (1338 bytes)

	I0701 12:21:37.361044  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /usr/share/ca-certificates/6378542.pem (1708 bytes)

	I0701 12:21:37.385424  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0701 12:21:37.409054  652196 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0701 12:21:37.426602  652196 ssh_runner.go:195] Run: openssl version

	I0701 12:21:37.432129  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0701 12:21:37.442695  652196 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.447331  652196 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul  1 12:05 /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.447415  652196 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:21:37.453215  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0701 12:21:37.464086  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/637854.pem && ln -fs /usr/share/ca-certificates/637854.pem /etc/ssl/certs/637854.pem"

	I0701 12:21:37.474527  652196 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.479057  652196 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul  1 12:11 /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.479123  652196 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/637854.pem

	I0701 12:21:37.484641  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/637854.pem /etc/ssl/certs/51391683.0"

	I0701 12:21:37.495175  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6378542.pem && ln -fs /usr/share/ca-certificates/6378542.pem /etc/ssl/certs/6378542.pem"

	I0701 12:21:37.505961  652196 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.510286  652196 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul  1 12:11 /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.510365  652196 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6378542.pem

	I0701 12:21:37.516124  652196 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/6378542.pem /etc/ssl/certs/3ec20f2e.0"

	I0701 12:21:37.527154  652196 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0701 12:21:37.532024  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I0701 12:21:37.538145  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I0701 12:21:37.544280  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I0701 12:21:37.550448  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I0701 12:21:37.556356  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I0701 12:21:37.562174  652196 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I0701 12:21:37.568144  652196 kubeadm.go:391] StartCluster: {Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Clust

erName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false

freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L

MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:21:37.568362  652196 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0701 12:21:37.586457  652196 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	W0701 12:21:37.596129  652196 kubeadm.go:404] apiserver tunnel failed: apiserver port not set

	I0701 12:21:37.596158  652196 kubeadm.go:407] found existing configuration files, will attempt cluster restart

	I0701 12:21:37.596164  652196 kubeadm.go:587] restartPrimaryControlPlane start ...

	I0701 12:21:37.596237  652196 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I0701 12:21:37.605715  652196 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0701 12:21:37.606193  652196 kubeconfig.go:47] verify endpoint returned: get endpoint: "ha-735960" does not appear in /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:37.606354  652196 kubeconfig.go:62] /home/jenkins/minikube-integration/19166-630650/kubeconfig needs updating (will repair): [kubeconfig missing "ha-735960" cluster setting kubeconfig missing "ha-735960" context setting]

	I0701 12:21:37.606708  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/kubeconfig: {Name:mke3ef9d019eff4edd273b00c416fd77ed009242 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.607135  652196 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:37.607365  652196 kapi.go:59] client config for ha-735960: &rest.Config{Host:"https://192.168.39.16:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.crt", KeyFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key", CAFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(ni

l)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1cfbb80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0701 12:21:37.607752  652196 cert_rotation.go:137] Starting client certificate rotation controller

	I0701 12:21:37.608047  652196 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0701 12:21:37.617685  652196 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.39.16

	I0701 12:21:37.617715  652196 kubeadm.go:591] duration metric: took 21.544408ms to restartPrimaryControlPlane

	I0701 12:21:37.617725  652196 kubeadm.go:393] duration metric: took 49.593354ms to StartCluster

	I0701 12:21:37.617748  652196 settings.go:142] acquiring lock: {Name:mk6f7c85ea77a73ff0ac851454721f2e6e309153 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.617834  652196 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:21:37.618535  652196 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/kubeconfig: {Name:mke3ef9d019eff4edd273b00c416fd77ed009242 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:21:37.618754  652196 start.go:232] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0701 12:21:37.618777  652196 start.go:240] waiting for startup goroutines ...

	I0701 12:21:37.618792  652196 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0701 12:21:37.619028  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:37.621683  652196 out.go:177] * Enabled addons: 

	I0701 12:21:37.622979  652196 addons.go:510] duration metric: took 4.192015ms for enable addons: enabled=[]

	I0701 12:21:37.623011  652196 start.go:245] waiting for cluster config update ...

	I0701 12:21:37.623019  652196 start.go:254] writing updated cluster config ...

	I0701 12:21:37.624600  652196 out.go:177] 

	I0701 12:21:37.626023  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:37.626124  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:37.627745  652196 out.go:177] * Starting "ha-735960-m02" control-plane node in "ha-735960" cluster

	I0701 12:21:37.628946  652196 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:21:37.628969  652196 cache.go:56] Caching tarball of preloaded images

	I0701 12:21:37.629060  652196 preload.go:173] Found /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0701 12:21:37.629072  652196 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on docker

	I0701 12:21:37.629161  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:37.629353  652196 start.go:360] acquireMachinesLock for ha-735960-m02: {Name:mk43a6c0c0c15a237623df377ad65b82186c0ad8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0701 12:21:37.629411  652196 start.go:364] duration metric: took 31.79µs to acquireMachinesLock for "ha-735960-m02"

	I0701 12:21:37.629427  652196 start.go:96] Skipping create...Using existing machine configuration

	I0701 12:21:37.629440  652196 fix.go:54] fixHost starting: m02

	I0701 12:21:37.629698  652196 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:21:37.629747  652196 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:21:37.644981  652196 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:41663

	I0701 12:21:37.645473  652196 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:21:37.645947  652196 main.go:141] libmachine: Using API Version  1

	I0701 12:21:37.645969  652196 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:21:37.646284  652196 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:21:37.646523  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:37.646646  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetState

	I0701 12:21:37.648195  652196 fix.go:112] recreateIfNeeded on ha-735960-m02: state=Stopped err=<nil>

	I0701 12:21:37.648228  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	W0701 12:21:37.648406  652196 fix.go:138] unexpected machine state, will restart: <nil>

	I0701 12:21:37.650489  652196 out.go:177] * Restarting existing kvm2 VM for "ha-735960-m02" ...

	I0701 12:21:37.651975  652196 main.go:141] libmachine: (ha-735960-m02) Calling .Start

	I0701 12:21:37.652186  652196 main.go:141] libmachine: (ha-735960-m02) Ensuring networks are active...

	I0701 12:21:37.652916  652196 main.go:141] libmachine: (ha-735960-m02) Ensuring network default is active

	I0701 12:21:37.653282  652196 main.go:141] libmachine: (ha-735960-m02) Ensuring network mk-ha-735960 is active

	I0701 12:21:37.653613  652196 main.go:141] libmachine: (ha-735960-m02) Getting domain xml...

	I0701 12:21:37.654254  652196 main.go:141] libmachine: (ha-735960-m02) Creating domain...

	I0701 12:21:38.852369  652196 main.go:141] libmachine: (ha-735960-m02) Waiting to get IP...

	I0701 12:21:38.853358  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:38.853762  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:38.853832  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:38.853747  652384 retry.go:31] will retry after 295.798088ms: waiting for machine to come up

	I0701 12:21:39.151332  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:39.151886  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:39.151912  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:39.151845  652384 retry.go:31] will retry after 255.18729ms: waiting for machine to come up

	I0701 12:21:39.408310  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:39.408739  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:39.408792  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:39.408689  652384 retry.go:31] will retry after 457.740061ms: waiting for machine to come up

	I0701 12:21:39.868295  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:39.868702  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:39.868736  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:39.868629  652384 retry.go:31] will retry after 548.674851ms: waiting for machine to come up

	I0701 12:21:40.419597  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:40.420069  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:40.420100  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:40.420009  652384 retry.go:31] will retry after 755.113146ms: waiting for machine to come up

	I0701 12:21:41.176960  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:41.177380  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:41.177429  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:41.177309  652384 retry.go:31] will retry after 739.288718ms: waiting for machine to come up

	I0701 12:21:41.918305  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:41.918853  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:41.918884  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:41.918789  652384 retry.go:31] will retry after 722.041404ms: waiting for machine to come up

	I0701 12:21:42.642704  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:42.643188  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:42.643219  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:42.643113  652384 retry.go:31] will retry after 1.139279839s: waiting for machine to come up

	I0701 12:21:43.784719  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:43.785159  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:43.785193  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:43.785114  652384 retry.go:31] will retry after 1.276779849s: waiting for machine to come up

	I0701 12:21:45.063522  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:45.064026  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:45.064058  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:45.063969  652384 retry.go:31] will retry after 2.284492799s: waiting for machine to come up

	I0701 12:21:47.351530  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:47.352076  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:47.352113  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:47.351988  652384 retry.go:31] will retry after 2.171521184s: waiting for machine to come up

	I0701 12:21:49.526162  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:49.526566  652196 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:21:49.526590  652196 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:21:49.526523  652384 retry.go:31] will retry after 3.533181759s: waiting for machine to come up

	I0701 12:21:53.061482  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.062025  652196 main.go:141] libmachine: (ha-735960-m02) Found IP for machine: 192.168.39.86

	I0701 12:21:53.062048  652196 main.go:141] libmachine: (ha-735960-m02) Reserving static IP address...

	I0701 12:21:53.062060  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has current primary IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.062473  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "ha-735960-m02", mac: "52:54:00:0b:2f:ce", ip: "192.168.39.86"} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.062504  652196 main.go:141] libmachine: (ha-735960-m02) DBG | skip adding static IP to network mk-ha-735960 - found existing host DHCP lease matching {name: "ha-735960-m02", mac: "52:54:00:0b:2f:ce", ip: "192.168.39.86"}

	I0701 12:21:53.062534  652196 main.go:141] libmachine: (ha-735960-m02) Reserved static IP address: 192.168.39.86

	I0701 12:21:53.062554  652196 main.go:141] libmachine: (ha-735960-m02) Waiting for SSH to be available...

	I0701 12:21:53.062566  652196 main.go:141] libmachine: (ha-735960-m02) DBG | Getting to WaitForSSH function...

	I0701 12:21:53.064461  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.064796  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.064828  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.064893  652196 main.go:141] libmachine: (ha-735960-m02) DBG | Using SSH client type: external

	I0701 12:21:53.064938  652196 main.go:141] libmachine: (ha-735960-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa (-rw-------)

	I0701 12:21:53.064965  652196 main.go:141] libmachine: (ha-735960-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.86 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0701 12:21:53.064981  652196 main.go:141] libmachine: (ha-735960-m02) DBG | About to run SSH command:

	I0701 12:21:53.065000  652196 main.go:141] libmachine: (ha-735960-m02) DBG | exit 0

	I0701 12:21:53.190266  652196 main.go:141] libmachine: (ha-735960-m02) DBG | SSH cmd err, output: <nil>: 

	I0701 12:21:53.190636  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetConfigRaw

	I0701 12:21:53.191272  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:21:53.193658  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.193994  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.194027  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.194274  652196 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:21:53.194544  652196 machine.go:94] provisionDockerMachine start ...

	I0701 12:21:53.194562  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:53.194814  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.196894  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.197262  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.197291  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.197414  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.197654  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.197829  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.198021  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.198185  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.198432  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.198448  652196 main.go:141] libmachine: About to run SSH command:

	hostname

	I0701 12:21:53.306480  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0701 12:21:53.306526  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:21:53.306839  652196 buildroot.go:166] provisioning hostname "ha-735960-m02"

	I0701 12:21:53.306870  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:21:53.307063  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.309645  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.310086  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.310116  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.310307  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.310514  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.310689  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.310820  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.310997  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.311210  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.311225  652196 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-735960-m02 && echo "ha-735960-m02" | sudo tee /etc/hostname

	I0701 12:21:53.434956  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-735960-m02

	I0701 12:21:53.434992  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.437612  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.438016  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.438040  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.438190  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.438418  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.438601  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.438768  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.438926  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.439106  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.439128  652196 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-735960-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-735960-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-735960-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0701 12:21:53.559115  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0701 12:21:53.559146  652196 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19166-630650/.minikube CaCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19166-630650/.minikube}

	I0701 12:21:53.559163  652196 buildroot.go:174] setting up certificates

	I0701 12:21:53.559174  652196 provision.go:84] configureAuth start

	I0701 12:21:53.559186  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:21:53.559514  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:21:53.562119  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.562516  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.562550  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.562753  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.564741  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.565063  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.565082  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.565233  652196 provision.go:143] copyHostCerts

	I0701 12:21:53.565266  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:53.565309  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem, removing ...

	I0701 12:21:53.565318  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:21:53.565379  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem (1078 bytes)

	I0701 12:21:53.565450  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:53.565468  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem, removing ...

	I0701 12:21:53.565474  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:21:53.565492  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem (1123 bytes)

	I0701 12:21:53.565533  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:53.565549  652196 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem, removing ...

	I0701 12:21:53.565555  652196 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:21:53.565570  652196 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem (1675 bytes)

	I0701 12:21:53.565618  652196 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem org=jenkins.ha-735960-m02 san=[127.0.0.1 192.168.39.86 ha-735960-m02 localhost minikube]

	I0701 12:21:53.749696  652196 provision.go:177] copyRemoteCerts

	I0701 12:21:53.749755  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0701 12:21:53.749780  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.752460  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.752780  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.752813  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.752952  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.753159  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.753385  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.753547  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:53.835990  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0701 12:21:53.836060  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0701 12:21:53.858665  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0701 12:21:53.858753  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0701 12:21:53.880281  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0701 12:21:53.880367  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0701 12:21:53.902677  652196 provision.go:87] duration metric: took 343.48703ms to configureAuth

	I0701 12:21:53.902709  652196 buildroot.go:189] setting minikube options for container-runtime

	I0701 12:21:53.903020  652196 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:21:53.903053  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:53.903351  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:53.905929  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.906189  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:53.906216  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:53.906438  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:53.906667  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.906826  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:53.906966  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:53.907119  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:53.907282  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:53.907294  652196 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0701 12:21:54.019474  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0701 12:21:54.019501  652196 buildroot.go:70] root file system type: tmpfs

	I0701 12:21:54.019656  652196 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0701 12:21:54.019681  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:54.022816  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.023184  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:54.023208  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.023371  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:54.023579  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.023787  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.023946  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:54.024146  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:54.024319  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:54.024384  652196 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment="NO_PROXY=192.168.39.16"

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0701 12:21:54.147740  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment=NO_PROXY=192.168.39.16

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0701 12:21:54.147778  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:54.150547  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.151173  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:54.151208  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:54.151345  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:54.151561  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.151771  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:54.151918  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:54.152095  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:54.152266  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:54.152281  652196 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0701 12:21:56.028628  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0701 12:21:56.028682  652196 machine.go:97] duration metric: took 2.834118436s to provisionDockerMachine

	I0701 12:21:56.028701  652196 start.go:293] postStartSetup for "ha-735960-m02" (driver="kvm2")

	I0701 12:21:56.028716  652196 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0701 12:21:56.028738  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.029099  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0701 12:21:56.029132  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.031882  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.032264  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.032289  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.032433  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.032608  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.032817  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.032971  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:56.117309  652196 ssh_runner.go:195] Run: cat /etc/os-release

	I0701 12:21:56.121231  652196 info.go:137] Remote host: Buildroot 2023.02.9

	I0701 12:21:56.121263  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/addons for local assets ...

	I0701 12:21:56.121324  652196 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/files for local assets ...

	I0701 12:21:56.121391  652196 filesync.go:149] local asset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> 6378542.pem in /etc/ssl/certs

	I0701 12:21:56.121402  652196 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /etc/ssl/certs/6378542.pem

	I0701 12:21:56.121478  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0701 12:21:56.130302  652196 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:21:56.152776  652196 start.go:296] duration metric: took 124.058691ms for postStartSetup

	I0701 12:21:56.152821  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.153142  652196 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup

	I0701 12:21:56.153170  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.155689  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.156094  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.156120  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.156332  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.156555  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.156727  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.156917  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:56.240391  652196 machine.go:198] restoring vm config from /var/lib/minikube/backup: [etc]

	I0701 12:21:56.240454  652196 ssh_runner.go:195] Run: sudo rsync --archive --update /var/lib/minikube/backup/etc /

	I0701 12:21:56.280843  652196 fix.go:56] duration metric: took 18.651393475s for fixHost

	I0701 12:21:56.280895  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.283268  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.283590  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.283617  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.283860  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.284107  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.284307  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.284501  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.284686  652196 main.go:141] libmachine: Using SSH client type: native

	I0701 12:21:56.284888  652196 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:21:56.284903  652196 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0701 12:21:56.398873  652196 main.go:141] libmachine: SSH cmd err, output: <nil>: 1719836516.359963406

	I0701 12:21:56.398893  652196 fix.go:216] guest clock: 1719836516.359963406

	I0701 12:21:56.398901  652196 fix.go:229] Guest: 2024-07-01 12:21:56.359963406 +0000 UTC Remote: 2024-07-01 12:21:56.280872467 +0000 UTC m=+42.319261894 (delta=79.090939ms)

	I0701 12:21:56.398919  652196 fix.go:200] guest clock delta is within tolerance: 79.090939ms

	I0701 12:21:56.398924  652196 start.go:83] releasing machines lock for "ha-735960-m02", held for 18.769503298s

	I0701 12:21:56.398940  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.399198  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:21:56.401982  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.402404  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.402436  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.404680  652196 out.go:177] * Found network options:

	I0701 12:21:56.406167  652196 out.go:177]   - NO_PROXY=192.168.39.16

	W0701 12:21:56.407620  652196 proxy.go:119] fail to check proxy env: Error ip not in block

	I0701 12:21:56.407664  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.408285  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.408498  652196 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:21:56.408606  652196 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0701 12:21:56.408647  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	W0701 12:21:56.408741  652196 proxy.go:119] fail to check proxy env: Error ip not in block

	I0701 12:21:56.408826  652196 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I0701 12:21:56.408849  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:21:56.411170  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.411559  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.411598  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.411651  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.411933  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.412130  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.412221  652196 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:21:47 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:21:56.412247  652196 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:21:56.412295  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.412519  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:21:56.412508  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:21:56.412720  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:21:56.412871  652196 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:21:56.412987  652196 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	W0701 12:21:56.492511  652196 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0701 12:21:56.492595  652196 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0701 12:21:56.515270  652196 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0701 12:21:56.515305  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:56.515419  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:56.549004  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0701 12:21:56.560711  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0701 12:21:56.578763  652196 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0701 12:21:56.578832  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0701 12:21:56.589742  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:56.606645  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0701 12:21:56.620036  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:21:56.632033  652196 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0701 12:21:56.642458  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0701 12:21:56.653078  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0701 12:21:56.663035  652196 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0701 12:21:56.673203  652196 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0701 12:21:56.682348  652196 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0701 12:21:56.691388  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:56.798709  652196 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0701 12:21:56.821386  652196 start.go:494] detecting cgroup driver to use...

	I0701 12:21:56.821493  652196 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0701 12:21:56.841303  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:56.857934  652196 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0701 12:21:56.877318  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:21:56.889777  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:56.901844  652196 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0701 12:21:56.927595  652196 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:21:56.940849  652196 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:21:56.958116  652196 ssh_runner.go:195] Run: which cri-dockerd

	I0701 12:21:56.961664  652196 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0701 12:21:56.969985  652196 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0701 12:21:56.985048  652196 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0701 12:21:57.096072  652196 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0701 12:21:57.211289  652196 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0701 12:21:57.211354  652196 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0701 12:21:57.227069  652196 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:21:57.341292  652196 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0701 12:22:58.423195  652196 ssh_runner.go:235] Completed: sudo systemctl restart docker: (1m1.08185799s)

	I0701 12:22:58.423268  652196 ssh_runner.go:195] Run: sudo journalctl --no-pager -u docker

	I0701 12:22:58.444321  652196 out.go:177] 

	W0701 12:22:58.445678  652196 out.go:239] X Exiting due to RUNTIME_ENABLE: Failed to enable container runtime: sudo systemctl restart docker: Process exited with status 1

	stdout:

	stderr:

	Job for docker.service failed because the control process exited with error code.

	See "systemctl status docker.service" and "journalctl -xeu docker.service" for details.

	sudo journalctl --no-pager -u docker:

	-- stdout --

	Jul 01 12:21:54 ha-735960-m02 systemd[1]: Starting Docker Application Container Engine...

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.524329635Z" level=info msg="Starting up"

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.525054987Z" level=info msg="containerd not running, starting managed containerd"

	Jul 01 12:21:54 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:54.525787354Z" level=info msg="started new containerd process" address=/var/run/docker/containerd/containerd.sock module=libcontainerd pid=513

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.553695593Z" level=info msg="starting containerd" revision=ae71819c4f5e67bb4d5ae76a6b735f29cc25774e version=v1.7.18

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572290393Z" level=info msg="loading plugin \"io.containerd.event.v1.exchange\"..." type=io.containerd.event.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572432449Z" level=info msg="loading plugin \"io.containerd.internal.v1.opt\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572518940Z" level=info msg="loading plugin \"io.containerd.warning.v1.deprecations\"..." type=io.containerd.warning.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572558429Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.572981597Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.blockfile\"..." error="no scratch file generator: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573093539Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573355911Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.btrfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs filesystem to be used with the btrfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573425452Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.devmapper\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573469593Z" level=warning msg="failed to load plugin io.containerd.snapshotter.v1.devmapper" error="devmapper not configured"

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573505057Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.native\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.573782642Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.overlayfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.574848351Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.aufs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.576951334Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.aufs\"..." error="aufs is not supported (modprobe aufs failed: exit status 1 \"modprobe: FATAL: Module aufs not found in directory /lib/modules/5.10.207\\n\"): skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577031827Z" level=info msg="loading plugin \"io.containerd.snapshotter.v1.zfs\"..." type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577253828Z" level=info msg="skip loading plugin \"io.containerd.snapshotter.v1.zfs\"..." error="path /var/lib/docker/containerd/daemon/io.containerd.snapshotter.v1.zfs must be a zfs filesystem to be used with the zfs snapshotter: skip plugin" type=io.containerd.snapshotter.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577304329Z" level=info msg="loading plugin \"io.containerd.content.v1.content\"..." type=io.containerd.content.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577551634Z" level=info msg="loading plugin \"io.containerd.metadata.v1.bolt\"..." type=io.containerd.metadata.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577624370Z" level=warning msg="could not use snapshotter devmapper in metadata plugin" error="devmapper not configured"

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.577665230Z" level=info msg="metadata content store policy set" policy=shared

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.580979416Z" level=info msg="loading plugin \"io.containerd.gc.v1.scheduler\"..." type=io.containerd.gc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581128476Z" level=info msg="loading plugin \"io.containerd.differ.v1.walking\"..." type=io.containerd.differ.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581284824Z" level=info msg="loading plugin \"io.containerd.lease.v1.manager\"..." type=io.containerd.lease.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581371031Z" level=info msg="loading plugin \"io.containerd.streaming.v1.manager\"..." type=io.containerd.streaming.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581432559Z" level=info msg="loading plugin \"io.containerd.runtime.v1.linux\"..." type=io.containerd.runtime.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581524784Z" level=info msg="loading plugin \"io.containerd.monitor.v1.cgroups\"..." type=io.containerd.monitor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.581996275Z" level=info msg="loading plugin \"io.containerd.runtime.v2.task\"..." type=io.containerd.runtime.v2

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582118070Z" level=info msg="loading plugin \"io.containerd.runtime.v2.shim\"..." type=io.containerd.runtime.v2

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582162131Z" level=info msg="loading plugin \"io.containerd.sandbox.store.v1.local\"..." type=io.containerd.sandbox.store.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582245548Z" level=info msg="loading plugin \"io.containerd.sandbox.controller.v1.local\"..." type=io.containerd.sandbox.controller.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582319648Z" level=info msg="loading plugin \"io.containerd.service.v1.containers-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582368655Z" level=info msg="loading plugin \"io.containerd.service.v1.content-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582407448Z" level=info msg="loading plugin \"io.containerd.service.v1.diff-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582445279Z" level=info msg="loading plugin \"io.containerd.service.v1.images-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582484550Z" level=info msg="loading plugin \"io.containerd.service.v1.introspection-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582521928Z" level=info msg="loading plugin \"io.containerd.service.v1.namespaces-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582558472Z" level=info msg="loading plugin \"io.containerd.service.v1.snapshots-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582601035Z" level=info msg="loading plugin \"io.containerd.service.v1.tasks-service\"..." type=io.containerd.service.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582656126Z" level=info msg="loading plugin \"io.containerd.grpc.v1.containers\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582693985Z" level=info msg="loading plugin \"io.containerd.grpc.v1.content\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582741537Z" level=info msg="loading plugin \"io.containerd.grpc.v1.diff\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582779033Z" level=info msg="loading plugin \"io.containerd.grpc.v1.events\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582815513Z" level=info msg="loading plugin \"io.containerd.grpc.v1.images\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582853076Z" level=info msg="loading plugin \"io.containerd.grpc.v1.introspection\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582892671Z" level=info msg="loading plugin \"io.containerd.grpc.v1.leases\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582938669Z" level=info msg="loading plugin \"io.containerd.grpc.v1.namespaces\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.582980248Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandbox-controllers\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583032987Z" level=info msg="loading plugin \"io.containerd.grpc.v1.sandboxes\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583083364Z" level=info msg="loading plugin \"io.containerd.grpc.v1.snapshots\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583122445Z" level=info msg="loading plugin \"io.containerd.grpc.v1.streaming\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583161506Z" level=info msg="loading plugin \"io.containerd.grpc.v1.tasks\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583262727Z" level=info msg="loading plugin \"io.containerd.transfer.v1.local\"..." type=io.containerd.transfer.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583333396Z" level=info msg="loading plugin \"io.containerd.grpc.v1.transfer\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583373579Z" level=info msg="loading plugin \"io.containerd.grpc.v1.version\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583414811Z" level=info msg="loading plugin \"io.containerd.internal.v1.restart\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583520612Z" level=info msg="loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." type=io.containerd.tracing.processor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583751718Z" level=info msg="skip loading plugin \"io.containerd.tracing.processor.v1.otlp\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.tracing.processor.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583800626Z" level=info msg="loading plugin \"io.containerd.internal.v1.tracing\"..." type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583838317Z" level=info msg="skip loading plugin \"io.containerd.internal.v1.tracing\"..." error="skip plugin: tracing endpoint not configured" type=io.containerd.internal.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583874340Z" level=info msg="loading plugin \"io.containerd.grpc.v1.healthcheck\"..." type=io.containerd.grpc.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583912430Z" level=info msg="loading plugin \"io.containerd.nri.v1.nri\"..." type=io.containerd.nri.v1

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.583991424Z" level=info msg="NRI interface is disabled by configuration."

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584364167Z" level=info msg=serving... address=/var/run/docker/containerd/containerd-debug.sock

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584467963Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock.ttrpc

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584654486Z" level=info msg=serving... address=/var/run/docker/containerd/containerd.sock

	Jul 01 12:21:54 ha-735960-m02 dockerd[513]: time="2024-07-01T12:21:54.584785754Z" level=info msg="containerd successfully booted in 0.032655s"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.555699119Z" level=info msg="[graphdriver] trying configured driver: overlay2"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.620790434Z" level=info msg="Loading containers: start."

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.813021303Z" level=warning msg="ip6tables is enabled, but cannot set up ip6tables chains" error="failed to create NAT chain DOCKER: iptables failed: ip6tables --wait -t nat -N DOCKER: ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)\nPerhaps ip6tables or your kernel needs to be upgraded.\n (exit status 3)"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.888534738Z" level=info msg="Default bridge (docker0) is assigned with an IP address 172.17.0.0/16. Daemon option --bip can be used to set a preferred IP address"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.940299653Z" level=info msg="Loading containers: done."

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.956534314Z" level=info msg="Docker daemon" commit=ff1e2c0 containerd-snapshotter=false storage-driver=overlay2 version=27.0.1

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.956851438Z" level=info msg="Daemon has completed initialization"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.988054435Z" level=info msg="API listen on /var/run/docker.sock"

	Jul 01 12:21:55 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:55.988129188Z" level=info msg="API listen on [::]:2376"

	Jul 01 12:21:55 ha-735960-m02 systemd[1]: Started Docker Application Container Engine.

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.316115209Z" level=info msg="Processing signal 'terminated'"

	Jul 01 12:21:57 ha-735960-m02 systemd[1]: Stopping Docker Application Container Engine...

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317321834Z" level=info msg="stopping event stream following graceful shutdown" error="<nil>" module=libcontainerd namespace=moby

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317386191Z" level=info msg="Daemon shutdown complete"

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317447382Z" level=info msg="stopping event stream following graceful shutdown" error="context canceled" module=libcontainerd namespace=plugins.moby

	Jul 01 12:21:57 ha-735960-m02 dockerd[506]: time="2024-07-01T12:21:57.317464543Z" level=info msg="stopping healthcheck following graceful shutdown" module=libcontainerd

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: docker.service: Deactivated successfully.

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: Stopped Docker Application Container Engine.

	Jul 01 12:21:58 ha-735960-m02 systemd[1]: Starting Docker Application Container Engine...

	Jul 01 12:21:58 ha-735960-m02 dockerd[1188]: time="2024-07-01T12:21:58.364754006Z" level=info msg="Starting up"

	Jul 01 12:22:58 ha-735960-m02 dockerd[1188]: failed to start daemon: failed to dial "/run/containerd/containerd.sock": failed to dial "/run/containerd/containerd.sock": context deadline exceeded

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: docker.service: Main process exited, code=exited, status=1/FAILURE

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: docker.service: Failed with result 'exit-code'.

	Jul 01 12:22:58 ha-735960-m02 systemd[1]: Failed to start Docker Application Container Engine.

	-- /stdout --

	W0701 12:22:58.445741  652196 out.go:239] * 

	W0701 12:22:58.447325  652196 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮

	│                                                                                             │

	│    * If the above advice does not help, please let us know:                                 │

	│      https://github.com/kubernetes/minikube/issues/new/choose                               │

	│                                                                                             │

	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │

	│                                                                                             │

	╰─────────────────────────────────────────────────────────────────────────────────────────────╯

	I0701 12:22:58.449434  652196 out.go:177] 

	==> Docker <==

	Jul 01 12:21:44 ha-735960 dockerd[1190]: time="2024-07-01T12:21:44.208507474Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:05 ha-735960 dockerd[1184]: time="2024-07-01T12:22:05.425890009Z" level=info msg="ignoring event" container=d97b6df80577316a9cf70b2af0f8d52bb2bd7071ff932a8f1f03df9497724786 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Jul 01 12:22:05 ha-735960 dockerd[1190]: time="2024-07-01T12:22:05.426406022Z" level=info msg="shim disconnected" id=d97b6df80577316a9cf70b2af0f8d52bb2bd7071ff932a8f1f03df9497724786 namespace=moby

	Jul 01 12:22:05 ha-735960 dockerd[1190]: time="2024-07-01T12:22:05.427162251Z" level=warning msg="cleaning up after shim disconnected" id=d97b6df80577316a9cf70b2af0f8d52bb2bd7071ff932a8f1f03df9497724786 namespace=moby

	Jul 01 12:22:05 ha-735960 dockerd[1190]: time="2024-07-01T12:22:05.427275716Z" level=info msg="cleaning up dead shim" namespace=moby

	Jul 01 12:22:06 ha-735960 dockerd[1190]: time="2024-07-01T12:22:06.439101176Z" level=info msg="shim disconnected" id=ad4259a9c8ee03ff4c6910c68c5c866481fede150d57267cdc957e46aca4ef80 namespace=moby

	Jul 01 12:22:06 ha-735960 dockerd[1184]: time="2024-07-01T12:22:06.441768147Z" level=info msg="ignoring event" container=ad4259a9c8ee03ff4c6910c68c5c866481fede150d57267cdc957e46aca4ef80 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Jul 01 12:22:06 ha-735960 dockerd[1190]: time="2024-07-01T12:22:06.442054407Z" level=warning msg="cleaning up after shim disconnected" id=ad4259a9c8ee03ff4c6910c68c5c866481fede150d57267cdc957e46aca4ef80 namespace=moby

	Jul 01 12:22:06 ha-735960 dockerd[1190]: time="2024-07-01T12:22:06.442214156Z" level=info msg="cleaning up dead shim" namespace=moby

	Jul 01 12:22:24 ha-735960 dockerd[1190]: time="2024-07-01T12:22:24.071877635Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jul 01 12:22:24 ha-735960 dockerd[1190]: time="2024-07-01T12:22:24.072398316Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jul 01 12:22:24 ha-735960 dockerd[1190]: time="2024-07-01T12:22:24.072506177Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:24 ha-735960 dockerd[1190]: time="2024-07-01T12:22:24.072761669Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:27 ha-735960 dockerd[1190]: time="2024-07-01T12:22:27.091757274Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jul 01 12:22:27 ha-735960 dockerd[1190]: time="2024-07-01T12:22:27.091819785Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jul 01 12:22:27 ha-735960 dockerd[1190]: time="2024-07-01T12:22:27.091834055Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:27 ha-735960 dockerd[1190]: time="2024-07-01T12:22:27.092367194Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:22:47 ha-735960 dockerd[1184]: time="2024-07-01T12:22:47.577930706Z" level=info msg="ignoring event" container=e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30 module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Jul 01 12:22:47 ha-735960 dockerd[1190]: time="2024-07-01T12:22:47.578670317Z" level=info msg="shim disconnected" id=e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30 namespace=moby

	Jul 01 12:22:47 ha-735960 dockerd[1190]: time="2024-07-01T12:22:47.578983718Z" level=warning msg="cleaning up after shim disconnected" id=e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30 namespace=moby

	Jul 01 12:22:47 ha-735960 dockerd[1190]: time="2024-07-01T12:22:47.579585559Z" level=info msg="cleaning up dead shim" namespace=moby

	Jul 01 12:22:48 ha-735960 dockerd[1184]: time="2024-07-01T12:22:48.582829662Z" level=info msg="ignoring event" container=829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d module=libcontainerd namespace=moby topic=/tasks/delete type="*events.TaskDelete"

	Jul 01 12:22:48 ha-735960 dockerd[1190]: time="2024-07-01T12:22:48.583282892Z" level=info msg="shim disconnected" id=829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d namespace=moby

	Jul 01 12:22:48 ha-735960 dockerd[1190]: time="2024-07-01T12:22:48.584157023Z" level=warning msg="cleaning up after shim disconnected" id=829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d namespace=moby

	Jul 01 12:22:48 ha-735960 dockerd[1190]: time="2024-07-01T12:22:48.584285564Z" level=info msg="cleaning up dead shim" namespace=moby

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED              STATE               NAME                      ATTEMPT             POD ID              POD

	e546c39248bc8       56ce0fd9fb532                                                                                         35 seconds ago       Exited              kube-apiserver            2                   16dae930b4edb       kube-apiserver-ha-735960

	829fe19c75ce3       e874818b3caac                                                                                         38 seconds ago       Exited              kube-controller-manager   2                   5e2a9b91be69c       kube-controller-manager-ha-735960

	cecb3dd12e16e       38af8ddebf499                                                                                         About a minute ago   Running             kube-vip                  0                   8d1562fb4b8c3       kube-vip-ha-735960

	6a200a6b49020       3861cfcd7c04c                                                                                         About a minute ago   Running             etcd                      1                   5b1097d48d724       etcd-ha-735960

	2d71437c5f06d       7820c83aa1394                                                                                         About a minute ago   Running             kube-scheduler            1                   fa7dea6a1b8bd       kube-scheduler-ha-735960

	14112a4d8f2cb       38af8ddebf499                                                                                         2 minutes ago        Exited              kube-vip                  1                   46ab74fdab7e2       kube-vip-ha-735960

	1ef6d9da6a9c5       gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12   4 minutes ago        Exited              busybox                   0                   1f5ccc7b0e655       busybox-fc5497c4f-pjfcw

	a9c30cd4b3455       cbb01a7bd410d                                                                                         6 minutes ago        Exited              coredns                   0                   7b4b4f7ec4b63       coredns-7db6d8ff4d-nk4lf

	769b0b8751350       cbb01a7bd410d                                                                                         6 minutes ago        Exited              coredns                   0                   7a349370d4f88       coredns-7db6d8ff4d-p4rtz

	97d58c94f3fdc       6e38f40d628db                                                                                         6 minutes ago        Exited              storage-provisioner       0                   9226633ad878a       storage-provisioner

	f472aef5302fd       kindest/kindnetd@sha256:9c2b5fcda3cb5a9725ecb893f3c8998a92d51a87465a886eb563e18d649383a8              6 minutes ago        Exited              kindnet-cni               0                   ab9c74a502295       kindnet-7f6hm

	6116abe6039dc       53c535741fb44                                                                                         6 minutes ago        Exited              kube-proxy                0                   da69191059798       kube-proxy-lphzn

	cb63d54411807       7820c83aa1394                                                                                         7 minutes ago        Exited              kube-scheduler            0                   19b6b0e6ed64e       kube-scheduler-ha-735960

	24c8926d2b31d       3861cfcd7c04c                                                                                         7 minutes ago        Exited              etcd                      0                   d3b914e19ca22       etcd-ha-735960

	==> coredns [769b0b875135] <==

	[INFO] 10.244.1.2:44221 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 60 0.000082797s

	[INFO] 10.244.2.2:33797 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000157729s

	[INFO] 10.244.2.2:52590 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.004055351s

	[INFO] 10.244.2.2:46983 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.003253494s

	[INFO] 10.244.2.2:56187 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000205215s

	[INFO] 10.244.2.2:41086 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000158307s

	[INFO] 10.244.0.4:47783 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000097077s

	[INFO] 10.244.0.4:50743 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.0001523s

	[INFO] 10.244.0.4:37141 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000138763s

	[INFO] 10.244.1.2:32981 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000132906s

	[INFO] 10.244.1.2:36762 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001646552s

	[INFO] 10.244.1.2:33583 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000072434s

	[INFO] 10.244.2.2:37027 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000156518s

	[INFO] 10.244.2.2:58435 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000104504s

	[INFO] 10.244.2.2:36107 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000090251s

	[INFO] 10.244.0.4:44792 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000227164s

	[INFO] 10.244.0.4:56557 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000140925s

	[INFO] 10.244.1.2:38284 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000232717s

	[INFO] 10.244.2.2:37664 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000135198s

	[INFO] 10.244.2.2:60876 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.00032392s

	[INFO] 10.244.1.2:37461 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000133264s

	[INFO] 10.244.1.2:45182 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000117372s

	[INFO] 10.244.1.2:37156 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000240093s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> coredns [a9c30cd4b345] <==

	[INFO] 10.244.0.4:57095 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.002251804s

	[INFO] 10.244.0.4:42381 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000081215s

	[INFO] 10.244.0.4:53499 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00124929s

	[INFO] 10.244.0.4:41287 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000174281s

	[INFO] 10.244.0.4:36433 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000142863s

	[INFO] 10.244.1.2:47688 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130034s

	[INFO] 10.244.1.2:40562 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00183587s

	[INFO] 10.244.1.2:35137 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.0000771s

	[INFO] 10.244.1.2:37798 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000184282s

	[INFO] 10.244.1.2:43876 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00008807s

	[INFO] 10.244.2.2:35039 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000119303s

	[INFO] 10.244.0.4:53229 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000090292s

	[INFO] 10.244.0.4:42097 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.00011308s

	[INFO] 10.244.1.2:42114 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130767s

	[INFO] 10.244.1.2:56638 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000110707s

	[INFO] 10.244.1.2:55805 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000093484s

	[INFO] 10.244.2.2:51675 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000145117s

	[INFO] 10.244.2.2:56838 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000136843s

	[INFO] 10.244.0.4:60951 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000162889s

	[INFO] 10.244.0.4:34776 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000112367s

	[INFO] 10.244.0.4:45397 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000073771s

	[INFO] 10.244.0.4:52372 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000058127s

	[INFO] 10.244.1.2:41033 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000131962s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> describe nodes <==

	command /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig" failed with error: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig": Process exited with status 1

	stdout:

	stderr:

	E0701 12:23:02.942397    2957 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	E0701 12:23:02.942978    2957 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	E0701 12:23:02.944650    2957 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	E0701 12:23:02.945088    2957 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	E0701 12:23:02.946699    2957 memcache.go:265] couldn't get current server API group list: Get "https://localhost:8443/api?timeout=32s": dial tcp 127.0.0.1:8443: connect: connection refused

	The connection to the server localhost:8443 was refused - did you specify the right host or port?

	==> dmesg <==

	[Jul 1 12:21] You have booted with nomodeset. This means your GPU drivers are DISABLED

	[  +0.000001] Any video related functionality will be severely degraded, and you may not even be able to suspend the system properly

	[  +0.000000] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.050877] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.036108] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.421397] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +1.628587] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +2.463440] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000007] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +4.322115] systemd-fstab-generator[476]: Ignoring "noauto" option for root device

	[  +0.057798] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.060958] systemd-fstab-generator[488]: Ignoring "noauto" option for root device

	[  +2.352578] systemd-fstab-generator[1113]: Ignoring "noauto" option for root device

	[  +0.297044] systemd-fstab-generator[1150]: Ignoring "noauto" option for root device

	[  +0.121689] systemd-fstab-generator[1162]: Ignoring "noauto" option for root device

	[  +0.127513] systemd-fstab-generator[1176]: Ignoring "noauto" option for root device

	[  +2.293985] kauditd_printk_skb: 195 callbacks suppressed

	[  +0.325101] systemd-fstab-generator[1411]: Ignoring "noauto" option for root device

	[  +0.108851] systemd-fstab-generator[1423]: Ignoring "noauto" option for root device

	[  +0.138237] systemd-fstab-generator[1435]: Ignoring "noauto" option for root device

	[  +0.156114] systemd-fstab-generator[1450]: Ignoring "noauto" option for root device

	[  +0.494872] systemd-fstab-generator[1603]: Ignoring "noauto" option for root device

	[  +6.977462] kauditd_printk_skb: 176 callbacks suppressed

	[ +11.291301] kauditd_printk_skb: 40 callbacks suppressed

	==> etcd [24c8926d2b31] <==

	{"level":"info","ts":"2024-07-01T12:21:01.297933Z","caller":"traceutil/trace.go:171","msg":"trace[249123960] range","detail":"{range_begin:/registry/leases/; range_end:/registry/leases0; }","duration":"4.106112275s","start":"2024-07-01T12:20:57.191803Z","end":"2024-07-01T12:21:01.297915Z","steps":["trace[249123960] 'agreement among raft nodes before linearized reading'  (duration: 4.10601913s)"],"step_count":1}

	{"level":"warn","ts":"2024-07-01T12:21:01.298006Z","caller":"v3rpc/interceptor.go:197","msg":"request stats","start time":"2024-07-01T12:20:57.191796Z","time spent":"4.106166982s","remote":"127.0.0.1:56240","response type":"/etcdserverpb.KV/Range","request count":0,"request size":40,"response count":0,"response size":0,"request content":"key:\"/registry/leases/\" range_end:\"/registry/leases0\" count_only:true "}

	2024/07/01 12:21:01 WARNING: [core] [Server #8] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	2024/07/01 12:21:01 WARNING: [core] [Server #8] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	2024/07/01 12:21:01 WARNING: [core] [Server #8] grpc: Server.processUnaryRPC failed to write status: connection error: desc = "transport is closing"

	{"level":"warn","ts":"2024-07-01T12:21:01.381902Z","caller":"embed/serve.go:212","msg":"stopping secure grpc server due to error","error":"accept tcp 192.168.39.16:2379: use of closed network connection"}

	{"level":"warn","ts":"2024-07-01T12:21:01.38194Z","caller":"embed/serve.go:214","msg":"stopped secure grpc server due to error","error":"accept tcp 192.168.39.16:2379: use of closed network connection"}

	{"level":"info","ts":"2024-07-01T12:21:01.38203Z","caller":"etcdserver/server.go:1462","msg":"skipped leadership transfer; local server is not leader","local-member-id":"b6c76b3131c1024","current-leader-member-id":"0"}

	{"level":"info","ts":"2024-07-01T12:21:01.382382Z","caller":"rafthttp/peer.go:330","msg":"stopping remote peer","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382398Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.38247Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream Message","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382583Z","caller":"rafthttp/pipeline.go:85","msg":"stopped HTTP pipelining with remote peer","local-member-id":"b6c76b3131c1024","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382685Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"b6c76b3131c1024","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382809Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream Message","local-member-id":"b6c76b3131c1024","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382826Z","caller":"rafthttp/peer.go:335","msg":"stopped remote peer","remote-peer-id":"c77bbbee62c21090"}

	{"level":"info","ts":"2024-07-01T12:21:01.382832Z","caller":"rafthttp/peer.go:330","msg":"stopping remote peer","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.382882Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.3829Z","caller":"rafthttp/stream.go:294","msg":"stopped TCP streaming connection with remote peer","stream-writer-type":"stream Message","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.385706Z","caller":"rafthttp/pipeline.go:85","msg":"stopped HTTP pipelining with remote peer","local-member-id":"b6c76b3131c1024","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.385804Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"b6c76b3131c1024","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.385838Z","caller":"rafthttp/stream.go:442","msg":"stopped stream reader with remote peer","stream-reader-type":"stream Message","local-member-id":"b6c76b3131c1024","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.385849Z","caller":"rafthttp/peer.go:335","msg":"stopped remote peer","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:21:01.406065Z","caller":"embed/etcd.go:579","msg":"stopping serving peer traffic","address":"192.168.39.16:2380"}

	{"level":"info","ts":"2024-07-01T12:21:01.406193Z","caller":"embed/etcd.go:584","msg":"stopped serving peer traffic","address":"192.168.39.16:2380"}

	{"level":"info","ts":"2024-07-01T12:21:01.406214Z","caller":"embed/etcd.go:377","msg":"closed etcd server","name":"ha-735960","data-dir":"/var/lib/minikube/etcd","advertise-peer-urls":["https://192.168.39.16:2380"],"advertise-client-urls":["https://192.168.39.16:2379"]}

	==> etcd [6a200a6b4902] <==

	{"level":"info","ts":"2024-07-01T12:22:57.488845Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:57.488894Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:57.488907Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:57.488922Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:57.488929Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888088Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888193Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888234Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888281Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:22:58.888295Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	{"level":"warn","ts":"2024-07-01T12:22:59.811118Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"c77bbbee62c21090","rtt":"0s","error":"dial tcp 192.168.39.86:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:22:59.811186Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"c77bbbee62c21090","rtt":"0s","error":"dial tcp 192.168.39.86:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:22:59.827782Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: connect: no route to host"}

	{"level":"warn","ts":"2024-07-01T12:22:59.82782Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: connect: no route to host"}

	{"level":"info","ts":"2024-07-01T12:23:00.288491Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:00.288559Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:00.288572Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:00.288586Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:00.288593Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:01.688306Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:01.688588Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:01.68866Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:01.688697Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:01.688777Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	{"level":"warn","ts":"2024-07-01T12:23:01.767286Z","caller":"etcdserver/server.go:2089","msg":"failed to publish local member to cluster through raft","local-member-id":"b6c76b3131c1024","local-member-attributes":"{Name:ha-735960 ClientURLs:[https://192.168.39.16:2379]}","request-path":"/0/members/b6c76b3131c1024/attributes","publish-timeout":"7s","error":"etcdserver: request timed out"}

	==> kernel <==

	 12:23:03 up 1 min,  0 users,  load average: 0.13, 0.07, 0.02

	Linux ha-735960 5.10.207 #1 SMP Wed Jun 26 19:37:34 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [f472aef5302f] <==

	I0701 12:20:12.428842       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:20:22.443154       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:20:22.443292       1 main.go:227] handling current node

	I0701 12:20:22.443323       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:20:22.443388       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:20:22.443605       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:20:22.443653       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:20:22.443793       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:20:22.443836       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:20:32.451395       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:20:32.451431       1 main.go:227] handling current node

	I0701 12:20:32.451481       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:20:32.451486       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:20:32.451947       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:20:32.451980       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:20:32.452873       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:20:32.453015       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:20:42.470169       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:20:42.470264       1 main.go:227] handling current node

	I0701 12:20:42.470289       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:20:42.470302       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:20:42.470523       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:20:42.470616       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:20:42.470868       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:20:42.470914       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	==> kube-apiserver [e546c39248bc] <==

	I0701 12:22:27.228496       1 options.go:221] external host was not specified, using 192.168.39.16

	I0701 12:22:27.229584       1 server.go:148] Version: v1.30.2

	I0701 12:22:27.229706       1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0701 12:22:27.544729       1 shared_informer.go:313] Waiting for caches to sync for node_authorizer

	I0701 12:22:27.547846       1 shared_informer.go:313] Waiting for caches to sync for *generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]

	I0701 12:22:27.551600       1 plugins.go:157] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.

	I0701 12:22:27.551634       1 plugins.go:160] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.

	I0701 12:22:27.551982       1 instance.go:299] Using reconciler: lease

	W0701 12:22:47.544372       1 logging.go:59] [core] [Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: authentication handshake failed: context deadline exceeded"

	W0701 12:22:47.544664       1 logging.go:59] [core] [Channel #3 SubChannel #4] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: authentication handshake failed: context canceled"

	F0701 12:22:47.553171       1 instance.go:292] Error creating leases: error creating storage factory: context deadline exceeded

	==> kube-controller-manager [829fe19c75ce] <==

	I0701 12:22:24.521097       1 serving.go:380] Generated self-signed cert in-memory

	I0701 12:22:24.837441       1 controllermanager.go:189] "Starting" version="v1.30.2"

	I0701 12:22:24.837478       1 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0701 12:22:24.839276       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"

	I0701 12:22:24.839470       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"

	I0701 12:22:24.839988       1 secure_serving.go:213] Serving securely on 127.0.0.1:10257

	I0701 12:22:24.840049       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	E0701 12:22:48.561111       1 controllermanager.go:234] "Error building controller context" err="failed to wait for apiserver being healthy: timed out waiting for the condition: failed to get apiserver /healthz status: Get \"https://192.168.39.16:8443/healthz\": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:57228->192.168.39.16:8443: read: connection reset by peer"

	==> kube-proxy [6116abe6039d] <==

	I0701 12:16:09.205590       1 server_linux.go:69] "Using iptables proxy"

	I0701 12:16:09.223098       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.16"]

	I0701 12:16:09.284088       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0701 12:16:09.284134       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0701 12:16:09.284152       1 server_linux.go:165] "Using iptables Proxier"

	I0701 12:16:09.286802       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0701 12:16:09.287240       1 server.go:872] "Version info" version="v1.30.2"

	I0701 12:16:09.287274       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0701 12:16:09.288803       1 config.go:192] "Starting service config controller"

	I0701 12:16:09.288830       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0701 12:16:09.289262       1 config.go:101] "Starting endpoint slice config controller"

	I0701 12:16:09.289283       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0701 12:16:09.290101       1 config.go:319] "Starting node config controller"

	I0701 12:16:09.290125       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0701 12:16:09.389941       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0701 12:16:09.390030       1 shared_informer.go:320] Caches are synced for service config

	I0701 12:16:09.390393       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [2d71437c5f06] <==

	E0701 12:22:48.563438       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://192.168.39.16:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:57242->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563506       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: Get "https://192.168.39.16:8443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59182->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563570       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://192.168.39.16:8443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59182->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563641       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: Get "https://192.168.39.16:8443/api/v1/pods?fieldSelector=status.phase%3DSucceeded%!C(MISSING)status.phase%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59186->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563665       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: Get "https://192.168.39.16:8443/api/v1/pods?fieldSelector=status.phase%3DSucceeded%!C(MISSING)status.phase%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59186->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563724       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: Get "https://192.168.39.16:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59188->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563747       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: Get "https://192.168.39.16:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59188->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563814       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: Get "https://192.168.39.16:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59202->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563830       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: Get "https://192.168.39.16:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59202->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563886       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59238->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563907       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59238->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563967       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59262->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.563982       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59262->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.563997       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59210->192.168.39.16:8443: read: connection reset by peer

	E0701 12:22:48.564229       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:59210->192.168.39.16:8443: read: connection reset by peer

	W0701 12:22:48.669137       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: Get "https://192.168.39.16:8443/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:22:48.669192       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: Get "https://192.168.39.16:8443/api/v1/persistentvolumeclaims?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:22:51.792652       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.16:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:22:51.792757       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.16:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:22:52.248014       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: Get "https://192.168.39.16:8443/apis/apps/v1/replicasets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:22:52.248063       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: Get "https://192.168.39.16:8443/apis/apps/v1/replicasets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:22:55.201032       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://192.168.39.16:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:22:55.201141       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://192.168.39.16:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:23:02.474045       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: Get "https://192.168.39.16:8443/apis/apps/v1/statefulsets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:23:02.474098       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: Get "https://192.168.39.16:8443/apis/apps/v1/statefulsets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	==> kube-scheduler [cb63d5441180] <==

	W0701 12:15:50.916180       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0701 12:15:50.916379       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	W0701 12:15:51.752711       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	E0701 12:15:51.752853       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: statefulsets.apps is forbidden: User "system:kube-scheduler" cannot list resource "statefulsets" in API group "apps" at the cluster scope

	W0701 12:15:51.794007       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	E0701 12:15:51.794055       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: pods is forbidden: User "system:kube-scheduler" cannot list resource "pods" in API group "" at the cluster scope

	W0701 12:15:51.931391       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	E0701 12:15:51.931434       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: csistoragecapacities.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csistoragecapacities" in API group "storage.k8s.io" at the cluster scope

	W0701 12:15:51.950120       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	E0701 12:15:51.950162       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: replicationcontrollers is forbidden: User "system:kube-scheduler" cannot list resource "replicationcontrollers" in API group "" at the cluster scope

	W0701 12:15:51.968922       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0701 12:15:51.969125       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0701 12:15:51.985991       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	E0701 12:15:51.986032       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: configmaps "extension-apiserver-authentication" is forbidden: User "system:kube-scheduler" cannot list resource "configmaps" in API group "" in the namespace "kube-system"

	W0701 12:15:52.054298       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	E0701 12:15:52.054329       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolumeClaim: failed to list *v1.PersistentVolumeClaim: persistentvolumeclaims is forbidden: User "system:kube-scheduler" cannot list resource "persistentvolumeclaims" in API group "" at the cluster scope

	W0701 12:15:52.260873       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	E0701 12:15:52.260979       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: csinodes.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "csinodes" in API group "storage.k8s.io" at the cluster scope

	I0701 12:15:54.206866       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	E0701 12:19:09.710917       1 framework.go:1286] "Plugin Failed" err="Operation cannot be fulfilled on pods/binding \"kube-proxy-xv95g\": pod kube-proxy-xv95g is already assigned to node \"ha-735960-m04\"" plugin="DefaultBinder" pod="kube-system/kube-proxy-xv95g" node="ha-735960-m04"

	E0701 12:19:09.713930       1 schedule_one.go:1046] "Error scheduling pod; retrying" err="running Bind plugin \"DefaultBinder\": Operation cannot be fulfilled on pods/binding \"kube-proxy-xv95g\": pod kube-proxy-xv95g is already assigned to node \"ha-735960-m04\"" pod="kube-system/kube-proxy-xv95g"

	I0701 12:21:01.200143       1 secure_serving.go:258] Stopped listening on 127.0.0.1:10259

	I0701 12:21:01.200254       1 tlsconfig.go:255] "Shutting down DynamicServingCertificateController"

	I0701 12:21:01.200659       1 configmap_cafile_content.go:223] "Shutting down controller" name="client-ca::kube-system::extension-apiserver-authentication::client-ca-file"

	E0701 12:21:01.212693       1 run.go:74] "command failed" err="finished without leader elect"

	==> kubelet <==

	Jul 01 12:22:49 ha-735960 kubelet[1610]: E0701 12:22:49.182112    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-ha-735960_kube-system(9a545edc3c0d885e2370d3a24ff8ac4b)\"" pod="kube-system/kube-controller-manager-ha-735960" podUID="9a545edc3c0d885e2370d3a24ff8ac4b"

	Jul 01 12:22:50 ha-735960 kubelet[1610]: I0701 12:22:50.089167    1610 scope.go:117] "RemoveContainer" containerID="e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30"

	Jul 01 12:22:50 ha-735960 kubelet[1610]: E0701 12:22:50.089722    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver pod=kube-apiserver-ha-735960_kube-system(858bfcad8b1d02b8cdc3dc83c4af060c)\"" pod="kube-system/kube-apiserver-ha-735960" podUID="858bfcad8b1d02b8cdc3dc83c4af060c"

	Jul 01 12:22:50 ha-735960 kubelet[1610]: I0701 12:22:50.202365    1610 scope.go:117] "RemoveContainer" containerID="829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d"

	Jul 01 12:22:50 ha-735960 kubelet[1610]: E0701 12:22:50.202700    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-ha-735960_kube-system(9a545edc3c0d885e2370d3a24ff8ac4b)\"" pod="kube-system/kube-controller-manager-ha-735960" podUID="9a545edc3c0d885e2370d3a24ff8ac4b"

	Jul 01 12:22:51 ha-735960 kubelet[1610]: I0701 12:22:51.209935    1610 scope.go:117] "RemoveContainer" containerID="829fe19c75ce30a13d3a4e33a2e2a760477739dbe6f611f1b4e60d69d0444f4d"

	Jul 01 12:22:51 ha-735960 kubelet[1610]: E0701 12:22:51.210647    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-controller-manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-controller-manager pod=kube-controller-manager-ha-735960_kube-system(9a545edc3c0d885e2370d3a24ff8ac4b)\"" pod="kube-system/kube-controller-manager-ha-735960" podUID="9a545edc3c0d885e2370d3a24ff8ac4b"

	Jul 01 12:22:51 ha-735960 kubelet[1610]: I0701 12:22:51.576067    1610 kubelet_node_status.go:73] "Attempting to register node" node="ha-735960"

	Jul 01 12:22:53 ha-735960 kubelet[1610]: I0701 12:22:53.728933    1610 scope.go:117] "RemoveContainer" containerID="e546c39248bc8ab525701bacc0a354650e0da853981a4624abd25fdba1c1ca30"

	Jul 01 12:22:53 ha-735960 kubelet[1610]: E0701 12:22:53.729329    1610 pod_workers.go:1298] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-apiserver\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-apiserver pod=kube-apiserver-ha-735960_kube-system(858bfcad8b1d02b8cdc3dc83c4af060c)\"" pod="kube-system/kube-apiserver-ha-735960" podUID="858bfcad8b1d02b8cdc3dc83c4af060c"

	Jul 01 12:22:53 ha-735960 kubelet[1610]: E0701 12:22:53.789831    1610 kubelet_node_status.go:96] "Unable to register node with API server" err="Post \"https://control-plane.minikube.internal:8443/api/v1/nodes\": dial tcp 192.168.39.254:8443: connect: no route to host" node="ha-735960"

	Jul 01 12:22:53 ha-735960 kubelet[1610]: E0701 12:22:53.790000    1610 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ha-735960?timeout=10s\": dial tcp 192.168.39.254:8443: connect: no route to host" interval="7s"

	Jul 01 12:22:56 ha-735960 kubelet[1610]: W0701 12:22:56.862031    1610 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: Get "https://control-plane.minikube.internal:8443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:22:56 ha-735960 kubelet[1610]: E0701 12:22:56.862122    1610 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: Get "https://control-plane.minikube.internal:8443/apis/node.k8s.io/v1/runtimeclasses?limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:22:57 ha-735960 kubelet[1610]: E0701 12:22:57.094040    1610 eviction_manager.go:282] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ha-735960\" not found"

	Jul 01 12:22:59 ha-735960 kubelet[1610]: W0701 12:22:59.934973    1610 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:22:59 ha-735960 kubelet[1610]: E0701 12:22:59.935046    1610 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://control-plane.minikube.internal:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:22:59 ha-735960 kubelet[1610]: W0701 12:22:59.935096    1610 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-735960&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:22:59 ha-735960 kubelet[1610]: E0701 12:22:59.935120    1610 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://control-plane.minikube.internal:8443/api/v1/nodes?fieldSelector=metadata.name%!D(MISSING)ha-735960&limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:22:59 ha-735960 kubelet[1610]: E0701 12:22:59.935170    1610 event.go:368] "Unable to write event (may retry after sleeping)" err="Post \"https://control-plane.minikube.internal:8443/api/v1/namespaces/default/events\": dial tcp 192.168.39.254:8443: connect: no route to host" event="&Event{ObjectMeta:{ha-735960.17de162e90ad8f5f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ha-735960,UID:ha-735960,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ha-735960,},FirstTimestamp:2024-07-01 12:21:36.953708383 +0000 UTC m=+0.183371310,LastTimestamp:2024-07-01 12:21:36.953708383 +0000 UTC m=+0.183371310,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ha-735960,}"

	Jul 01 12:23:00 ha-735960 kubelet[1610]: I0701 12:23:00.791239    1610 kubelet_node_status.go:73] "Attempting to register node" node="ha-735960"

	Jul 01 12:23:03 ha-735960 kubelet[1610]: W0701 12:23:03.006011    1610 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://control-plane.minikube.internal:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:23:03 ha-735960 kubelet[1610]: E0701 12:23:03.006051    1610 kubelet_node_status.go:96] "Unable to register node with API server" err="Post \"https://control-plane.minikube.internal:8443/api/v1/nodes\": dial tcp 192.168.39.254:8443: connect: no route to host" node="ha-735960"

	Jul 01 12:23:03 ha-735960 kubelet[1610]: E0701 12:23:03.006090    1610 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://control-plane.minikube.internal:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.254:8443: connect: no route to host

	Jul 01 12:23:03 ha-735960 kubelet[1610]: E0701 12:23:03.006162    1610 controller.go:145] "Failed to ensure lease exists, will retry" err="Get \"https://control-plane.minikube.internal:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ha-735960?timeout=10s\": dial tcp 192.168.39.254:8443: connect: no route to host" interval="7s"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-735960 -n ha-735960

helpers_test.go:254: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-735960 -n ha-735960: exit status 2 (230.835771ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:254: status error: exit status 2 (may be ok)

helpers_test.go:256: "ha-735960" apiserver is not running, skipping kubectl commands (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/DegradedAfterSecondaryNodeDelete (1.68s)

=== RUN   TestMultiControlPlane/serial/StopCluster

ha_test.go:531: (dbg) Run:  out/minikube-linux-amd64 -p ha-735960 stop -v=7 --alsologtostderr

E0701 12:23:22.863651  637854 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/addons-877411/client.crt: no such file or directory

ha_test.go:531: (dbg) Done: out/minikube-linux-amd64 -p ha-735960 stop -v=7 --alsologtostderr: (58.805260324s)

ha_test.go:537: (dbg) Run:  out/minikube-linux-amd64 -p ha-735960 status -v=7 --alsologtostderr

ha_test.go:537: (dbg) Non-zero exit: out/minikube-linux-amd64 -p ha-735960 status -v=7 --alsologtostderr: exit status 7 (123.611874ms)

-- stdout --

	ha-735960

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-735960-m02

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-735960-m03

	type: Control Plane

	host: Stopped

	kubelet: Stopped

	apiserver: Stopped

	kubeconfig: Stopped

	ha-735960-m04

	type: Worker

	host: Stopped

	kubelet: Stopped

-- /stdout --

** stderr ** 

	I0701 12:24:02.377383  653477 out.go:291] Setting OutFile to fd 1 ...

	I0701 12:24:02.377503  653477 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:24:02.377511  653477 out.go:304] Setting ErrFile to fd 2...

	I0701 12:24:02.377515  653477 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:24:02.377696  653477 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19166-630650/.minikube/bin

	I0701 12:24:02.377860  653477 out.go:298] Setting JSON to false

	I0701 12:24:02.377888  653477 mustload.go:65] Loading cluster: ha-735960

	I0701 12:24:02.378005  653477 notify.go:220] Checking for updates...

	I0701 12:24:02.378265  653477 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:24:02.378282  653477 status.go:255] checking status of ha-735960 ...

	I0701 12:24:02.378722  653477 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:24:02.378779  653477 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:24:02.400342  653477 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43529

	I0701 12:24:02.400850  653477 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:24:02.401487  653477 main.go:141] libmachine: Using API Version  1

	I0701 12:24:02.401520  653477 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:24:02.401880  653477 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:24:02.402068  653477 main.go:141] libmachine: (ha-735960) Calling .GetState

	I0701 12:24:02.403726  653477 status.go:330] ha-735960 host status = "Stopped" (err=<nil>)

	I0701 12:24:02.403738  653477 status.go:343] host is not running, skipping remaining checks

	I0701 12:24:02.403745  653477 status.go:257] ha-735960 status: &{Name:ha-735960 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0701 12:24:02.403769  653477 status.go:255] checking status of ha-735960-m02 ...

	I0701 12:24:02.404052  653477 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:24:02.404105  653477 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:24:02.419410  653477 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:35849

	I0701 12:24:02.419794  653477 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:24:02.420207  653477 main.go:141] libmachine: Using API Version  1

	I0701 12:24:02.420229  653477 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:24:02.420601  653477 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:24:02.420790  653477 main.go:141] libmachine: (ha-735960-m02) Calling .GetState

	I0701 12:24:02.422249  653477 status.go:330] ha-735960-m02 host status = "Stopped" (err=<nil>)

	I0701 12:24:02.422267  653477 status.go:343] host is not running, skipping remaining checks

	I0701 12:24:02.422275  653477 status.go:257] ha-735960-m02 status: &{Name:ha-735960-m02 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0701 12:24:02.422295  653477 status.go:255] checking status of ha-735960-m03 ...

	I0701 12:24:02.422621  653477 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:24:02.422656  653477 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:24:02.437366  653477 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:42733

	I0701 12:24:02.437735  653477 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:24:02.438236  653477 main.go:141] libmachine: Using API Version  1

	I0701 12:24:02.438255  653477 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:24:02.438601  653477 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:24:02.438796  653477 main.go:141] libmachine: (ha-735960-m03) Calling .GetState

	I0701 12:24:02.440138  653477 status.go:330] ha-735960-m03 host status = "Stopped" (err=<nil>)

	I0701 12:24:02.440163  653477 status.go:343] host is not running, skipping remaining checks

	I0701 12:24:02.440181  653477 status.go:257] ha-735960-m03 status: &{Name:ha-735960-m03 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

	I0701 12:24:02.440205  653477 status.go:255] checking status of ha-735960-m04 ...

	I0701 12:24:02.440484  653477 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:24:02.440534  653477 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:24:02.455215  653477 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34791

	I0701 12:24:02.455658  653477 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:24:02.456174  653477 main.go:141] libmachine: Using API Version  1

	I0701 12:24:02.456201  653477 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:24:02.456521  653477 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:24:02.456702  653477 main.go:141] libmachine: (ha-735960-m04) Calling .GetState

	I0701 12:24:02.458485  653477 status.go:330] ha-735960-m04 host status = "Stopped" (err=<nil>)

	I0701 12:24:02.458502  653477 status.go:343] host is not running, skipping remaining checks

	I0701 12:24:02.458509  653477 status.go:257] ha-735960-m04 status: &{Name:ha-735960-m04 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:true TimeToStop: DockerEnv: PodManEnv:}

** /stderr **

ha_test.go:543: status says not two control-plane nodes are present: args "out/minikube-linux-amd64 -p ha-735960 status -v=7 --alsologtostderr": ha-735960

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-735960-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-735960-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-735960-m04

type: Worker

host: Stopped

kubelet: Stopped

ha_test.go:549: status says not three kubelets are stopped: args "out/minikube-linux-amd64 -p ha-735960 status -v=7 --alsologtostderr": ha-735960

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-735960-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-735960-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-735960-m04

type: Worker

host: Stopped

kubelet: Stopped

ha_test.go:552: status says not two apiservers are stopped: args "out/minikube-linux-amd64 -p ha-735960 status -v=7 --alsologtostderr": ha-735960

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-735960-m02

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-735960-m03

type: Control Plane

host: Stopped

kubelet: Stopped

apiserver: Stopped

kubeconfig: Stopped

ha-735960-m04

type: Worker

host: Stopped

kubelet: Stopped

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-735960 -n ha-735960

helpers_test.go:239: (dbg) Non-zero exit: out/minikube-linux-amd64 status --format={{.Host}} -p ha-735960 -n ha-735960: exit status 7 (63.304055ms)

-- stdout --

	Stopped

-- /stdout --

helpers_test.go:239: status error: exit status 7 (may be ok)

helpers_test.go:241: "ha-735960" host is not running, skipping log retrieval (state="Stopped")

--- FAIL: TestMultiControlPlane/serial/StopCluster (58.99s)

=== RUN   TestMultiControlPlane/serial/RestartCluster

ha_test.go:560: (dbg) Run:  out/minikube-linux-amd64 start -p ha-735960 --wait=true -v=7 --alsologtostderr --driver=kvm2 

E0701 12:24:11.881073  637854 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/functional-377045/client.crt: no such file or directory

E0701 12:24:39.565295  637854 cert_rotation.go:168] key failed with : open /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/functional-377045/client.crt: no such file or directory

ha_test.go:560: (dbg) Done: out/minikube-linux-amd64 start -p ha-735960 --wait=true -v=7 --alsologtostderr --driver=kvm2 : (3m33.688504069s)

ha_test.go:566: (dbg) Run:  out/minikube-linux-amd64 -p ha-735960 status -v=7 --alsologtostderr

ha_test.go:571: status says not two control-plane nodes are present: args "out/minikube-linux-amd64 -p ha-735960 status -v=7 --alsologtostderr": ha-735960

type: Control Plane

host: Running

kubelet: Running

apiserver: Running

kubeconfig: Configured

ha-735960-m02

type: Control Plane

host: Running

kubelet: Running

apiserver: Running

kubeconfig: Configured

ha-735960-m03

type: Control Plane

host: Running

kubelet: Running

apiserver: Running

kubeconfig: Configured

ha-735960-m04

type: Worker

host: Running

kubelet: Running

ha_test.go:574: status says not three hosts are running: args "out/minikube-linux-amd64 -p ha-735960 status -v=7 --alsologtostderr": ha-735960

type: Control Plane

host: Running

kubelet: Running

apiserver: Running

kubeconfig: Configured

ha-735960-m02

type: Control Plane

host: Running

kubelet: Running

apiserver: Running

kubeconfig: Configured

ha-735960-m03

type: Control Plane

host: Running

kubelet: Running

apiserver: Running

kubeconfig: Configured

ha-735960-m04

type: Worker

host: Running

kubelet: Running

ha_test.go:577: status says not three kubelets are running: args "out/minikube-linux-amd64 -p ha-735960 status -v=7 --alsologtostderr": ha-735960

type: Control Plane

host: Running

kubelet: Running

apiserver: Running

kubeconfig: Configured

ha-735960-m02

type: Control Plane

host: Running

kubelet: Running

apiserver: Running

kubeconfig: Configured

ha-735960-m03

type: Control Plane

host: Running

kubelet: Running

apiserver: Running

kubeconfig: Configured

ha-735960-m04

type: Worker

host: Running

kubelet: Running

ha_test.go:580: status says not two apiservers are running: args "out/minikube-linux-amd64 -p ha-735960 status -v=7 --alsologtostderr": ha-735960

type: Control Plane

host: Running

kubelet: Running

apiserver: Running

kubeconfig: Configured

ha-735960-m02

type: Control Plane

host: Running

kubelet: Running

apiserver: Running

kubeconfig: Configured

ha-735960-m03

type: Control Plane

host: Running

kubelet: Running

apiserver: Running

kubeconfig: Configured

ha-735960-m04

type: Worker

host: Running

kubelet: Running

ha_test.go:584: (dbg) Run:  kubectl get nodes

ha_test.go:592: (dbg) Run:  kubectl get nodes -o "go-template='{{range .items}}{{range .status.conditions}}{{if eq .type "Ready"}} {{.status}}{{"\n"}}{{end}}{{end}}{{end}}'"

ha_test.go:597: expected 3 nodes Ready status to be True, got 

-- stdout --

	' True

	 True

	 True

	 True

	'

-- /stdout --

helpers_test.go:222: -----------------------post-mortem--------------------------------

helpers_test.go:239: (dbg) Run:  out/minikube-linux-amd64 status --format={{.Host}} -p ha-735960 -n ha-735960

helpers_test.go:244: <<< TestMultiControlPlane/serial/RestartCluster FAILED: start of post-mortem logs <<<

helpers_test.go:245: ======>  post-mortem[TestMultiControlPlane/serial/RestartCluster]: minikube logs <======

helpers_test.go:247: (dbg) Run:  out/minikube-linux-amd64 -p ha-735960 logs -n 25

helpers_test.go:247: (dbg) Done: out/minikube-linux-amd64 -p ha-735960 logs -n 25: (1.650438403s)

helpers_test.go:252: TestMultiControlPlane/serial/RestartCluster logs: 

-- stdout --

	==> Audit <==

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| Command |                                       Args                                       |  Profile  |  User   | Version |     Start Time      |      End Time       |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	| cp      | ha-735960 cp ha-735960-m03:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04:/home/docker/cp-test_ha-735960-m03_ha-735960-m04.txt               |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m03 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m04 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m03_ha-735960-m04.txt                             |           |         |         |                     |                     |

	| cp      | ha-735960 cp testdata/cp-test.txt                                                | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04:/home/docker/cp-test.txt                                           |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /tmp/TestMultiControlPlaneserialCopyFile2826819896/001/cp-test_ha-735960-m04.txt |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960:/home/docker/cp-test_ha-735960-m04_ha-735960.txt                       |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960 sudo cat                                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m04_ha-735960.txt                                 |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m02:/home/docker/cp-test_ha-735960-m04_ha-735960-m02.txt               |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m02 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m04_ha-735960-m02.txt                             |           |         |         |                     |                     |

	| cp      | ha-735960 cp ha-735960-m04:/home/docker/cp-test.txt                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m03:/home/docker/cp-test_ha-735960-m04_ha-735960-m03.txt               |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n                                                                 | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | ha-735960-m04 sudo cat                                                           |           |         |         |                     |                     |

	|         | /home/docker/cp-test.txt                                                         |           |         |         |                     |                     |

	| ssh     | ha-735960 ssh -n ha-735960-m03 sudo cat                                          | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | /home/docker/cp-test_ha-735960-m04_ha-735960-m03.txt                             |           |         |         |                     |                     |

	| node    | ha-735960 node stop m02 -v=7                                                     | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:19 UTC |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | ha-735960 node start m02 -v=7                                                    | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:19 UTC | 01 Jul 24 12:20 UTC |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | list -p ha-735960 -v=7                                                           | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:20 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| stop    | -p ha-735960 -v=7                                                                | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:20 UTC | 01 Jul 24 12:21 UTC |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| start   | -p ha-735960 --wait=true -v=7                                                    | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:21 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| node    | list -p ha-735960                                                                | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:22 UTC |                     |

	| node    | ha-735960 node delete m03 -v=7                                                   | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:22 UTC |                     |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| stop    | ha-735960 stop -v=7                                                              | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:23 UTC | 01 Jul 24 12:24 UTC |

	|         | --alsologtostderr                                                                |           |         |         |                     |                     |

	| start   | -p ha-735960 --wait=true                                                         | ha-735960 | jenkins | v1.33.1 | 01 Jul 24 12:24 UTC | 01 Jul 24 12:27 UTC |

	|         | -v=7 --alsologtostderr                                                           |           |         |         |                     |                     |

	|         | --driver=kvm2                                                                    |           |         |         |                     |                     |

	|---------|----------------------------------------------------------------------------------|-----------|---------|---------|---------------------|---------------------|

	==> Last Start <==

	Log file created at: 2024/07/01 12:24:02

	Running on machine: ubuntu-20-agent-7

	Binary: Built with gc go1.22.4 for linux/amd64

	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg

	I0701 12:24:02.565321  653531 out.go:291] Setting OutFile to fd 1 ...

	I0701 12:24:02.565576  653531 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:24:02.565584  653531 out.go:304] Setting ErrFile to fd 2...

	I0701 12:24:02.565588  653531 out.go:338] TERM=,COLORTERM=, which probably does not support color

	I0701 12:24:02.565782  653531 root.go:338] Updating PATH: /home/jenkins/minikube-integration/19166-630650/.minikube/bin

	I0701 12:24:02.566304  653531 out.go:298] Setting JSON to false

	I0701 12:24:02.567248  653531 start.go:129] hostinfo: {"hostname":"ubuntu-20-agent-7","uptime":7581,"bootTime":1719829062,"procs":185,"os":"linux","platform":"ubuntu","platformFamily":"debian","platformVersion":"20.04","kernelVersion":"5.15.0-1062-gcp","kernelArch":"x86_64","virtualizationSystem":"kvm","virtualizationRole":"guest","hostId":"591c9f12-2938-3743-e2bf-c56a050d43d1"}

	I0701 12:24:02.567318  653531 start.go:139] virtualization: kvm guest

	I0701 12:24:02.569903  653531 out.go:177] * [ha-735960] minikube v1.33.1 on Ubuntu 20.04 (kvm/amd64)

	I0701 12:24:02.571307  653531 notify.go:220] Checking for updates...

	I0701 12:24:02.571336  653531 out.go:177]   - MINIKUBE_LOCATION=19166

	I0701 12:24:02.572748  653531 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true

	I0701 12:24:02.574111  653531 out.go:177]   - KUBECONFIG=/home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:24:02.575333  653531 out.go:177]   - MINIKUBE_HOME=/home/jenkins/minikube-integration/19166-630650/.minikube

	I0701 12:24:02.576670  653531 out.go:177]   - MINIKUBE_BIN=out/minikube-linux-amd64

	I0701 12:24:02.578040  653531 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=

	I0701 12:24:02.579691  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:24:02.580063  653531 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:24:02.580118  653531 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:24:02.595084  653531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:46077

	I0701 12:24:02.595523  653531 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:24:02.596065  653531 main.go:141] libmachine: Using API Version  1

	I0701 12:24:02.596090  653531 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:24:02.596376  653531 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:24:02.596591  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:24:02.596798  653531 driver.go:392] Setting default libvirt URI to qemu:///system

	I0701 12:24:02.597091  653531 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:24:02.597140  653531 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:24:02.611685  653531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43891

	I0701 12:24:02.612062  653531 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:24:02.612574  653531 main.go:141] libmachine: Using API Version  1

	I0701 12:24:02.612596  653531 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:24:02.612886  653531 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:24:02.613060  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:24:02.647232  653531 out.go:177] * Using the kvm2 driver based on existing profile

	I0701 12:24:02.648606  653531 start.go:297] selected driver: kvm2

	I0701 12:24:02.648624  653531 start.go:901] validating driver "kvm2" against &{Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVer

sion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storagecla

ss:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount

9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:24:02.648774  653531 start.go:912] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}

	I0701 12:24:02.649109  653531 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0701 12:24:02.649176  653531 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/jenkins/minikube-integration/19166-630650/.minikube/bin:/home/jenkins/workspace/KVM_Linux_integration/out/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games:/usr/local/go/bin:/home/jenkins/go/bin:/usr/local/bin/:/usr/local/go/bin/:/home/jenkins/go/bin

	I0701 12:24:02.663726  653531 install.go:137] /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2 version is 1.33.1

	I0701 12:24:02.664362  653531 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0701 12:24:02.664394  653531 cni.go:84] Creating CNI manager for ""

	I0701 12:24:02.664400  653531 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0701 12:24:02.664456  653531 start.go:340] cluster config:

	{Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39

.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false h

elm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]

MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:24:02.664569  653531 iso.go:125] acquiring lock: {Name:mk5c70910f61bc270c83609c48670eaf9d7e0602 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}

	I0701 12:24:02.666644  653531 out.go:177] * Starting "ha-735960" primary control-plane node in "ha-735960" cluster

	I0701 12:24:02.667913  653531 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:24:02.667956  653531 preload.go:147] Found local preload: /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4

	I0701 12:24:02.667963  653531 cache.go:56] Caching tarball of preloaded images

	I0701 12:24:02.668051  653531 preload.go:173] Found /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0701 12:24:02.668065  653531 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on docker

	I0701 12:24:02.668178  653531 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:24:02.668362  653531 start.go:360] acquireMachinesLock for ha-735960: {Name:mk43a6c0c0c15a237623df377ad65b82186c0ad8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0701 12:24:02.668420  653531 start.go:364] duration metric: took 37.459µs to acquireMachinesLock for "ha-735960"

	I0701 12:24:02.668440  653531 start.go:96] Skipping create...Using existing machine configuration

	I0701 12:24:02.668454  653531 fix.go:54] fixHost starting: 

	I0701 12:24:02.668711  653531 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:24:02.668747  653531 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:24:02.682861  653531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39713

	I0701 12:24:02.683321  653531 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:24:02.683791  653531 main.go:141] libmachine: Using API Version  1

	I0701 12:24:02.683812  653531 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:24:02.684145  653531 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:24:02.684389  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:24:02.684573  653531 main.go:141] libmachine: (ha-735960) Calling .GetState

	I0701 12:24:02.686019  653531 fix.go:112] recreateIfNeeded on ha-735960: state=Stopped err=<nil>

	I0701 12:24:02.686043  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	W0701 12:24:02.686187  653531 fix.go:138] unexpected machine state, will restart: <nil>

	I0701 12:24:02.688339  653531 out.go:177] * Restarting existing kvm2 VM for "ha-735960" ...

	I0701 12:24:02.690004  653531 main.go:141] libmachine: (ha-735960) Calling .Start

	I0701 12:24:02.690210  653531 main.go:141] libmachine: (ha-735960) Ensuring networks are active...

	I0701 12:24:02.690928  653531 main.go:141] libmachine: (ha-735960) Ensuring network default is active

	I0701 12:24:02.691237  653531 main.go:141] libmachine: (ha-735960) Ensuring network mk-ha-735960 is active

	I0701 12:24:02.691618  653531 main.go:141] libmachine: (ha-735960) Getting domain xml...

	I0701 12:24:02.692321  653531 main.go:141] libmachine: (ha-735960) Creating domain...

	I0701 12:24:03.888996  653531 main.go:141] libmachine: (ha-735960) Waiting to get IP...

	I0701 12:24:03.889967  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:03.890480  653531 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:24:03.890588  653531 main.go:141] libmachine: (ha-735960) DBG | I0701 12:24:03.890454  653582 retry.go:31] will retry after 276.532377ms: waiting for machine to come up

	I0701 12:24:04.169193  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:04.169696  653531 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:24:04.169722  653531 main.go:141] libmachine: (ha-735960) DBG | I0701 12:24:04.169655  653582 retry.go:31] will retry after 379.701447ms: waiting for machine to come up

	I0701 12:24:04.551325  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:04.551741  653531 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:24:04.551768  653531 main.go:141] libmachine: (ha-735960) DBG | I0701 12:24:04.551690  653582 retry.go:31] will retry after 390.796114ms: waiting for machine to come up

	I0701 12:24:04.944503  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:04.944879  653531 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:24:04.944907  653531 main.go:141] libmachine: (ha-735960) DBG | I0701 12:24:04.944824  653582 retry.go:31] will retry after 501.242083ms: waiting for machine to come up

	I0701 12:24:05.447754  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:05.448283  653531 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:24:05.448315  653531 main.go:141] libmachine: (ha-735960) DBG | I0701 12:24:05.448261  653582 retry.go:31] will retry after 739.761709ms: waiting for machine to come up

	I0701 12:24:06.189145  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:06.189602  653531 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:24:06.189631  653531 main.go:141] libmachine: (ha-735960) DBG | I0701 12:24:06.189545  653582 retry.go:31] will retry after 652.97975ms: waiting for machine to come up

	I0701 12:24:06.844427  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:06.844894  653531 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:24:06.844917  653531 main.go:141] libmachine: (ha-735960) DBG | I0701 12:24:06.844845  653582 retry.go:31] will retry after 1.122975762s: waiting for machine to come up

	I0701 12:24:07.969893  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:07.970374  653531 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:24:07.970427  653531 main.go:141] libmachine: (ha-735960) DBG | I0701 12:24:07.970304  653582 retry.go:31] will retry after 933.604302ms: waiting for machine to come up

	I0701 12:24:08.905636  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:08.905959  653531 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:24:08.905983  653531 main.go:141] libmachine: (ha-735960) DBG | I0701 12:24:08.905909  653582 retry.go:31] will retry after 1.753153445s: waiting for machine to come up

	I0701 12:24:10.662098  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:10.662553  653531 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:24:10.662622  653531 main.go:141] libmachine: (ha-735960) DBG | I0701 12:24:10.662537  653582 retry.go:31] will retry after 1.625060377s: waiting for machine to come up

	I0701 12:24:12.290368  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:12.290788  653531 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:24:12.290822  653531 main.go:141] libmachine: (ha-735960) DBG | I0701 12:24:12.290695  653582 retry.go:31] will retry after 2.741972388s: waiting for machine to come up

	I0701 12:24:15.036161  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:15.036634  653531 main.go:141] libmachine: (ha-735960) DBG | unable to find current IP address of domain ha-735960 in network mk-ha-735960

	I0701 12:24:15.036661  653531 main.go:141] libmachine: (ha-735960) DBG | I0701 12:24:15.036581  653582 retry.go:31] will retry after 3.113034425s: waiting for machine to come up

	I0701 12:24:18.151534  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.152048  653531 main.go:141] libmachine: (ha-735960) Found IP for machine: 192.168.39.16

	I0701 12:24:18.152074  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has current primary IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.152083  653531 main.go:141] libmachine: (ha-735960) Reserving static IP address...

	I0701 12:24:18.152579  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "ha-735960", mac: "52:54:00:6c:20:7c", ip: "192.168.39.16"} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:18.152611  653531 main.go:141] libmachine: (ha-735960) DBG | skip adding static IP to network mk-ha-735960 - found existing host DHCP lease matching {name: "ha-735960", mac: "52:54:00:6c:20:7c", ip: "192.168.39.16"}

	I0701 12:24:18.152626  653531 main.go:141] libmachine: (ha-735960) Reserved static IP address: 192.168.39.16

	I0701 12:24:18.152643  653531 main.go:141] libmachine: (ha-735960) Waiting for SSH to be available...

	I0701 12:24:18.152674  653531 main.go:141] libmachine: (ha-735960) DBG | Getting to WaitForSSH function...

	I0701 12:24:18.154511  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.154741  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:18.154760  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.154885  653531 main.go:141] libmachine: (ha-735960) DBG | Using SSH client type: external

	I0701 12:24:18.154912  653531 main.go:141] libmachine: (ha-735960) DBG | Using SSH private key: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa (-rw-------)

	I0701 12:24:18.154954  653531 main.go:141] libmachine: (ha-735960) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.16 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0701 12:24:18.154968  653531 main.go:141] libmachine: (ha-735960) DBG | About to run SSH command:

	I0701 12:24:18.154991  653531 main.go:141] libmachine: (ha-735960) DBG | exit 0

	I0701 12:24:18.274220  653531 main.go:141] libmachine: (ha-735960) DBG | SSH cmd err, output: <nil>: 

	I0701 12:24:18.274677  653531 main.go:141] libmachine: (ha-735960) Calling .GetConfigRaw

	I0701 12:24:18.275344  653531 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:24:18.277628  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.278085  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:18.278118  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.278447  653531 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:24:18.278671  653531 machine.go:94] provisionDockerMachine start ...

	I0701 12:24:18.278694  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:24:18.278956  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:24:18.281138  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.281565  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:18.281590  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.281697  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:24:18.281884  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:18.282084  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:18.282290  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:24:18.282484  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:24:18.282777  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:24:18.282790  653531 main.go:141] libmachine: About to run SSH command:

	hostname

	I0701 12:24:18.378249  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0701 12:24:18.378279  653531 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:24:18.378583  653531 buildroot.go:166] provisioning hostname "ha-735960"

	I0701 12:24:18.378614  653531 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:24:18.378869  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:24:18.381421  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.381789  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:18.381817  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.381949  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:24:18.382158  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:18.382297  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:18.382445  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:24:18.382576  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:24:18.382763  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:24:18.382780  653531 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-735960 && echo "ha-735960" | sudo tee /etc/hostname

	I0701 12:24:18.491369  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-735960

	I0701 12:24:18.491396  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:24:18.494039  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.494432  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:18.494460  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.494718  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:24:18.494939  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:18.495106  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:18.495259  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:24:18.495452  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:24:18.495675  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:24:18.495699  653531 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-735960' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-735960/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-735960' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0701 12:24:18.598595  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0701 12:24:18.598631  653531 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19166-630650/.minikube CaCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19166-630650/.minikube}

	I0701 12:24:18.598653  653531 buildroot.go:174] setting up certificates

	I0701 12:24:18.598662  653531 provision.go:84] configureAuth start

	I0701 12:24:18.598670  653531 main.go:141] libmachine: (ha-735960) Calling .GetMachineName

	I0701 12:24:18.598968  653531 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:24:18.601563  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.602005  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:18.602036  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.602215  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:24:18.604739  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.605246  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:18.605273  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:18.605427  653531 provision.go:143] copyHostCerts

	I0701 12:24:18.605458  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:24:18.605515  653531 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem, removing ...

	I0701 12:24:18.605523  653531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:24:18.605588  653531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem (1675 bytes)

	I0701 12:24:18.605671  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:24:18.605688  653531 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem, removing ...

	I0701 12:24:18.605695  653531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:24:18.605718  653531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem (1078 bytes)

	I0701 12:24:18.605772  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:24:18.605788  653531 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem, removing ...

	I0701 12:24:18.605794  653531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:24:18.605814  653531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem (1123 bytes)

	I0701 12:24:18.605871  653531 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem org=jenkins.ha-735960 san=[127.0.0.1 192.168.39.16 ha-735960 localhost minikube]

	I0701 12:24:19.079576  653531 provision.go:177] copyRemoteCerts

	I0701 12:24:19.079661  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0701 12:24:19.079696  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:24:19.082253  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:19.082610  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:19.082638  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:19.082786  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:24:19.082996  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:19.083179  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:24:19.083325  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:24:19.160543  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0701 12:24:19.160634  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0701 12:24:19.183871  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0701 12:24:19.183957  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem --> /etc/docker/server.pem (1200 bytes)

	I0701 12:24:19.206811  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0701 12:24:19.206911  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1679 bytes)

	I0701 12:24:19.229160  653531 provision.go:87] duration metric: took 630.48062ms to configureAuth

	I0701 12:24:19.229197  653531 buildroot.go:189] setting minikube options for container-runtime

	I0701 12:24:19.229480  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:24:19.229521  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:24:19.229827  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:24:19.232595  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:19.233032  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:19.233062  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:19.233264  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:24:19.233514  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:19.233696  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:19.233834  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:24:19.234025  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:24:19.234222  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:24:19.234237  653531 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0701 12:24:19.331417  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0701 12:24:19.331446  653531 buildroot.go:70] root file system type: tmpfs

	I0701 12:24:19.331582  653531 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0701 12:24:19.331605  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:24:19.334269  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:19.334634  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:19.334660  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:19.334900  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:24:19.335107  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:19.335308  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:19.335479  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:24:19.335645  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:24:19.335809  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:24:19.335865  653531 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0701 12:24:19.443562  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0701 12:24:19.443592  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:24:19.446176  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:19.446524  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:19.446556  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:19.446723  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:24:19.446930  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:19.447105  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:19.447245  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:24:19.447408  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:24:19.447591  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:24:19.447611  653531 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0701 12:24:21.232310  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0701 12:24:21.232343  653531 machine.go:97] duration metric: took 2.953656212s to provisionDockerMachine

	I0701 12:24:21.232359  653531 start.go:293] postStartSetup for "ha-735960" (driver="kvm2")

	I0701 12:24:21.232371  653531 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0701 12:24:21.232390  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:24:21.232744  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0701 12:24:21.232777  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:24:21.235119  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:21.235559  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:21.235584  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:21.235772  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:24:21.235940  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:21.236122  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:24:21.236248  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:24:21.313134  653531 ssh_runner.go:195] Run: cat /etc/os-release

	I0701 12:24:21.317084  653531 info.go:137] Remote host: Buildroot 2023.02.9

	I0701 12:24:21.317118  653531 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/addons for local assets ...

	I0701 12:24:21.317202  653531 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/files for local assets ...

	I0701 12:24:21.317295  653531 filesync.go:149] local asset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> 6378542.pem in /etc/ssl/certs

	I0701 12:24:21.317307  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /etc/ssl/certs/6378542.pem

	I0701 12:24:21.317399  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0701 12:24:21.326681  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:24:21.349306  653531 start.go:296] duration metric: took 116.926386ms for postStartSetup

	I0701 12:24:21.349360  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:24:21.349703  653531 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup

	I0701 12:24:21.349739  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:24:21.352499  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:21.352917  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:21.352946  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:21.353148  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:24:21.353394  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:21.353561  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:24:21.353790  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:24:21.433784  653531 machine.go:198] restoring vm config from /var/lib/minikube/backup: [etc]

	I0701 12:24:21.433859  653531 ssh_runner.go:195] Run: sudo rsync --archive --update /var/lib/minikube/backup/etc /

	I0701 12:24:21.475659  653531 fix.go:56] duration metric: took 18.807194904s for fixHost

	I0701 12:24:21.475706  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:24:21.478623  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:21.479038  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:21.479071  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:21.479250  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:24:21.479467  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:21.479584  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:21.479702  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:24:21.479838  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:24:21.480034  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.16 22 <nil> <nil>}

	I0701 12:24:21.480048  653531 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0701 12:24:21.586741  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: 1719836661.563256683

	I0701 12:24:21.586770  653531 fix.go:216] guest clock: 1719836661.563256683

	I0701 12:24:21.586783  653531 fix.go:229] Guest: 2024-07-01 12:24:21.563256683 +0000 UTC Remote: 2024-07-01 12:24:21.475685785 +0000 UTC m=+18.945537438 (delta=87.570898ms)

	I0701 12:24:21.586836  653531 fix.go:200] guest clock delta is within tolerance: 87.570898ms

	I0701 12:24:21.586844  653531 start.go:83] releasing machines lock for "ha-735960", held for 18.918411663s

	I0701 12:24:21.586868  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:24:21.587158  653531 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:24:21.589666  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:21.590034  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:21.590064  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:21.590216  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:24:21.590761  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:24:21.590954  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:24:21.591048  653531 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0701 12:24:21.591096  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:24:21.591207  653531 ssh_runner.go:195] Run: cat /version.json

	I0701 12:24:21.591235  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:24:21.593711  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:21.593857  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:21.594066  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:21.594091  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:21.594278  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:24:21.594408  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:21.594432  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:21.594491  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:21.594596  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:24:21.594674  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:24:21.594780  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:21.594865  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:24:21.594903  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:24:21.595018  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:24:21.688196  653531 ssh_runner.go:195] Run: systemctl --version

	I0701 12:24:21.693743  653531 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	W0701 12:24:21.698823  653531 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0701 12:24:21.698901  653531 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0701 12:24:21.714364  653531 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0701 12:24:21.714404  653531 start.go:494] detecting cgroup driver to use...

	I0701 12:24:21.714572  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:24:21.734692  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0701 12:24:21.744599  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0701 12:24:21.754591  653531 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0701 12:24:21.754664  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0701 12:24:21.764718  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:24:21.774564  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0701 12:24:21.784516  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:24:21.794592  653531 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0701 12:24:21.804646  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0701 12:24:21.814497  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0701 12:24:21.824363  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0701 12:24:21.834566  653531 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0701 12:24:21.843852  653531 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0701 12:24:21.852939  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:24:21.959107  653531 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0701 12:24:21.981473  653531 start.go:494] detecting cgroup driver to use...

	I0701 12:24:21.981556  653531 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0701 12:24:21.995383  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:24:22.009843  653531 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0701 12:24:22.030755  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:24:22.043208  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:24:22.055774  653531 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0701 12:24:22.080888  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:24:22.093331  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:24:22.110088  653531 ssh_runner.go:195] Run: which cri-dockerd

	I0701 12:24:22.113487  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0701 12:24:22.121907  653531 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0701 12:24:22.137227  653531 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0701 12:24:22.245438  653531 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0701 12:24:22.351994  653531 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0701 12:24:22.352150  653531 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0701 12:24:22.368109  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:24:22.474388  653531 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0701 12:24:24.887396  653531 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.412956412s)

	I0701 12:24:24.887487  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0701 12:24:24.900113  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:24:24.912702  653531 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0701 12:24:25.020545  653531 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0701 12:24:25.134056  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:24:25.242294  653531 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0701 12:24:25.258251  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:24:25.270762  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:24:25.375199  653531 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0701 12:24:25.454939  653531 start.go:541] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0701 12:24:25.455020  653531 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0701 12:24:25.460209  653531 start.go:562] Will wait 60s for crictl version

	I0701 12:24:25.460266  653531 ssh_runner.go:195] Run: which crictl

	I0701 12:24:25.463721  653531 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0701 12:24:25.498358  653531 start.go:578] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.0.1

	RuntimeApiVersion:  v1

	I0701 12:24:25.498453  653531 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:24:25.525766  653531 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:24:25.549708  653531 out.go:204] * Preparing Kubernetes v1.30.2 on Docker 27.0.1 ...

	I0701 12:24:25.549757  653531 main.go:141] libmachine: (ha-735960) Calling .GetIP

	I0701 12:24:25.552699  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:25.553097  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:25.553132  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:25.553374  653531 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0701 12:24:25.557331  653531 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:24:25.569653  653531 kubeadm.go:877] updating cluster {Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Cl

usterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:fa

lse freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p200

0.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} ...

	I0701 12:24:25.569810  653531 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:24:25.569866  653531 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0701 12:24:25.593428  653531 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.30.2

	registry.k8s.io/kube-controller-manager:v1.30.2

	registry.k8s.io/kube-scheduler:v1.30.2

	registry.k8s.io/kube-proxy:v1.30.2

	kindest/kindnetd:v20240513-cd2ac642

	ghcr.io/kube-vip/kube-vip:v0.8.0

	registry.k8s.io/etcd:3.5.12-0

	registry.k8s.io/coredns/coredns:v1.11.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28

	-- /stdout --

	I0701 12:24:25.593450  653531 docker.go:615] Images already preloaded, skipping extraction

	I0701 12:24:25.593535  653531 ssh_runner.go:195] Run: docker images --format {{.Repository}}:{{.Tag}}

	I0701 12:24:25.613507  653531 docker.go:685] Got preloaded images: -- stdout --

	registry.k8s.io/kube-apiserver:v1.30.2

	registry.k8s.io/kube-controller-manager:v1.30.2

	registry.k8s.io/kube-scheduler:v1.30.2

	registry.k8s.io/kube-proxy:v1.30.2

	kindest/kindnetd:v20240513-cd2ac642

	ghcr.io/kube-vip/kube-vip:v0.8.0

	registry.k8s.io/etcd:3.5.12-0

	registry.k8s.io/coredns/coredns:v1.11.1

	registry.k8s.io/pause:3.9

	gcr.io/k8s-minikube/storage-provisioner:v5

	gcr.io/k8s-minikube/busybox:1.28

	-- /stdout --

	I0701 12:24:25.613542  653531 cache_images.go:84] Images are preloaded, skipping loading

	I0701 12:24:25.613557  653531 kubeadm.go:928] updating node { 192.168.39.16 8443 v1.30.2 docker true true} ...

	I0701 12:24:25.613677  653531 kubeadm.go:940] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-735960 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.16

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0701 12:24:25.613736  653531 ssh_runner.go:195] Run: docker info --format {{.CgroupDriver}}

	I0701 12:24:25.636959  653531 cni.go:84] Creating CNI manager for ""

	I0701 12:24:25.636987  653531 cni.go:136] multinode detected (4 nodes found), recommending kindnet

	I0701 12:24:25.637001  653531 kubeadm.go:84] Using pod CIDR: 10.244.0.0/16

	I0701 12:24:25.637033  653531 kubeadm.go:181] kubeadm options: {CertDir:/var/lib/minikube/certs ServiceCIDR:10.96.0.0/12 PodSubnet:10.244.0.0/16 AdvertiseAddress:192.168.39.16 APIServerPort:8443 KubernetesVersion:v1.30.2 EtcdDataDir:/var/lib/minikube/etcd EtcdExtraArgs:map[] ClusterName:ha-735960 NodeName:ha-735960 DNSDomain:cluster.local CRISocket:/var/run/cri-dockerd.sock ImageRepository: ComponentOptions:[{Component:apiServer ExtraArgs:map[enable-admission-plugins:NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota] Pairs:map[certSANs:["127.0.0.1", "localhost", "192.168.39.16"]]} {Component:controllerManager ExtraArgs:map[allocate-node-cidrs:true leader-elect:false] Pairs:map[]} {Component:scheduler ExtraArgs:map[leader-elect:false] Pairs:map[]}] FeatureArgs:map[] NodeIP:192.168.39.16 CgroupDriver:cgroupfs ClientCAFile:/var/lib/minikube/certs/ca.crt StaticPodPath:/etc/kubernetes

/manifests ControlPlaneAddress:control-plane.minikube.internal KubeProxyOptions:map[] ResolvConfSearchRegression:false KubeletConfigOpts:map[containerRuntimeEndpoint:unix:///var/run/cri-dockerd.sock hairpinMode:hairpin-veth runtimeRequestTimeout:15m] PrependCriSocketUnix:true}

	I0701 12:24:25.637207  653531 kubeadm.go:187] kubeadm config:

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: InitConfiguration

	localAPIEndpoint:

	  advertiseAddress: 192.168.39.16

	  bindPort: 8443

	bootstrapTokens:

	  - groups:

	      - system:bootstrappers:kubeadm:default-node-token

	    ttl: 24h0m0s

	    usages:

	      - signing

	      - authentication

	nodeRegistration:

	  criSocket: unix:///var/run/cri-dockerd.sock

	  name: "ha-735960"

	  kubeletExtraArgs:

	    node-ip: 192.168.39.16

	  taints: []

	---

	apiVersion: kubeadm.k8s.io/v1beta3

	kind: ClusterConfiguration

	apiServer:

	  certSANs: ["127.0.0.1", "localhost", "192.168.39.16"]

	  extraArgs:

	    enable-admission-plugins: "NamespaceLifecycle,LimitRanger,ServiceAccount,DefaultStorageClass,DefaultTolerationSeconds,NodeRestriction,MutatingAdmissionWebhook,ValidatingAdmissionWebhook,ResourceQuota"

	controllerManager:

	  extraArgs:

	    allocate-node-cidrs: "true"

	    leader-elect: "false"

	scheduler:

	  extraArgs:

	    leader-elect: "false"

	certificatesDir: /var/lib/minikube/certs

	clusterName: mk

	controlPlaneEndpoint: control-plane.minikube.internal:8443

	etcd:

	  local:

	    dataDir: /var/lib/minikube/etcd

	    extraArgs:

	      proxy-refresh-interval: "70000"

	kubernetesVersion: v1.30.2

	networking:

	  dnsDomain: cluster.local

	  podSubnet: "10.244.0.0/16"

	  serviceSubnet: 10.96.0.0/12

	---

	apiVersion: kubelet.config.k8s.io/v1beta1

	kind: KubeletConfiguration

	authentication:

	  x509:

	    clientCAFile: /var/lib/minikube/certs/ca.crt

	cgroupDriver: cgroupfs

	containerRuntimeEndpoint: unix:///var/run/cri-dockerd.sock

	hairpinMode: hairpin-veth

	runtimeRequestTimeout: 15m

	clusterDomain: "cluster.local"

	# disable disk resource management by default

	imageGCHighThresholdPercent: 100

	evictionHard:

	  nodefs.available: "0%!"(MISSING)

	  nodefs.inodesFree: "0%!"(MISSING)

	  imagefs.available: "0%!"(MISSING)

	failSwapOn: false

	staticPodPath: /etc/kubernetes/manifests

	---

	apiVersion: kubeproxy.config.k8s.io/v1alpha1

	kind: KubeProxyConfiguration

	clusterCIDR: "10.244.0.0/16"

	metricsBindAddress: 0.0.0.0:10249

	conntrack:

	  maxPerCore: 0

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_established"

	  tcpEstablishedTimeout: 0s

	# Skip setting "net.netfilter.nf_conntrack_tcp_timeout_close"

	  tcpCloseWaitTimeout: 0s

	I0701 12:24:25.637234  653531 kube-vip.go:115] generating kube-vip config ...

	I0701 12:24:25.637291  653531 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0701 12:24:25.651059  653531 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0701 12:24:25.651192  653531 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0701 12:24:25.651261  653531 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0701 12:24:25.660952  653531 binaries.go:44] Found k8s binaries, skipping transfer

	I0701 12:24:25.661049  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /var/tmp/minikube /etc/kubernetes/manifests

	I0701 12:24:25.669901  653531 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (309 bytes)

	I0701 12:24:25.685801  653531 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0701 12:24:25.701259  653531 ssh_runner.go:362] scp memory --> /var/tmp/minikube/kubeadm.yaml.new (2154 bytes)

	I0701 12:24:25.717237  653531 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0701 12:24:25.732682  653531 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0701 12:24:25.736549  653531 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:24:25.748348  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:24:25.857797  653531 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0701 12:24:25.874307  653531 certs.go:68] Setting up /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960 for IP: 192.168.39.16

	I0701 12:24:25.874340  653531 certs.go:194] generating shared ca certs ...

	I0701 12:24:25.874365  653531 certs.go:226] acquiring lock for ca certs: {Name:mk34e166bfd069e523b2325e14d1812c523bff53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:24:25.874584  653531 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key

	I0701 12:24:25.874645  653531 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key

	I0701 12:24:25.874659  653531 certs.go:256] generating profile certs ...

	I0701 12:24:25.874733  653531 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key

	I0701 12:24:25.874814  653531 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.5c21f4af

	I0701 12:24:25.874868  653531 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key

	I0701 12:24:25.874883  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0701 12:24:25.874918  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0701 12:24:25.874937  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0701 12:24:25.874955  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0701 12:24:25.874972  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0701 12:24:25.874991  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0701 12:24:25.875008  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0701 12:24:25.875025  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0701 12:24:25.875093  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem (1338 bytes)

	W0701 12:24:25.875146  653531 certs.go:480] ignoring /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854_empty.pem, impossibly tiny 0 bytes

	I0701 12:24:25.875161  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem (1675 bytes)

	I0701 12:24:25.875193  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem (1078 bytes)

	I0701 12:24:25.875224  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem (1123 bytes)

	I0701 12:24:25.875261  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem (1675 bytes)

	I0701 12:24:25.875343  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:24:25.875386  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /usr/share/ca-certificates/6378542.pem

	I0701 12:24:25.875409  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:24:25.875426  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem -> /usr/share/ca-certificates/637854.pem

	I0701 12:24:25.876083  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0701 12:24:25.910761  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0701 12:24:25.938480  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0701 12:24:25.963281  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0701 12:24:25.989413  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)

	I0701 12:24:26.015055  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0701 12:24:26.039406  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0701 12:24:26.062955  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0701 12:24:26.093960  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /usr/share/ca-certificates/6378542.pem (1708 bytes)

	I0701 12:24:26.125896  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0701 12:24:26.156031  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem --> /usr/share/ca-certificates/637854.pem (1338 bytes)

	I0701 12:24:26.181375  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (738 bytes)

	I0701 12:24:26.209470  653531 ssh_runner.go:195] Run: openssl version

	I0701 12:24:26.218386  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6378542.pem && ln -fs /usr/share/ca-certificates/6378542.pem /etc/ssl/certs/6378542.pem"

	I0701 12:24:26.233243  653531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6378542.pem

	I0701 12:24:26.241811  653531 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul  1 12:11 /usr/share/ca-certificates/6378542.pem

	I0701 12:24:26.241888  653531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6378542.pem

	I0701 12:24:26.250559  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/6378542.pem /etc/ssl/certs/3ec20f2e.0"

	I0701 12:24:26.277768  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0701 12:24:26.305594  653531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:24:26.315685  653531 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul  1 12:05 /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:24:26.315763  653531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:24:26.330923  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0701 12:24:26.351095  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/637854.pem && ln -fs /usr/share/ca-certificates/637854.pem /etc/ssl/certs/637854.pem"

	I0701 12:24:26.374355  653531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/637854.pem

	I0701 12:24:26.380759  653531 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul  1 12:11 /usr/share/ca-certificates/637854.pem

	I0701 12:24:26.380836  653531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/637854.pem

	I0701 12:24:26.392584  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/637854.pem /etc/ssl/certs/51391683.0"

	I0701 12:24:26.411160  653531 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0701 12:24:26.419483  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I0701 12:24:26.437558  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I0701 12:24:26.444826  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I0701 12:24:26.454628  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I0701 12:24:26.467473  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I0701 12:24:26.476039  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I0701 12:24:26.482296  653531 kubeadm.go:391] StartCluster: {Name:ha-735960 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/19142/minikube-v1.33.1-1719412936-19142-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.44-1719413016-19142@sha256:af368900f8c68437efd9db2dba61a03b07068e5b9fe0dc8d7f46be199657779d Memory:2200 CPUs:2 DiskSize:20000 Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.30.2 Clust

erName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true} {Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}] Addons:map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false

freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/jenkins:/minikube-host Mount9PVersion:9p2000.L

MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}

	I0701 12:24:26.482508  653531 ssh_runner.go:195] Run: docker ps --filter status=paused --filter=name=k8s_.*_(kube-system)_ --format={{.ID}}

	I0701 12:24:26.498609  653531 ssh_runner.go:195] Run: sudo ls /var/lib/kubelet/kubeadm-flags.env /var/lib/kubelet/config.yaml /var/lib/minikube/etcd

	W0701 12:24:26.509374  653531 kubeadm.go:404] apiserver tunnel failed: apiserver port not set

	I0701 12:24:26.509403  653531 kubeadm.go:407] found existing configuration files, will attempt cluster restart

	I0701 12:24:26.509410  653531 kubeadm.go:587] restartPrimaryControlPlane start ...

	I0701 12:24:26.509466  653531 ssh_runner.go:195] Run: sudo test -d /data/minikube

	I0701 12:24:26.518865  653531 kubeadm.go:129] /data/minikube skipping compat symlinks: sudo test -d /data/minikube: Process exited with status 1

	stdout:

	stderr:

	I0701 12:24:26.519310  653531 kubeconfig.go:47] verify endpoint returned: get endpoint: "ha-735960" does not appear in /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:24:26.519460  653531 kubeconfig.go:62] /home/jenkins/minikube-integration/19166-630650/kubeconfig needs updating (will repair): [kubeconfig missing "ha-735960" cluster setting kubeconfig missing "ha-735960" context setting]

	I0701 12:24:26.519772  653531 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/kubeconfig: {Name:mke3ef9d019eff4edd273b00c416fd77ed009242 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:24:26.520253  653531 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:24:26.520566  653531 kapi.go:59] client config for ha-735960: &rest.Config{Host:"https://192.168.39.16:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.crt", KeyFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key", CAFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(ni

l)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1cfbb80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	I0701 12:24:26.521041  653531 cert_rotation.go:137] Starting client certificate rotation controller

	I0701 12:24:26.521235  653531 ssh_runner.go:195] Run: sudo diff -u /var/tmp/minikube/kubeadm.yaml /var/tmp/minikube/kubeadm.yaml.new

	I0701 12:24:26.530555  653531 kubeadm.go:624] The running cluster does not require reconfiguration: 192.168.39.16

	I0701 12:24:26.530586  653531 kubeadm.go:591] duration metric: took 21.167521ms to restartPrimaryControlPlane

	I0701 12:24:26.530596  653531 kubeadm.go:393] duration metric: took 48.31583ms to StartCluster

	I0701 12:24:26.530618  653531 settings.go:142] acquiring lock: {Name:mk6f7c85ea77a73ff0ac851454721f2e6e309153 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:24:26.530700  653531 settings.go:150] Updating kubeconfig:  /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:24:26.531272  653531 lock.go:35] WriteFile acquiring /home/jenkins/minikube-integration/19166-630650/kubeconfig: {Name:mke3ef9d019eff4edd273b00c416fd77ed009242 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:24:26.531528  653531 start.go:232] HA (multi-control plane) cluster: will skip waiting for primary control-plane node &{Name: IP:192.168.39.16 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0701 12:24:26.531554  653531 start.go:240] waiting for startup goroutines ...

	I0701 12:24:26.531572  653531 addons.go:507] enable addons start: toEnable=map[ambassador:false auto-pause:false cloud-spanner:false csi-hostpath-driver:false dashboard:false default-storageclass:false efk:false freshpod:false gcp-auth:false gvisor:false headlamp:false helm-tiller:false inaccel:false ingress:false ingress-dns:false inspektor-gadget:false istio:false istio-provisioner:false kong:false kubeflow:false kubevirt:false logviewer:false metallb:false metrics-server:false nvidia-device-plugin:false nvidia-driver-installer:false nvidia-gpu-device-plugin:false olm:false pod-security-policy:false portainer:false registry:false registry-aliases:false registry-creds:false storage-provisioner:false storage-provisioner-gluster:false storage-provisioner-rancher:false volcano:false volumesnapshots:false yakd:false]

	I0701 12:24:26.531767  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:24:26.534496  653531 out.go:177] * Enabled addons: 

	I0701 12:24:26.535873  653531 addons.go:510] duration metric: took 4.304011ms for enable addons: enabled=[]

	I0701 12:24:26.535915  653531 start.go:245] waiting for cluster config update ...

	I0701 12:24:26.535925  653531 start.go:254] writing updated cluster config ...

	I0701 12:24:26.537498  653531 out.go:177] 

	I0701 12:24:26.539211  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:24:26.539336  653531 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:24:26.541509  653531 out.go:177] * Starting "ha-735960-m02" control-plane node in "ha-735960" cluster

	I0701 12:24:26.542802  653531 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:24:26.542833  653531 cache.go:56] Caching tarball of preloaded images

	I0701 12:24:26.542967  653531 preload.go:173] Found /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0701 12:24:26.542983  653531 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on docker

	I0701 12:24:26.543093  653531 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:24:26.543293  653531 start.go:360] acquireMachinesLock for ha-735960-m02: {Name:mk43a6c0c0c15a237623df377ad65b82186c0ad8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0701 12:24:26.543355  653531 start.go:364] duration metric: took 39.786µs to acquireMachinesLock for "ha-735960-m02"

	I0701 12:24:26.543382  653531 start.go:96] Skipping create...Using existing machine configuration

	I0701 12:24:26.543393  653531 fix.go:54] fixHost starting: m02

	I0701 12:24:26.543665  653531 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:24:26.543694  653531 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:24:26.558741  653531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34329

	I0701 12:24:26.559300  653531 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:24:26.559767  653531 main.go:141] libmachine: Using API Version  1

	I0701 12:24:26.559790  653531 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:24:26.560107  653531 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:24:26.560324  653531 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:24:26.560471  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetState

	I0701 12:24:26.561903  653531 fix.go:112] recreateIfNeeded on ha-735960-m02: state=Stopped err=<nil>

	I0701 12:24:26.561933  653531 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	W0701 12:24:26.562104  653531 fix.go:138] unexpected machine state, will restart: <nil>

	I0701 12:24:26.564118  653531 out.go:177] * Restarting existing kvm2 VM for "ha-735960-m02" ...

	I0701 12:24:26.565547  653531 main.go:141] libmachine: (ha-735960-m02) Calling .Start

	I0701 12:24:26.565742  653531 main.go:141] libmachine: (ha-735960-m02) Ensuring networks are active...

	I0701 12:24:26.566439  653531 main.go:141] libmachine: (ha-735960-m02) Ensuring network default is active

	I0701 12:24:26.566739  653531 main.go:141] libmachine: (ha-735960-m02) Ensuring network mk-ha-735960 is active

	I0701 12:24:26.567095  653531 main.go:141] libmachine: (ha-735960-m02) Getting domain xml...

	I0701 12:24:26.567681  653531 main.go:141] libmachine: (ha-735960-m02) Creating domain...

	I0701 12:24:27.772734  653531 main.go:141] libmachine: (ha-735960-m02) Waiting to get IP...

	I0701 12:24:27.773478  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:27.773801  653531 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:24:27.773853  653531 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:24:27.773777  653719 retry.go:31] will retry after 217.058414ms: waiting for machine to come up

	I0701 12:24:27.992187  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:27.992715  653531 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:24:27.992745  653531 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:24:27.992653  653719 retry.go:31] will retry after 295.156992ms: waiting for machine to come up

	I0701 12:24:28.289101  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:28.289597  653531 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:24:28.289630  653531 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:24:28.289531  653719 retry.go:31] will retry after 353.406325ms: waiting for machine to come up

	I0701 12:24:28.644006  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:28.644479  653531 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:24:28.644510  653531 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:24:28.644437  653719 retry.go:31] will retry after 398.224689ms: waiting for machine to come up

	I0701 12:24:29.044072  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:29.044514  653531 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:24:29.044545  653531 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:24:29.044461  653719 retry.go:31] will retry after 547.020131ms: waiting for machine to come up

	I0701 12:24:29.593264  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:29.593690  653531 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:24:29.593709  653531 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:24:29.593653  653719 retry.go:31] will retry after 787.756844ms: waiting for machine to come up

	I0701 12:24:30.382731  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:30.383180  653531 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:24:30.383209  653531 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:24:30.383137  653719 retry.go:31] will retry after 870.067991ms: waiting for machine to come up

	I0701 12:24:31.254672  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:31.255252  653531 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:24:31.255285  653531 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:24:31.255205  653719 retry.go:31] will retry after 1.371479719s: waiting for machine to come up

	I0701 12:24:32.628605  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:32.629092  653531 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:24:32.629124  653531 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:24:32.629036  653719 retry.go:31] will retry after 1.347043223s: waiting for machine to come up

	I0701 12:24:33.978739  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:33.979246  653531 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:24:33.979275  653531 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:24:33.979195  653719 retry.go:31] will retry after 2.257830197s: waiting for machine to come up

	I0701 12:24:36.239828  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:36.240400  653531 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:24:36.240433  653531 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:24:36.240355  653719 retry.go:31] will retry after 2.834526493s: waiting for machine to come up

	I0701 12:24:39.078121  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:39.078416  653531 main.go:141] libmachine: (ha-735960-m02) DBG | unable to find current IP address of domain ha-735960-m02 in network mk-ha-735960

	I0701 12:24:39.078448  653531 main.go:141] libmachine: (ha-735960-m02) DBG | I0701 12:24:39.078379  653719 retry.go:31] will retry after 2.465969863s: waiting for machine to come up

	I0701 12:24:41.547043  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:41.547535  653531 main.go:141] libmachine: (ha-735960-m02) Found IP for machine: 192.168.39.86

	I0701 12:24:41.547569  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has current primary IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:41.547579  653531 main.go:141] libmachine: (ha-735960-m02) Reserving static IP address...

	I0701 12:24:41.547991  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "ha-735960-m02", mac: "52:54:00:0b:2f:ce", ip: "192.168.39.86"} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:41.548015  653531 main.go:141] libmachine: (ha-735960-m02) Reserved static IP address: 192.168.39.86

	I0701 12:24:41.548032  653531 main.go:141] libmachine: (ha-735960-m02) DBG | skip adding static IP to network mk-ha-735960 - found existing host DHCP lease matching {name: "ha-735960-m02", mac: "52:54:00:0b:2f:ce", ip: "192.168.39.86"}

	I0701 12:24:41.548045  653531 main.go:141] libmachine: (ha-735960-m02) DBG | Getting to WaitForSSH function...

	I0701 12:24:41.548059  653531 main.go:141] libmachine: (ha-735960-m02) Waiting for SSH to be available...

	I0701 12:24:41.550171  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:41.550523  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:41.550552  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:41.550644  653531 main.go:141] libmachine: (ha-735960-m02) DBG | Using SSH client type: external

	I0701 12:24:41.550670  653531 main.go:141] libmachine: (ha-735960-m02) DBG | Using SSH private key: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa (-rw-------)

	I0701 12:24:41.550719  653531 main.go:141] libmachine: (ha-735960-m02) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.86 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0701 12:24:41.550739  653531 main.go:141] libmachine: (ha-735960-m02) DBG | About to run SSH command:

	I0701 12:24:41.550754  653531 main.go:141] libmachine: (ha-735960-m02) DBG | exit 0

	I0701 12:24:41.678305  653531 main.go:141] libmachine: (ha-735960-m02) DBG | SSH cmd err, output: <nil>: 

	I0701 12:24:41.678691  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetConfigRaw

	I0701 12:24:41.679334  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:24:41.682006  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:41.682508  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:41.682540  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:41.682792  653531 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:24:41.683005  653531 machine.go:94] provisionDockerMachine start ...

	I0701 12:24:41.683030  653531 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:24:41.683290  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:24:41.685599  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:41.685951  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:41.685979  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:41.686153  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:24:41.686378  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:41.686551  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:41.686684  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:24:41.686822  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:24:41.687030  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:24:41.687043  653531 main.go:141] libmachine: About to run SSH command:

	hostname

	I0701 12:24:41.802622  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0701 12:24:41.802657  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:24:41.802940  653531 buildroot.go:166] provisioning hostname "ha-735960-m02"

	I0701 12:24:41.802963  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:24:41.803281  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:24:41.805937  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:41.806443  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:41.806470  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:41.806608  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:24:41.806785  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:41.807003  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:41.807154  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:24:41.807371  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:24:41.807554  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:24:41.807567  653531 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-735960-m02 && echo "ha-735960-m02" | sudo tee /etc/hostname

	I0701 12:24:41.938306  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-735960-m02

	I0701 12:24:41.938353  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:24:41.941077  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:41.941535  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:41.941592  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:41.941765  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:24:41.941994  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:41.942161  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:41.942290  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:24:41.942491  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:24:41.942676  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:24:41.942701  653531 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-735960-m02' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-735960-m02/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-735960-m02' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0701 12:24:42.062715  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0701 12:24:42.062750  653531 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19166-630650/.minikube CaCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19166-630650/.minikube}

	I0701 12:24:42.062772  653531 buildroot.go:174] setting up certificates

	I0701 12:24:42.062785  653531 provision.go:84] configureAuth start

	I0701 12:24:42.062795  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetMachineName

	I0701 12:24:42.063134  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:24:42.065907  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:42.066246  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:42.066279  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:42.066490  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:24:42.068450  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:42.068818  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:42.068843  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:42.068957  653531 provision.go:143] copyHostCerts

	I0701 12:24:42.068988  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:24:42.069022  653531 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem, removing ...

	I0701 12:24:42.069030  653531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:24:42.069082  653531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem (1078 bytes)

	I0701 12:24:42.069156  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:24:42.069173  653531 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem, removing ...

	I0701 12:24:42.069180  653531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:24:42.069199  653531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem (1123 bytes)

	I0701 12:24:42.069241  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:24:42.069257  653531 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem, removing ...

	I0701 12:24:42.069263  653531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:24:42.069279  653531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem (1675 bytes)

	I0701 12:24:42.069326  653531 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem org=jenkins.ha-735960-m02 san=[127.0.0.1 192.168.39.86 ha-735960-m02 localhost minikube]

	I0701 12:24:42.315961  653531 provision.go:177] copyRemoteCerts

	I0701 12:24:42.316035  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0701 12:24:42.316061  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:24:42.318992  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:42.319361  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:42.319395  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:42.319557  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:24:42.319740  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:42.319969  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:24:42.320092  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:24:42.408924  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0701 12:24:42.408999  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0701 12:24:42.434942  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0701 12:24:42.435038  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0701 12:24:42.458628  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0701 12:24:42.458728  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0701 12:24:42.482505  653531 provision.go:87] duration metric: took 419.705556ms to configureAuth

	I0701 12:24:42.482536  653531 buildroot.go:189] setting minikube options for container-runtime

	I0701 12:24:42.482760  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:24:42.482797  653531 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:24:42.483103  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:24:42.485829  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:42.486249  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:42.486277  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:42.486574  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:24:42.486846  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:42.487031  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:42.487211  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:24:42.487420  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:24:42.487596  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:24:42.487608  653531 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0701 12:24:42.603937  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0701 12:24:42.603962  653531 buildroot.go:70] root file system type: tmpfs

	I0701 12:24:42.604101  653531 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0701 12:24:42.604123  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:24:42.606937  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:42.607326  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:42.607351  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:42.607512  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:24:42.607762  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:42.607935  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:42.608131  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:24:42.608318  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:24:42.608490  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:24:42.608578  653531 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment="NO_PROXY=192.168.39.16"

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0701 12:24:42.731927  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment=NO_PROXY=192.168.39.16

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0701 12:24:42.731963  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:24:42.735092  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:42.735552  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:42.735586  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:42.735721  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:24:42.735916  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:42.736097  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:42.736226  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:24:42.736425  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:24:42.736596  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:24:42.736613  653531 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0701 12:24:44.641546  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0701 12:24:44.641584  653531 machine.go:97] duration metric: took 2.958558644s to provisionDockerMachine

	I0701 12:24:44.641601  653531 start.go:293] postStartSetup for "ha-735960-m02" (driver="kvm2")

	I0701 12:24:44.641615  653531 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0701 12:24:44.641637  653531 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:24:44.642004  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0701 12:24:44.642040  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:24:44.645224  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:44.645706  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:44.645738  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:44.645868  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:24:44.646053  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:44.646222  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:24:44.646376  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:24:44.736407  653531 ssh_runner.go:195] Run: cat /etc/os-release

	I0701 12:24:44.740656  653531 info.go:137] Remote host: Buildroot 2023.02.9

	I0701 12:24:44.740682  653531 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/addons for local assets ...

	I0701 12:24:44.740758  653531 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/files for local assets ...

	I0701 12:24:44.740835  653531 filesync.go:149] local asset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> 6378542.pem in /etc/ssl/certs

	I0701 12:24:44.740848  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /etc/ssl/certs/6378542.pem

	I0701 12:24:44.740945  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0701 12:24:44.749928  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:24:44.772391  653531 start.go:296] duration metric: took 130.772957ms for postStartSetup

	I0701 12:24:44.772467  653531 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:24:44.772787  653531 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup

	I0701 12:24:44.772824  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:24:44.775217  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:44.775582  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:44.775607  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:44.775804  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:24:44.776027  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:44.776203  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:24:44.776383  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:24:44.864587  653531 machine.go:198] restoring vm config from /var/lib/minikube/backup: [etc]

	I0701 12:24:44.864665  653531 ssh_runner.go:195] Run: sudo rsync --archive --update /var/lib/minikube/backup/etc /

	I0701 12:24:44.904439  653531 fix.go:56] duration metric: took 18.361036234s for fixHost

	I0701 12:24:44.904495  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:24:44.907382  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:44.907911  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:44.907944  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:44.908260  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:24:44.908504  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:44.908689  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:44.908847  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:24:44.909036  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:24:44.909257  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.86 22 <nil> <nil>}

	I0701 12:24:44.909273  653531 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0701 12:24:45.022815  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: 1719836684.998547011

	I0701 12:24:45.022845  653531 fix.go:216] guest clock: 1719836684.998547011

	I0701 12:24:45.022855  653531 fix.go:229] Guest: 2024-07-01 12:24:44.998547011 +0000 UTC Remote: 2024-07-01 12:24:44.904469964 +0000 UTC m=+42.374321626 (delta=94.077047ms)

	I0701 12:24:45.022878  653531 fix.go:200] guest clock delta is within tolerance: 94.077047ms

	I0701 12:24:45.022885  653531 start.go:83] releasing machines lock for "ha-735960-m02", held for 18.479517819s

	I0701 12:24:45.022904  653531 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:24:45.023158  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:24:45.025946  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:45.026429  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:45.026468  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:45.028669  653531 out.go:177] * Found network options:

	I0701 12:24:45.030344  653531 out.go:177]   - NO_PROXY=192.168.39.16

	W0701 12:24:45.031921  653531 proxy.go:119] fail to check proxy env: Error ip not in block

	I0701 12:24:45.031959  653531 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:24:45.032658  653531 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:24:45.032888  653531 main.go:141] libmachine: (ha-735960-m02) Calling .DriverName

	I0701 12:24:45.033013  653531 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0701 12:24:45.033058  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	W0701 12:24:45.033081  653531 proxy.go:119] fail to check proxy env: Error ip not in block

	I0701 12:24:45.033171  653531 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I0701 12:24:45.033195  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHHostname

	I0701 12:24:45.035752  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:45.035981  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:45.036219  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:45.036245  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:45.036348  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:45.036378  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:45.036406  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:24:45.036593  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHPort

	I0701 12:24:45.036652  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:45.036754  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHKeyPath

	I0701 12:24:45.036826  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:24:45.036903  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetSSHUsername

	I0701 12:24:45.036969  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	I0701 12:24:45.037025  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.86 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m02/id_rsa Username:docker}

	W0701 12:24:45.137872  653531 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0701 12:24:45.137946  653531 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0701 12:24:45.154683  653531 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0701 12:24:45.154717  653531 start.go:494] detecting cgroup driver to use...

	I0701 12:24:45.154827  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:24:45.176886  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0701 12:24:45.188345  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0701 12:24:45.197947  653531 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0701 12:24:45.198012  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0701 12:24:45.207676  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:24:45.217559  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0701 12:24:45.227803  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:24:45.238295  653531 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0701 12:24:45.248764  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0701 12:24:45.258909  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0701 12:24:45.268726  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0701 12:24:45.279039  653531 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0701 12:24:45.288042  653531 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0701 12:24:45.296914  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:24:45.411404  653531 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0701 12:24:45.436012  653531 start.go:494] detecting cgroup driver to use...

	I0701 12:24:45.436122  653531 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0701 12:24:45.450142  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:24:45.462829  653531 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0701 12:24:45.481152  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:24:45.494283  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:24:45.507074  653531 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0701 12:24:45.534155  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:24:45.547185  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:24:45.564773  653531 ssh_runner.go:195] Run: which cri-dockerd

	I0701 12:24:45.568760  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0701 12:24:45.577542  653531 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0701 12:24:45.593021  653531 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0701 12:24:45.701211  653531 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0701 12:24:45.815750  653531 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0701 12:24:45.815810  653531 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0701 12:24:45.831989  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:24:45.941168  653531 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0701 12:24:48.340550  653531 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.399331326s)

	I0701 12:24:48.340643  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0701 12:24:48.354582  653531 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I0701 12:24:48.370449  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:24:48.383634  653531 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0701 12:24:48.491334  653531 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0701 12:24:48.612412  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:24:48.742773  653531 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0701 12:24:48.759856  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:24:48.772621  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:24:48.884376  653531 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0701 12:24:48.964457  653531 start.go:541] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0701 12:24:48.964538  653531 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0701 12:24:48.970016  653531 start.go:562] Will wait 60s for crictl version

	I0701 12:24:48.970082  653531 ssh_runner.go:195] Run: which crictl

	I0701 12:24:48.974017  653531 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0701 12:24:49.010380  653531 start.go:578] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.0.1

	RuntimeApiVersion:  v1

	I0701 12:24:49.010470  653531 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:24:49.038204  653531 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:24:49.060452  653531 out.go:204] * Preparing Kubernetes v1.30.2 on Docker 27.0.1 ...

	I0701 12:24:49.061662  653531 out.go:177]   - env NO_PROXY=192.168.39.16

	I0701 12:24:49.062894  653531 main.go:141] libmachine: (ha-735960-m02) Calling .GetIP

	I0701 12:24:49.065420  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:49.065726  653531 main.go:141] libmachine: (ha-735960-m02) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:0b:2f:ce", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:36 +0000 UTC Type:0 Mac:52:54:00:0b:2f:ce Iaid: IPaddr:192.168.39.86 Prefix:24 Hostname:ha-735960-m02 Clientid:01:52:54:00:0b:2f:ce}

	I0701 12:24:49.065756  653531 main.go:141] libmachine: (ha-735960-m02) DBG | domain ha-735960-m02 has defined IP address 192.168.39.86 and MAC address 52:54:00:0b:2f:ce in network mk-ha-735960

	I0701 12:24:49.065973  653531 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0701 12:24:49.070110  653531 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:24:49.082188  653531 mustload.go:65] Loading cluster: ha-735960

	I0701 12:24:49.082530  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:24:49.082941  653531 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:24:49.082993  653531 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:24:49.097892  653531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43153

	I0701 12:24:49.098396  653531 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:24:49.098894  653531 main.go:141] libmachine: Using API Version  1

	I0701 12:24:49.098917  653531 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:24:49.099215  653531 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:24:49.099436  653531 main.go:141] libmachine: (ha-735960) Calling .GetState

	I0701 12:24:49.100798  653531 host.go:66] Checking if "ha-735960" exists ...

	I0701 12:24:49.101079  653531 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:24:49.101112  653531 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:24:49.115736  653531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:34567

	I0701 12:24:49.116185  653531 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:24:49.116654  653531 main.go:141] libmachine: Using API Version  1

	I0701 12:24:49.116678  653531 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:24:49.117007  653531 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:24:49.117203  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:24:49.117366  653531 certs.go:68] Setting up /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960 for IP: 192.168.39.86

	I0701 12:24:49.117380  653531 certs.go:194] generating shared ca certs ...

	I0701 12:24:49.117398  653531 certs.go:226] acquiring lock for ca certs: {Name:mk34e166bfd069e523b2325e14d1812c523bff53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:24:49.117551  653531 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key

	I0701 12:24:49.117591  653531 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key

	I0701 12:24:49.117600  653531 certs.go:256] generating profile certs ...

	I0701 12:24:49.117669  653531 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key

	I0701 12:24:49.117728  653531 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.b19d6c48

	I0701 12:24:49.117760  653531 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key

	I0701 12:24:49.117771  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0701 12:24:49.117786  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0701 12:24:49.117800  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0701 12:24:49.117811  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0701 12:24:49.117823  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0701 12:24:49.117835  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0701 12:24:49.117847  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0701 12:24:49.117858  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0701 12:24:49.117903  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem (1338 bytes)

	W0701 12:24:49.117934  653531 certs.go:480] ignoring /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854_empty.pem, impossibly tiny 0 bytes

	I0701 12:24:49.117946  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem (1675 bytes)

	I0701 12:24:49.117973  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem (1078 bytes)

	I0701 12:24:49.117994  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem (1123 bytes)

	I0701 12:24:49.118013  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem (1675 bytes)

	I0701 12:24:49.118048  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:24:49.118076  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem -> /usr/share/ca-certificates/637854.pem

	I0701 12:24:49.118092  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /usr/share/ca-certificates/6378542.pem

	I0701 12:24:49.118104  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:24:49.118150  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:24:49.120907  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:49.121392  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:24:49.121418  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:24:49.121523  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:24:49.121694  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:24:49.121825  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:24:49.121959  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:24:49.190715  653531 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0701 12:24:49.195755  653531 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0701 12:24:49.206197  653531 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0701 12:24:49.209869  653531 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)

	I0701 12:24:49.219170  653531 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0701 12:24:49.223114  653531 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0701 12:24:49.233000  653531 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0701 12:24:49.237162  653531 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0701 12:24:49.246812  653531 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0701 12:24:49.250554  653531 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0701 12:24:49.259926  653531 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0701 12:24:49.263843  653531 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0701 12:24:49.274536  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0701 12:24:49.299467  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0701 12:24:49.322887  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0701 12:24:49.345311  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0701 12:24:49.367988  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)

	I0701 12:24:49.390632  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0701 12:24:49.416047  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0701 12:24:49.439560  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0701 12:24:49.462382  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem --> /usr/share/ca-certificates/637854.pem (1338 bytes)

	I0701 12:24:49.484590  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /usr/share/ca-certificates/6378542.pem (1708 bytes)

	I0701 12:24:49.507507  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0701 12:24:49.529932  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0701 12:24:49.545966  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)

	I0701 12:24:49.561557  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0701 12:24:49.577402  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0701 12:24:49.593250  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0701 12:24:49.609739  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0701 12:24:49.626015  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0701 12:24:49.643897  653531 ssh_runner.go:195] Run: openssl version

	I0701 12:24:49.649608  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/637854.pem && ln -fs /usr/share/ca-certificates/637854.pem /etc/ssl/certs/637854.pem"

	I0701 12:24:49.660203  653531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/637854.pem

	I0701 12:24:49.664449  653531 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul  1 12:11 /usr/share/ca-certificates/637854.pem

	I0701 12:24:49.664503  653531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/637854.pem

	I0701 12:24:49.670228  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/637854.pem /etc/ssl/certs/51391683.0"

	I0701 12:24:49.680554  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6378542.pem && ln -fs /usr/share/ca-certificates/6378542.pem /etc/ssl/certs/6378542.pem"

	I0701 12:24:49.690901  653531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6378542.pem

	I0701 12:24:49.695200  653531 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul  1 12:11 /usr/share/ca-certificates/6378542.pem

	I0701 12:24:49.695266  653531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6378542.pem

	I0701 12:24:49.700503  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/6378542.pem /etc/ssl/certs/3ec20f2e.0"

	I0701 12:24:49.710442  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0701 12:24:49.720297  653531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:24:49.724530  653531 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul  1 12:05 /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:24:49.724590  653531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:24:49.729832  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0701 12:24:49.739574  653531 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0701 12:24:49.743717  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I0701 12:24:49.749498  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I0701 12:24:49.755217  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I0701 12:24:49.761210  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I0701 12:24:49.767138  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I0701 12:24:49.772853  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I0701 12:24:49.778598  653531 kubeadm.go:928] updating node {m02 192.168.39.86 8443 v1.30.2 docker true true} ...

	I0701 12:24:49.778706  653531 kubeadm.go:940] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-735960-m02 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.86

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0701 12:24:49.778735  653531 kube-vip.go:115] generating kube-vip config ...

	I0701 12:24:49.778769  653531 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0701 12:24:49.792722  653531 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0701 12:24:49.792794  653531 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0701 12:24:49.792861  653531 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0701 12:24:49.804161  653531 binaries.go:44] Found k8s binaries, skipping transfer

	I0701 12:24:49.804241  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0701 12:24:49.814550  653531 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0701 12:24:49.831390  653531 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0701 12:24:49.848397  653531 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0701 12:24:49.865443  653531 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0701 12:24:49.869104  653531 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:24:49.880669  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:24:49.995061  653531 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0701 12:24:50.012084  653531 start.go:234] Will wait 6m0s for node &{Name:m02 IP:192.168.39.86 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0701 12:24:50.012461  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:24:50.014165  653531 out.go:177] * Verifying Kubernetes components...

	I0701 12:24:50.015753  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:24:50.164868  653531 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0701 12:24:50.189841  653531 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:24:50.190056  653531 kapi.go:59] client config for ha-735960: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.crt", KeyFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key", CAFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1cfbb80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0701 12:24:50.190130  653531 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.16:8443

	I0701 12:24:50.190323  653531 node_ready.go:35] waiting up to 6m0s for node "ha-735960-m02" to be "Ready" ...

	I0701 12:24:50.190456  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:24:50.190466  653531 round_trippers.go:469] Request Headers:

	I0701 12:24:50.190477  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:24:50.190487  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:24:54.343288  653531 round_trippers.go:574] Response Status:  in 4152 milliseconds

	I0701 12:24:55.343662  653531 with_retry.go:234] Got a Retry-After 1s response for attempt 1 to https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:24:55.343730  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:24:55.343744  653531 round_trippers.go:469] Request Headers:

	I0701 12:24:55.343754  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:24:55.343758  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:24:55.344302  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:24:55.344422  653531 node_ready.go:53] error getting node "ha-735960-m02": Get "https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.1:52872->192.168.39.16:8443: read: connection reset by peer

	I0701 12:24:55.344514  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:24:55.344528  653531 round_trippers.go:469] Request Headers:

	I0701 12:24:55.344538  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:24:55.344544  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:24:55.344874  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:24:55.691490  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:24:55.691516  653531 round_trippers.go:469] Request Headers:

	I0701 12:24:55.691527  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:24:55.691533  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:24:55.691976  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:24:56.190655  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:24:56.190680  653531 round_trippers.go:469] Request Headers:

	I0701 12:24:56.190689  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:24:56.190694  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:24:56.191223  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:24:56.690634  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:24:56.690660  653531 round_trippers.go:469] Request Headers:

	I0701 12:24:56.690669  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:24:56.690672  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:24:56.691171  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:24:57.190543  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:24:57.190576  653531 round_trippers.go:469] Request Headers:

	I0701 12:24:57.190588  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:24:57.190593  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:24:57.191164  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:24:57.691155  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:24:57.691185  653531 round_trippers.go:469] Request Headers:

	I0701 12:24:57.691197  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:24:57.691205  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:24:57.691722  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:24:57.691807  653531 node_ready.go:53] error getting node "ha-735960-m02": Get "https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02": dial tcp 192.168.39.16:8443: connect: connection refused

	I0701 12:24:58.190799  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:24:58.190827  653531 round_trippers.go:469] Request Headers:

	I0701 12:24:58.190841  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:24:58.190847  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:24:58.191262  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:24:58.690909  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:24:58.690934  653531 round_trippers.go:469] Request Headers:

	I0701 12:24:58.690943  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:24:58.690947  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:24:58.691435  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:24:59.191343  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:24:59.191369  653531 round_trippers.go:469] Request Headers:

	I0701 12:24:59.191379  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:24:59.191385  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:24:59.191790  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:24:59.691540  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:24:59.691570  653531 round_trippers.go:469] Request Headers:

	I0701 12:24:59.691582  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:24:59.691587  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:24:59.692063  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:24:59.692155  653531 node_ready.go:53] error getting node "ha-735960-m02": Get "https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02": dial tcp 192.168.39.16:8443: connect: connection refused

	I0701 12:25:00.190742  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:00.190767  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:00.190776  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:00.190780  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:00.191351  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:00.691648  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:00.691679  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:00.691691  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:00.691697  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:00.692126  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:01.190745  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:01.190769  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:01.190778  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:01.190784  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:01.191282  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:01.691565  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:01.691597  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:01.691614  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:01.691621  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:01.692000  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:02.191662  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:02.191693  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:02.191706  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:02.191714  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:02.192140  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:02.192224  653531 node_ready.go:53] error getting node "ha-735960-m02": Get "https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02": dial tcp 192.168.39.16:8443: connect: connection refused

	I0701 12:25:02.691148  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:02.691173  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:02.691180  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:02.691185  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:02.691566  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:03.190561  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:03.190591  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:03.190603  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:03.190611  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:03.191147  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:03.690811  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:03.690839  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:03.690849  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:03.690854  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:03.691458  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:04.191099  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:04.191130  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:04.191142  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:04.191147  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:04.191609  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:04.691342  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:04.691368  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:04.691376  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:04.691380  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:04.691811  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:04.691897  653531 node_ready.go:53] error getting node "ha-735960-m02": Get "https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02": dial tcp 192.168.39.16:8443: connect: connection refused

	I0701 12:25:05.191508  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:05.191532  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:05.191540  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:05.191550  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:05.192027  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:05.690552  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:05.690579  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:05.690588  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:05.690592  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:05.691114  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:06.190741  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:06.190773  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:06.190785  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:06.190790  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:06.191210  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:06.690600  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:06.690630  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:06.690640  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:06.690646  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:06.691129  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:07.191607  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:07.191631  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:07.191639  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:07.191643  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:07.192193  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:07.192283  653531 node_ready.go:53] error getting node "ha-735960-m02": Get "https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02": dial tcp 192.168.39.16:8443: connect: connection refused

	I0701 12:25:07.691099  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:07.691129  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:07.691140  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:07.691145  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:07.691572  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:08.191598  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:08.191623  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:08.191632  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:08.191636  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:08.192026  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:08.690679  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:08.690702  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:08.690713  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:08.690717  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:08.691142  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:09.190900  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:09.190924  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:09.190932  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:09.190938  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:09.191395  653531 round_trippers.go:574] Response Status:  in 0 milliseconds

	I0701 12:25:09.690594  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:09.690615  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:09.690623  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:09.690629  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:11.690040  653531 round_trippers.go:574] Response Status: 200 OK in 1999 milliseconds

	I0701 12:25:11.702263  653531 node_ready.go:49] node "ha-735960-m02" has status "Ready":"True"

	I0701 12:25:11.702299  653531 node_ready.go:38] duration metric: took 21.511933368s for node "ha-735960-m02" to be "Ready" ...

	I0701 12:25:11.702313  653531 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0701 12:25:11.702416  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods

	I0701 12:25:11.702430  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:11.702441  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:11.702454  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:11.789461  653531 round_trippers.go:574] Response Status: 200 OK in 86 milliseconds

	I0701 12:25:11.802344  653531 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace to be "Ready" ...

	I0701 12:25:11.802466  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:11.802476  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:11.802483  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:11.802487  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:11.816015  653531 round_trippers.go:574] Response Status: 200 OK in 13 milliseconds

	I0701 12:25:11.816768  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:11.816789  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:11.816801  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:11.816808  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:11.831063  653531 round_trippers.go:574] Response Status: 200 OK in 14 milliseconds

	I0701 12:25:12.302968  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:12.302992  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:12.303000  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:12.303004  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:12.307067  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:12.308122  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:12.308138  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:12.308146  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:12.308150  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:12.311874  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:12.803638  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:12.803667  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:12.803679  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:12.803686  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:12.814049  653531 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0701 12:25:12.814887  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:12.814910  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:12.814921  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:12.814925  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:12.821738  653531 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0701 12:25:13.303576  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:13.303600  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:13.303608  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:13.303614  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:13.307218  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:13.308090  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:13.308106  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:13.308113  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:13.308117  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:13.311302  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:13.803234  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:13.803266  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:13.803274  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:13.803277  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:13.806287  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:13.807004  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:13.807020  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:13.807029  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:13.807032  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:13.809746  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:13.810211  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:14.302637  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:14.302668  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:14.302676  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:14.302680  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:14.306137  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:14.306904  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:14.306920  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:14.306928  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:14.306932  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:14.309754  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:14.802564  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:14.802587  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:14.802595  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:14.802599  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:14.808775  653531 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0701 12:25:14.809568  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:14.809588  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:14.809596  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:14.809601  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:14.812414  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:15.303353  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:15.303378  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:15.303386  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:15.303391  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:15.306881  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:15.307679  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:15.307702  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:15.307712  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:15.307721  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:15.310551  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:15.802545  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:15.802569  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:15.802577  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:15.802582  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:15.806303  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:15.807445  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:15.807462  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:15.807473  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:15.807479  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:15.813688  653531 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0701 12:25:15.814187  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:16.303627  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:16.303655  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:16.303664  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:16.303667  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:16.307153  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:16.307819  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:16.307838  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:16.307848  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:16.307854  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:16.317298  653531 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds

	I0701 12:25:16.802946  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:16.802971  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:16.802979  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:16.802985  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:16.806421  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:16.807100  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:16.807120  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:16.807130  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:16.807135  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:16.809697  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:17.302581  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:17.302628  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:17.302640  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:17.302648  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:17.307226  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:17.307905  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:17.307922  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:17.307929  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:17.307936  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:17.311203  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:17.803470  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:17.803514  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:17.803526  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:17.803531  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:17.812734  653531 round_trippers.go:574] Response Status: 200 OK in 9 milliseconds

	I0701 12:25:17.813577  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:17.813595  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:17.813601  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:17.813608  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:17.818648  653531 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0701 12:25:17.819270  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:18.302575  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:18.302597  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:18.302605  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:18.302610  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:18.306847  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:18.307906  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:18.307927  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:18.307937  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:18.307943  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:18.310841  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:18.802657  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:18.802681  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:18.802689  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:18.802692  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:18.805685  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:18.806415  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:18.806434  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:18.806444  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:18.806451  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:18.809781  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:19.303618  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:19.303642  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:19.303650  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:19.303655  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:19.307473  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:19.308257  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:19.308275  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:19.308282  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:19.308286  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:19.311108  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:19.802669  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:19.802691  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:19.802700  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:19.802703  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:19.805915  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:19.806623  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:19.806641  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:19.806648  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:19.806653  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:19.809291  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:20.303135  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:20.303161  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:20.303169  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:20.303173  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:20.306861  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:20.307600  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:20.307618  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:20.307626  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:20.307630  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:20.310953  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:20.311503  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:20.803608  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:20.803633  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:20.803642  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:20.803645  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:20.807878  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:20.808941  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:20.808961  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:20.808969  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:20.808973  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:20.811817  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:21.303623  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:21.303648  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:21.303658  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:21.303662  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:21.307962  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:21.308821  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:21.308839  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:21.308846  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:21.308850  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:21.311792  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:21.803197  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:21.803227  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:21.803239  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:21.803244  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:21.806108  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:21.807085  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:21.807105  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:21.807138  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:21.807147  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:21.809757  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:22.302567  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:22.302593  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:22.302601  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:22.302608  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:22.306177  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:22.307066  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:22.307082  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:22.307091  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:22.307097  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:22.309849  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:22.803488  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:22.803511  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:22.803519  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:22.803523  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:22.807098  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:22.807809  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:22.807828  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:22.807839  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:22.807846  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:22.810906  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:22.811518  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:23.303611  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:23.303700  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:23.303719  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:23.303725  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:23.307759  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:23.308638  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:23.308659  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:23.308669  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:23.308674  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:23.312265  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:23.803188  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:23.803211  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:23.803222  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:23.803227  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:23.808854  653531 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0701 12:25:23.810030  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:23.810047  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:23.810057  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:23.810066  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:23.813689  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:24.303587  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:24.303609  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:24.303617  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:24.303622  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:24.306935  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:24.307770  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:24.307786  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:24.307794  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:24.307798  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:24.318402  653531 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0701 12:25:24.803269  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:24.803292  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:24.803302  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:24.803307  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:24.806559  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:24.807235  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:24.807252  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:24.807259  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:24.807264  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:24.809568  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:25.303424  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:25.303447  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:25.303457  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:25.303462  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:25.306169  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:25.306850  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:25.306869  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:25.306877  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:25.306881  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:25.309797  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:25.310316  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:25.803598  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:25.803625  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:25.803636  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:25.803641  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:25.807180  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:25.808080  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:25.808098  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:25.808106  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:25.808110  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:25.810694  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:26.303736  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:26.303758  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:26.303769  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:26.303774  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:26.307524  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:26.308268  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:26.308293  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:26.308304  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:26.308309  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:26.311520  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:26.803295  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:26.803319  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:26.803328  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:26.803332  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:26.806546  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:26.807183  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:26.807197  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:26.807204  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:26.807208  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:26.809974  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:27.302802  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:27.302827  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:27.302836  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:27.302840  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:27.305889  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:27.306573  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:27.306591  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:27.306598  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:27.306602  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:27.309203  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:27.802871  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:27.802896  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:27.802904  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:27.802908  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:27.806439  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:27.807255  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:27.807275  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:27.807283  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:27.807286  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:27.810137  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:27.810761  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:28.303255  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:28.303283  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:28.303295  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:28.303300  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:28.306809  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:28.307731  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:28.307752  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:28.307762  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:28.307768  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:28.311028  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:28.802544  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:28.802570  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:28.802580  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:28.802585  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:28.805960  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:28.806724  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:28.806740  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:28.806815  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:28.806826  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:28.809472  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:29.303397  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:29.303427  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:29.303438  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:29.303443  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:29.306785  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:29.307565  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:29.307584  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:29.307592  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:29.307596  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:29.310517  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:29.802683  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:29.802709  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:29.802717  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:29.802720  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:29.806680  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:29.807385  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:29.807404  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:29.807414  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:29.807420  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:29.810474  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:29.811143  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:30.303599  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:30.303629  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:30.303639  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:30.303643  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:30.307801  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:30.308475  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:30.308491  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:30.308498  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:30.308503  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:30.311947  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:30.802655  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:30.802680  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:30.802688  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:30.802692  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:30.806031  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:30.806743  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:30.806762  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:30.806769  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:30.806774  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:30.809315  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:31.303311  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:31.303340  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:31.303350  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:31.303354  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:31.306583  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:31.307361  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:31.307384  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:31.307395  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:31.307399  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:31.311058  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:31.802712  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:31.802740  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:31.802749  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:31.802753  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:31.806584  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:31.807317  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:31.807336  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:31.807347  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:31.807361  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:31.810401  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:32.303636  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:32.303663  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:32.303671  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:32.303676  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:32.307011  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:32.307797  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:32.307815  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:32.307825  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:32.307831  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:32.314944  653531 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0701 12:25:32.315492  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:32.802803  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:32.802830  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:32.802838  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:32.802844  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:32.807127  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:32.807884  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:32.807907  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:32.807917  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:32.807922  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:32.811565  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:33.303372  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:33.303399  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:33.303416  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:33.303421  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:33.307271  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:33.307961  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:33.307981  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:33.307988  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:33.308001  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:33.310760  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:33.802604  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:33.802631  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:33.802640  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:33.802643  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:33.806300  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:33.807219  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:33.807238  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:33.807245  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:33.807250  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:33.810578  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:34.303606  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:34.303632  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:34.303640  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:34.303644  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:34.308029  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:34.309132  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:34.309159  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:34.309172  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:34.309180  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:34.313056  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:34.803231  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:34.803261  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:34.803273  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:34.803278  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:34.806971  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:34.807591  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:34.807609  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:34.807617  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:34.807621  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:34.810457  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:34.810998  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:35.303350  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:35.303377  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:35.303386  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:35.303390  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:35.307557  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:35.310343  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:35.310361  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:35.310370  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:35.310374  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:35.314047  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:35.803318  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:35.803343  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:35.803352  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:35.803355  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:35.806663  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:35.807415  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:35.807435  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:35.807451  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:35.807460  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:35.810577  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:36.303513  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:36.303545  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:36.303577  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:36.303584  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:36.307367  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:36.308070  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:36.308089  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:36.308100  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:36.308106  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:36.312298  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:36.803266  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:36.803291  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:36.803299  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:36.803303  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:36.807158  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:36.807888  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:36.807906  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:36.807913  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:36.807918  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:36.811315  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:36.811752  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:37.303051  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:37.303079  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:37.303090  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:37.303094  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:37.307312  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:37.308243  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:37.308264  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:37.308275  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:37.308282  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:37.311883  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:37.802545  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:37.802572  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:37.802581  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:37.802585  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:37.805697  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:37.806592  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:37.806612  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:37.806622  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:37.806627  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:37.809149  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:38.302574  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:38.302602  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:38.302615  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:38.302621  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:38.306531  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:38.307159  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:38.307178  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:38.307189  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:38.307193  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:38.310496  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:38.803467  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:38.803495  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:38.803504  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:38.803509  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:38.807052  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:38.807927  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:38.807944  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:38.807951  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:38.807956  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:38.810712  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:39.302764  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:39.302790  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:39.302801  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:39.302805  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:39.306507  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:39.307614  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:39.307633  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:39.307641  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:39.307645  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:39.311327  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:39.311854  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:39.803193  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:39.803216  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:39.803225  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:39.803229  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:39.806519  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:39.807496  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:39.807515  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:39.807525  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:39.807532  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:39.810711  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:40.303599  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:40.303624  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:40.303633  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:40.303637  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:40.307414  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:40.308201  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:40.308227  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:40.308236  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:40.308242  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:40.313547  653531 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0701 12:25:40.803513  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:40.803535  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:40.803543  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:40.803548  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:40.806979  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:40.807738  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:40.807753  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:40.807761  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:40.807765  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:40.810649  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:41.303319  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:41.303343  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:41.303351  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:41.303355  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:41.307376  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:41.307943  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:41.307958  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:41.307965  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:41.307970  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:41.311161  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:41.803525  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:41.803549  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:41.803556  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:41.803559  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:41.806564  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:41.807431  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:41.807453  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:41.807464  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:41.807470  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:41.810527  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:41.811143  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:42.303619  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:42.303650  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:42.303662  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:42.303670  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:42.307838  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:42.308516  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:42.308536  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:42.308544  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:42.308550  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:42.312418  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:42.803505  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:42.803530  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:42.803540  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:42.803543  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:42.807116  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:42.808027  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:42.808044  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:42.808051  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:42.808055  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:42.810713  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:43.303632  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:43.303654  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:43.303664  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:43.303668  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:43.307247  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:43.307986  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:43.308002  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:43.308009  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:43.308013  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:43.310824  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:43.802592  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:43.802620  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:43.802628  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:43.802632  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:43.806238  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:43.807037  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:43.807059  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:43.807072  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:43.807076  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:43.809889  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:44.302994  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:44.303018  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:44.303026  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:44.303030  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:44.306644  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:44.307454  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:44.307470  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:44.307478  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:44.307482  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:44.311122  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:44.311762  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:44.803237  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:44.803267  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:44.803279  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:44.803286  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:44.807350  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:44.808020  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:44.808038  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:44.808045  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:44.808051  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:44.810846  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:45.302711  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:45.302735  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:45.302744  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:45.302748  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:45.306615  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:45.307478  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:45.307497  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:45.307508  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:45.307514  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:45.310453  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:45.803401  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:45.803428  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:45.803439  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:45.803444  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:45.807308  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:45.808014  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:45.808029  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:45.808036  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:45.808039  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:45.810822  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:46.302557  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:46.302584  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:46.302597  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:46.302601  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:46.306132  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:46.306862  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:46.306879  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:46.306888  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:46.306894  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:46.310611  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:46.803427  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:46.803455  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:46.803467  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:46.803474  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:46.807174  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:46.807896  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:46.807913  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:46.807921  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:46.807924  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:46.810938  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:46.811392  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:47.302820  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:47.302850  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:47.302859  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:47.302863  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:47.306419  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:47.307190  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:47.307211  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:47.307218  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:47.307222  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:47.309980  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:47.803501  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:47.803525  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:47.803534  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:47.803537  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:47.808075  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:47.808877  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:47.808896  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:47.808905  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:47.808910  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:47.815820  653531 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0701 12:25:48.302668  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:48.302699  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:48.302709  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:48.302716  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:48.308126  653531 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0701 12:25:48.308931  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:48.308949  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:48.308960  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:48.308965  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:48.317071  653531 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0701 12:25:48.802646  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:48.802669  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:48.802678  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:48.802682  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:48.807515  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:48.808381  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:48.808403  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:48.808413  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:48.808422  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:48.811034  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:48.811475  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:49.303193  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:49.303217  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:49.303225  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:49.303230  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:49.307574  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:49.308269  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:49.308285  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:49.308293  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:49.308297  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:49.312047  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:49.802745  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:49.802768  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:49.802776  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:49.802780  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:49.806546  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:49.807294  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:49.807313  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:49.807321  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:49.807326  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:49.810700  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:50.303644  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:50.303674  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:50.303684  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:50.303688  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:50.308034  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:50.308788  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:50.308807  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:50.308817  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:50.308823  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:50.313190  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:50.802959  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:50.802983  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:50.802992  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:50.802996  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:50.806875  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:50.807540  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:50.807558  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:50.807566  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:50.807571  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:50.810319  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:51.303292  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:51.303322  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:51.303334  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:51.303339  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:51.307067  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:51.307838  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:51.307858  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:51.307869  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:51.307875  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:51.312843  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:51.313579  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:51.803287  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:51.803312  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:51.803323  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:51.803329  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:51.807231  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:51.807995  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:51.808012  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:51.808020  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:51.808024  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:51.810740  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:52.303605  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:52.303629  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:52.303638  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:52.303643  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:52.306821  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:52.307565  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:52.307584  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:52.307594  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:52.307602  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:52.311075  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:52.803586  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:52.803610  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:52.803619  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:52.803623  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:52.807457  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:52.808236  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:52.808255  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:52.808266  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:52.808272  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:52.811703  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:53.303621  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:53.303644  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:53.303652  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:53.303656  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:53.310115  653531 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0701 12:25:53.310845  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:53.310863  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:53.310874  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:53.310878  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:53.313553  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:53.314016  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:53.803325  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:53.803349  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:53.803357  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:53.803361  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:53.806896  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:53.807585  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:53.807601  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:53.807608  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:53.807613  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:53.810245  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:54.302928  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:54.302952  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:54.302960  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:54.302963  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:54.306523  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:54.307165  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:54.307184  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:54.307195  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:54.307203  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:54.310455  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:54.803344  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:54.803367  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:54.803377  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:54.803380  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:54.806607  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:54.807210  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:54.807225  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:54.807233  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:54.807236  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:54.809746  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:55.303597  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:55.303623  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:55.303633  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:55.303637  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:55.307054  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:55.307759  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:55.307774  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:55.307781  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:55.307788  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:55.313043  653531 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0701 12:25:55.802698  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:55.802725  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:55.802736  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:55.802745  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:55.805918  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:55.806665  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:55.806682  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:55.806690  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:55.806694  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:55.809347  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:55.809833  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:56.303433  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:56.303460  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:56.303471  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:56.303479  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:56.307327  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:56.308094  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:56.308118  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:56.308126  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:56.308130  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:56.311241  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:56.803577  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:56.803605  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:56.803612  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:56.803616  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:56.806932  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:56.807699  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:56.807716  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:56.807724  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:56.807727  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:56.812547  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:57.303545  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:57.303573  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:57.303582  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:57.303586  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:57.307516  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:57.308162  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:57.308179  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:57.308186  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:57.308193  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:57.310961  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:57.803457  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:57.803482  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:57.803493  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:57.803500  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:57.807806  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:57.808679  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:57.808694  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:57.808704  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:57.808711  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:57.811544  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:57.811984  653531 pod_ready.go:102] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"False"

	I0701 12:25:58.303446  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:58.303471  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:58.303480  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:58.303484  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:58.307082  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:58.307737  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:58.307754  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:58.307762  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:58.307770  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:58.310778  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:58.803647  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:58.803671  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:58.803680  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:58.803690  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:58.807621  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:58.808241  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:58.808258  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:58.808266  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:58.808271  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:58.811002  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:59.302934  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:59.302961  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:59.302971  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:59.302976  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:59.306476  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:59.307188  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:59.307205  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:59.307213  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:59.307216  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:59.312012  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:25:59.803004  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:25:59.803028  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:59.803037  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:59.803041  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:59.806220  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:59.807058  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:59.807077  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:59.807083  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:59.807087  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:59.810042  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:59.810618  653531 pod_ready.go:92] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"True"

	I0701 12:25:59.810639  653531 pod_ready.go:81] duration metric: took 48.008262746s for pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace to be "Ready" ...

	I0701 12:25:59.810648  653531 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-p4rtz" in "kube-system" namespace to be "Ready" ...

	I0701 12:25:59.810702  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-p4rtz

	I0701 12:25:59.810709  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:59.810716  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:59.810720  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:59.813396  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:59.813957  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:59.813972  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:59.813979  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:59.813982  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:59.816606  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:59.816994  653531 pod_ready.go:92] pod "coredns-7db6d8ff4d-p4rtz" in "kube-system" namespace has status "Ready":"True"

	I0701 12:25:59.817012  653531 pod_ready.go:81] duration metric: took 6.357752ms for pod "coredns-7db6d8ff4d-p4rtz" in "kube-system" namespace to be "Ready" ...

	I0701 12:25:59.817021  653531 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:25:59.817069  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960

	I0701 12:25:59.817076  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:59.817084  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:59.817090  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:59.819509  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:59.819970  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:25:59.819984  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:59.819991  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:59.819995  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:59.822382  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:59.822919  653531 pod_ready.go:92] pod "etcd-ha-735960" in "kube-system" namespace has status "Ready":"True"

	I0701 12:25:59.822941  653531 pod_ready.go:81] duration metric: took 5.912537ms for pod "etcd-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:25:59.822951  653531 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:25:59.823013  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m02

	I0701 12:25:59.823021  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:59.823028  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:59.823032  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:59.825241  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:59.825771  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:25:59.825785  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:59.825791  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:59.825795  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:59.828111  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:59.828706  653531 pod_ready.go:92] pod "etcd-ha-735960-m02" in "kube-system" namespace has status "Ready":"True"

	I0701 12:25:59.828725  653531 pod_ready.go:81] duration metric: took 5.760203ms for pod "etcd-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:25:59.828740  653531 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:25:59.828804  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:25:59.828813  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:59.828820  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:59.828827  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:59.832068  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:25:59.832863  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:25:59.832878  653531 round_trippers.go:469] Request Headers:

	I0701 12:25:59.832885  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:25:59.832892  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:25:59.835452  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:25:59.835992  653531 pod_ready.go:97] node "ha-735960-m03" hosting pod "etcd-ha-735960-m03" in "kube-system" namespace is currently not "Ready" (skipping!): node "ha-735960-m03" has status "Ready":"Unknown"

	I0701 12:25:59.836024  653531 pod_ready.go:81] duration metric: took 7.273472ms for pod "etcd-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	E0701 12:25:59.836031  653531 pod_ready.go:66] WaitExtra: waitPodCondition: node "ha-735960-m03" hosting pod "etcd-ha-735960-m03" in "kube-system" namespace is currently not "Ready" (skipping!): node "ha-735960-m03" has status "Ready":"Unknown"

	I0701 12:25:59.836046  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:00.003492  653531 request.go:629] Waited for 167.376104ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960

	I0701 12:26:00.003566  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960

	I0701 12:26:00.003574  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:00.003585  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:00.003603  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:00.011681  653531 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0701 12:26:00.203578  653531 request.go:629] Waited for 191.210292ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:26:00.203641  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:26:00.203647  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:00.203654  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:00.203664  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:00.207391  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:00.207910  653531 pod_ready.go:92] pod "kube-apiserver-ha-735960" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:00.207934  653531 pod_ready.go:81] duration metric: took 371.877302ms for pod "kube-apiserver-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:00.207946  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:00.403020  653531 request.go:629] Waited for 194.98389ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m02

	I0701 12:26:00.403111  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m02

	I0701 12:26:00.403119  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:00.403141  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:00.403168  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:00.406515  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:00.603670  653531 request.go:629] Waited for 196.408497ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:26:00.603756  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:26:00.603766  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:00.603776  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:00.603787  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:00.607641  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:00.608254  653531 pod_ready.go:92] pod "kube-apiserver-ha-735960-m02" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:00.608279  653531 pod_ready.go:81] duration metric: took 400.3268ms for pod "kube-apiserver-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:00.608290  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:00.803335  653531 request.go:629] Waited for 194.970976ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:26:00.803416  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:26:00.803423  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:00.803432  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:00.803437  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:00.806887  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:01.003849  653531 request.go:629] Waited for 196.371058ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:01.003924  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:01.003931  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:01.003942  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:01.003947  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:01.007167  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:01.007625  653531 pod_ready.go:97] node "ha-735960-m03" hosting pod "kube-apiserver-ha-735960-m03" in "kube-system" namespace is currently not "Ready" (skipping!): node "ha-735960-m03" has status "Ready":"Unknown"

	I0701 12:26:01.007649  653531 pod_ready.go:81] duration metric: took 399.353356ms for pod "kube-apiserver-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	E0701 12:26:01.007659  653531 pod_ready.go:66] WaitExtra: waitPodCondition: node "ha-735960-m03" hosting pod "kube-apiserver-ha-735960-m03" in "kube-system" namespace is currently not "Ready" (skipping!): node "ha-735960-m03" has status "Ready":"Unknown"

	I0701 12:26:01.007667  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:01.203752  653531 request.go:629] Waited for 195.992128ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960

	I0701 12:26:01.203816  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960

	I0701 12:26:01.203821  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:01.203829  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:01.203835  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:01.207391  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:01.403364  653531 request.go:629] Waited for 195.371527ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:26:01.403446  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:26:01.403452  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:01.403460  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:01.403464  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:01.406768  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:01.407262  653531 pod_ready.go:92] pod "kube-controller-manager-ha-735960" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:01.407282  653531 pod_ready.go:81] duration metric: took 399.606397ms for pod "kube-controller-manager-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:01.407291  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:01.603806  653531 request.go:629] Waited for 196.426419ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960-m02

	I0701 12:26:01.603868  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960-m02

	I0701 12:26:01.603877  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:01.603885  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:01.603889  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:01.607133  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:01.803115  653531 request.go:629] Waited for 195.29931ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:26:01.803195  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:26:01.803202  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:01.803213  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:01.803220  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:01.806296  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:01.806997  653531 pod_ready.go:92] pod "kube-controller-manager-ha-735960-m02" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:01.807020  653531 pod_ready.go:81] duration metric: took 399.723075ms for pod "kube-controller-manager-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:01.807032  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:02.003077  653531 request.go:629] Waited for 195.935538ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960-m03

	I0701 12:26:02.003184  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960-m03

	I0701 12:26:02.003199  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:02.003212  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:02.003220  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:02.008458  653531 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0701 12:26:02.203469  653531 request.go:629] Waited for 194.368942ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:02.203529  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:02.203535  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:02.203542  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:02.203546  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:02.207148  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:02.207764  653531 pod_ready.go:97] node "ha-735960-m03" hosting pod "kube-controller-manager-ha-735960-m03" in "kube-system" namespace is currently not "Ready" (skipping!): node "ha-735960-m03" has status "Ready":"Unknown"

	I0701 12:26:02.207791  653531 pod_ready.go:81] duration metric: took 400.749537ms for pod "kube-controller-manager-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	E0701 12:26:02.207804  653531 pod_ready.go:66] WaitExtra: waitPodCondition: node "ha-735960-m03" hosting pod "kube-controller-manager-ha-735960-m03" in "kube-system" namespace is currently not "Ready" (skipping!): node "ha-735960-m03" has status "Ready":"Unknown"

	I0701 12:26:02.207816  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-25ssf" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:02.403791  653531 request.go:629] Waited for 195.887211ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-25ssf

	I0701 12:26:02.403858  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-25ssf

	I0701 12:26:02.403864  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:02.403874  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:02.403879  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:02.407843  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:02.603935  653531 request.go:629] Waited for 195.282891ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m04

	I0701 12:26:02.604003  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m04

	I0701 12:26:02.604008  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:02.604017  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:02.604024  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:02.607222  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:02.607681  653531 pod_ready.go:97] node "ha-735960-m04" hosting pod "kube-proxy-25ssf" in "kube-system" namespace is currently not "Ready" (skipping!): node "ha-735960-m04" has status "Ready":"Unknown"

	I0701 12:26:02.607701  653531 pod_ready.go:81] duration metric: took 399.872451ms for pod "kube-proxy-25ssf" in "kube-system" namespace to be "Ready" ...

	E0701 12:26:02.607710  653531 pod_ready.go:66] WaitExtra: waitPodCondition: node "ha-735960-m04" hosting pod "kube-proxy-25ssf" in "kube-system" namespace is currently not "Ready" (skipping!): node "ha-735960-m04" has status "Ready":"Unknown"

	I0701 12:26:02.607715  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-776rt" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:02.803135  653531 request.go:629] Waited for 195.335441ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-776rt

	I0701 12:26:02.803208  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-776rt

	I0701 12:26:02.803214  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:02.803221  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:02.803229  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:02.806089  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:03.004065  653531 request.go:629] Waited for 197.373789ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:03.004141  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:03.004150  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:03.004158  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:03.004174  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:03.007294  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:03.007921  653531 pod_ready.go:97] node "ha-735960-m03" hosting pod "kube-proxy-776rt" in "kube-system" namespace is currently not "Ready" (skipping!): node "ha-735960-m03" has status "Ready":"Unknown"

	I0701 12:26:03.007945  653531 pod_ready.go:81] duration metric: took 400.223567ms for pod "kube-proxy-776rt" in "kube-system" namespace to be "Ready" ...

	E0701 12:26:03.007955  653531 pod_ready.go:66] WaitExtra: waitPodCondition: node "ha-735960-m03" hosting pod "kube-proxy-776rt" in "kube-system" namespace is currently not "Ready" (skipping!): node "ha-735960-m03" has status "Ready":"Unknown"

	I0701 12:26:03.007961  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-b6knb" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:03.204042  653531 request.go:629] Waited for 195.997795ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-b6knb

	I0701 12:26:03.204129  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-b6knb

	I0701 12:26:03.204135  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:03.204143  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:03.204151  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:03.207989  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:03.404038  653531 request.go:629] Waited for 195.374708ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:26:03.404108  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:26:03.404113  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:03.404122  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:03.404127  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:03.407364  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:03.407859  653531 pod_ready.go:92] pod "kube-proxy-b6knb" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:03.407879  653531 pod_ready.go:81] duration metric: took 399.911763ms for pod "kube-proxy-b6knb" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:03.407889  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-lphzn" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:03.603040  653531 request.go:629] Waited for 195.068023ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-lphzn

	I0701 12:26:03.603123  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-lphzn

	I0701 12:26:03.603128  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:03.603137  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:03.603141  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:03.606547  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:03.803798  653531 request.go:629] Waited for 196.387613ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:26:03.803870  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:26:03.803875  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:03.803883  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:03.803888  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:03.807381  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:03.807877  653531 pod_ready.go:92] pod "kube-proxy-lphzn" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:03.807898  653531 pod_ready.go:81] duration metric: took 400.000751ms for pod "kube-proxy-lphzn" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:03.807907  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:04.004031  653531 request.go:629] Waited for 196.031388ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960

	I0701 12:26:04.004089  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960

	I0701 12:26:04.004095  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:04.004107  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:04.004115  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:04.007598  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:04.204058  653531 request.go:629] Waited for 195.850938ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:26:04.204148  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:26:04.204158  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:04.204172  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:04.204181  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:04.207457  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:04.208086  653531 pod_ready.go:92] pod "kube-scheduler-ha-735960" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:04.208102  653531 pod_ready.go:81] duration metric: took 400.189366ms for pod "kube-scheduler-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:04.208112  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:04.403245  653531 request.go:629] Waited for 195.048743ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960-m02

	I0701 12:26:04.403318  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960-m02

	I0701 12:26:04.403323  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:04.403331  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:04.403335  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:04.406662  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:04.603781  653531 request.go:629] Waited for 196.396031ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:26:04.603851  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:26:04.603858  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:04.603868  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:04.603872  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:04.607382  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:04.607837  653531 pod_ready.go:92] pod "kube-scheduler-ha-735960-m02" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:04.607857  653531 pod_ready.go:81] duration metric: took 399.737176ms for pod "kube-scheduler-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:04.607869  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:04.803931  653531 request.go:629] Waited for 195.967281ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960-m03

	I0701 12:26:04.804004  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960-m03

	I0701 12:26:04.804010  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:04.804018  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:04.804025  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:04.807572  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:05.003764  653531 request.go:629] Waited for 195.365798ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:05.003830  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:05.003836  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:05.003844  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:05.003852  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:05.006888  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:05.007360  653531 pod_ready.go:97] node "ha-735960-m03" hosting pod "kube-scheduler-ha-735960-m03" in "kube-system" namespace is currently not "Ready" (skipping!): node "ha-735960-m03" has status "Ready":"Unknown"

	I0701 12:26:05.007379  653531 pod_ready.go:81] duration metric: took 399.502183ms for pod "kube-scheduler-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	E0701 12:26:05.007388  653531 pod_ready.go:66] WaitExtra: waitPodCondition: node "ha-735960-m03" hosting pod "kube-scheduler-ha-735960-m03" in "kube-system" namespace is currently not "Ready" (skipping!): node "ha-735960-m03" has status "Ready":"Unknown"

	I0701 12:26:05.007396  653531 pod_ready.go:38] duration metric: took 53.305072048s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0701 12:26:05.007419  653531 api_server.go:52] waiting for apiserver process to appear ...

	I0701 12:26:05.007525  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I0701 12:26:05.023687  653531 logs.go:276] 2 containers: [f615f587cb12 c36c1d459356]

	I0701 12:26:05.023779  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I0701 12:26:05.041137  653531 logs.go:276] 2 containers: [68c63c4abd01 dff0f4abea41]

	I0701 12:26:05.041235  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I0701 12:26:05.059910  653531 logs.go:276] 0 containers: []

	W0701 12:26:05.059939  653531 logs.go:278] No container was found matching "coredns"

	I0701 12:26:05.060005  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I0701 12:26:05.076858  653531 logs.go:276] 2 containers: [279483668a9c 58811626a0de]

	I0701 12:26:05.076953  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I0701 12:26:05.091973  653531 logs.go:276] 2 containers: [156169e4ac3c 2885f7cf6f93]

	I0701 12:26:05.092072  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I0701 12:26:05.109350  653531 logs.go:276] 2 containers: [a72e102b5bf7 a1160a455902]

	I0701 12:26:05.109445  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I0701 12:26:05.126947  653531 logs.go:276] 2 containers: [c8184f4bc096 8c3a5ac0cf85]

	I0701 12:26:05.127013  653531 logs.go:123] Gathering logs for container status ...

	I0701 12:26:05.127032  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I0701 12:26:05.172758  653531 logs.go:123] Gathering logs for describe nodes ...

	I0701 12:26:05.172800  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I0701 12:26:05.530082  653531 logs.go:123] Gathering logs for kube-apiserver [f615f587cb12] ...

	I0701 12:26:05.530114  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f615f587cb12"

	I0701 12:26:05.563833  653531 logs.go:123] Gathering logs for kube-apiserver [c36c1d459356] ...

	I0701 12:26:05.563866  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c36c1d459356"

	I0701 12:26:05.633259  653531 logs.go:123] Gathering logs for etcd [dff0f4abea41] ...

	I0701 12:26:05.633305  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dff0f4abea41"

	I0701 12:26:05.672146  653531 logs.go:123] Gathering logs for kube-scheduler [58811626a0de] ...

	I0701 12:26:05.672187  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 58811626a0de"

	I0701 12:26:05.693508  653531 logs.go:123] Gathering logs for kube-proxy [2885f7cf6f93] ...

	I0701 12:26:05.693553  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2885f7cf6f93"

	I0701 12:26:05.717857  653531 logs.go:123] Gathering logs for Docker ...

	I0701 12:26:05.717889  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I0701 12:26:05.766696  653531 logs.go:123] Gathering logs for dmesg ...

	I0701 12:26:05.766736  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I0701 12:26:05.781553  653531 logs.go:123] Gathering logs for kube-proxy [156169e4ac3c] ...

	I0701 12:26:05.781587  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 156169e4ac3c"

	I0701 12:26:05.807724  653531 logs.go:123] Gathering logs for kindnet [8c3a5ac0cf85] ...

	I0701 12:26:05.807758  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8c3a5ac0cf85"

	I0701 12:26:05.830042  653531 logs.go:123] Gathering logs for etcd [68c63c4abd01] ...

	I0701 12:26:05.830072  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 68c63c4abd01"

	I0701 12:26:05.862525  653531 logs.go:123] Gathering logs for kube-controller-manager [a72e102b5bf7] ...

	I0701 12:26:05.862568  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a72e102b5bf7"

	I0701 12:26:05.901329  653531 logs.go:123] Gathering logs for kube-controller-manager [a1160a455902] ...

	I0701 12:26:05.901370  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1160a455902"

	I0701 12:26:05.942097  653531 logs.go:123] Gathering logs for kindnet [c8184f4bc096] ...

	I0701 12:26:05.942139  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c8184f4bc096"

	I0701 12:26:05.964792  653531 logs.go:123] Gathering logs for kubelet ...

	I0701 12:26:05.964829  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I0701 12:26:06.027347  653531 logs.go:123] Gathering logs for kube-scheduler [279483668a9c] ...

	I0701 12:26:06.027394  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 279483668a9c"

	I0701 12:26:08.550396  653531 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0701 12:26:08.565837  653531 api_server.go:72] duration metric: took 1m18.553699317s to wait for apiserver process to appear ...

	I0701 12:26:08.565866  653531 api_server.go:88] waiting for apiserver healthz status ...

	I0701 12:26:08.565941  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I0701 12:26:08.584274  653531 logs.go:276] 2 containers: [f615f587cb12 c36c1d459356]

	I0701 12:26:08.584349  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I0701 12:26:08.601551  653531 logs.go:276] 2 containers: [68c63c4abd01 dff0f4abea41]

	I0701 12:26:08.601633  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I0701 12:26:08.619657  653531 logs.go:276] 0 containers: []

	W0701 12:26:08.619687  653531 logs.go:278] No container was found matching "coredns"

	I0701 12:26:08.619744  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I0701 12:26:08.637393  653531 logs.go:276] 2 containers: [279483668a9c 58811626a0de]

	I0701 12:26:08.637473  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I0701 12:26:08.662222  653531 logs.go:276] 2 containers: [156169e4ac3c 2885f7cf6f93]

	I0701 12:26:08.662307  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I0701 12:26:08.678542  653531 logs.go:276] 2 containers: [a72e102b5bf7 a1160a455902]

	I0701 12:26:08.678649  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I0701 12:26:08.698914  653531 logs.go:276] 2 containers: [c8184f4bc096 8c3a5ac0cf85]

	I0701 12:26:08.698956  653531 logs.go:123] Gathering logs for kube-scheduler [58811626a0de] ...

	I0701 12:26:08.698968  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 58811626a0de"

	I0701 12:26:08.722744  653531 logs.go:123] Gathering logs for kube-controller-manager [a72e102b5bf7] ...

	I0701 12:26:08.722780  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a72e102b5bf7"

	I0701 12:26:08.767782  653531 logs.go:123] Gathering logs for kindnet [8c3a5ac0cf85] ...

	I0701 12:26:08.767825  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8c3a5ac0cf85"

	I0701 12:26:08.792700  653531 logs.go:123] Gathering logs for Docker ...

	I0701 12:26:08.792731  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I0701 12:26:08.841902  653531 logs.go:123] Gathering logs for container status ...

	I0701 12:26:08.841943  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I0701 12:26:08.885531  653531 logs.go:123] Gathering logs for kubelet ...

	I0701 12:26:08.885563  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I0701 12:26:08.940130  653531 logs.go:123] Gathering logs for etcd [68c63c4abd01] ...

	I0701 12:26:08.940179  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 68c63c4abd01"

	I0701 12:26:08.973841  653531 logs.go:123] Gathering logs for etcd [dff0f4abea41] ...

	I0701 12:26:08.973883  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dff0f4abea41"

	I0701 12:26:09.008785  653531 logs.go:123] Gathering logs for kube-apiserver [f615f587cb12] ...

	I0701 12:26:09.008824  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f615f587cb12"

	I0701 12:26:09.040512  653531 logs.go:123] Gathering logs for kube-apiserver [c36c1d459356] ...

	I0701 12:26:09.040568  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c36c1d459356"

	I0701 12:26:09.135818  653531 logs.go:123] Gathering logs for kube-scheduler [279483668a9c] ...

	I0701 12:26:09.135876  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 279483668a9c"

	I0701 12:26:09.158758  653531 logs.go:123] Gathering logs for describe nodes ...

	I0701 12:26:09.158802  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I0701 12:26:09.415637  653531 logs.go:123] Gathering logs for kube-proxy [2885f7cf6f93] ...

	I0701 12:26:09.415685  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2885f7cf6f93"

	I0701 12:26:09.438064  653531 logs.go:123] Gathering logs for kindnet [c8184f4bc096] ...

	I0701 12:26:09.438104  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c8184f4bc096"

	I0701 12:26:09.463612  653531 logs.go:123] Gathering logs for dmesg ...

	I0701 12:26:09.463666  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I0701 12:26:09.477906  653531 logs.go:123] Gathering logs for kube-proxy [156169e4ac3c] ...

	I0701 12:26:09.477936  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 156169e4ac3c"

	I0701 12:26:09.501662  653531 logs.go:123] Gathering logs for kube-controller-manager [a1160a455902] ...

	I0701 12:26:09.501704  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1160a455902"

	I0701 12:26:12.049246  653531 api_server.go:253] Checking apiserver healthz at https://192.168.39.16:8443/healthz ...

	I0701 12:26:12.055739  653531 api_server.go:279] https://192.168.39.16:8443/healthz returned 200:

	ok

	I0701 12:26:12.055824  653531 round_trippers.go:463] GET https://192.168.39.16:8443/version

	I0701 12:26:12.055829  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:12.055837  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:12.055841  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:12.056892  653531 round_trippers.go:574] Response Status: 200 OK in 1 milliseconds

	I0701 12:26:12.057034  653531 api_server.go:141] control plane version: v1.30.2

	I0701 12:26:12.057055  653531 api_server.go:131] duration metric: took 3.491183076s to wait for apiserver health ...

	I0701 12:26:12.057064  653531 system_pods.go:43] waiting for kube-system pods to appear ...

	I0701 12:26:12.057160  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-apiserver --format={{.ID}}

	I0701 12:26:12.074309  653531 logs.go:276] 2 containers: [f615f587cb12 c36c1d459356]

	I0701 12:26:12.074405  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_etcd --format={{.ID}}

	I0701 12:26:12.100040  653531 logs.go:276] 2 containers: [68c63c4abd01 dff0f4abea41]

	I0701 12:26:12.100116  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_coredns --format={{.ID}}

	I0701 12:26:12.119321  653531 logs.go:276] 0 containers: []

	W0701 12:26:12.119352  653531 logs.go:278] No container was found matching "coredns"

	I0701 12:26:12.119406  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-scheduler --format={{.ID}}

	I0701 12:26:12.137547  653531 logs.go:276] 2 containers: [279483668a9c 58811626a0de]

	I0701 12:26:12.137660  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-proxy --format={{.ID}}

	I0701 12:26:12.157321  653531 logs.go:276] 2 containers: [156169e4ac3c 2885f7cf6f93]

	I0701 12:26:12.157417  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kube-controller-manager --format={{.ID}}

	I0701 12:26:12.182117  653531 logs.go:276] 2 containers: [a72e102b5bf7 a1160a455902]

	I0701 12:26:12.182204  653531 ssh_runner.go:195] Run: docker ps -a --filter=name=k8s_kindnet --format={{.ID}}

	I0701 12:26:12.204201  653531 logs.go:276] 2 containers: [c8184f4bc096 8c3a5ac0cf85]

	I0701 12:26:12.204247  653531 logs.go:123] Gathering logs for kube-proxy [2885f7cf6f93] ...

	I0701 12:26:12.204260  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 2885f7cf6f93"

	I0701 12:26:12.228173  653531 logs.go:123] Gathering logs for kube-controller-manager [a72e102b5bf7] ...

	I0701 12:26:12.228206  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a72e102b5bf7"

	I0701 12:26:12.267264  653531 logs.go:123] Gathering logs for kindnet [c8184f4bc096] ...

	I0701 12:26:12.267309  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c8184f4bc096"

	I0701 12:26:12.294504  653531 logs.go:123] Gathering logs for Docker ...

	I0701 12:26:12.294535  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u docker -u cri-docker -n 400"

	I0701 12:26:12.344610  653531 logs.go:123] Gathering logs for describe nodes ...

	I0701 12:26:12.344649  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo /var/lib/minikube/binaries/v1.30.2/kubectl describe nodes --kubeconfig=/var/lib/minikube/kubeconfig"

	I0701 12:26:12.593887  653531 logs.go:123] Gathering logs for kube-apiserver [c36c1d459356] ...

	I0701 12:26:12.593927  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 c36c1d459356"

	I0701 12:26:12.665033  653531 logs.go:123] Gathering logs for kube-proxy [156169e4ac3c] ...

	I0701 12:26:12.665082  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 156169e4ac3c"

	I0701 12:26:12.687103  653531 logs.go:123] Gathering logs for container status ...

	I0701 12:26:12.687142  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo `which crictl || echo crictl` ps -a || sudo docker ps -a"

	I0701 12:26:12.735851  653531 logs.go:123] Gathering logs for kubelet ...

	I0701 12:26:12.735886  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo journalctl -u kubelet -n 400"

	I0701 12:26:12.793127  653531 logs.go:123] Gathering logs for kube-apiserver [f615f587cb12] ...

	I0701 12:26:12.793168  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 f615f587cb12"

	I0701 12:26:12.823004  653531 logs.go:123] Gathering logs for kindnet [8c3a5ac0cf85] ...

	I0701 12:26:12.823037  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 8c3a5ac0cf85"

	I0701 12:26:12.862610  653531 logs.go:123] Gathering logs for kube-scheduler [279483668a9c] ...

	I0701 12:26:12.862650  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 279483668a9c"

	I0701 12:26:12.883651  653531 logs.go:123] Gathering logs for kube-scheduler [58811626a0de] ...

	I0701 12:26:12.883685  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 58811626a0de"

	I0701 12:26:12.905351  653531 logs.go:123] Gathering logs for kube-controller-manager [a1160a455902] ...

	I0701 12:26:12.905388  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 a1160a455902"

	I0701 12:26:12.938388  653531 logs.go:123] Gathering logs for dmesg ...

	I0701 12:26:12.938427  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo dmesg -PH -L=never --level warn,err,crit,alert,emerg | tail -n 400"

	I0701 12:26:12.955609  653531 logs.go:123] Gathering logs for etcd [68c63c4abd01] ...

	I0701 12:26:12.955647  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 68c63c4abd01"

	I0701 12:26:12.987593  653531 logs.go:123] Gathering logs for etcd [dff0f4abea41] ...

	I0701 12:26:12.987626  653531 ssh_runner.go:195] Run: /bin/bash -c "docker logs --tail 400 dff0f4abea41"

	I0701 12:26:15.520590  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods

	I0701 12:26:15.520616  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:15.520625  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:15.520628  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:15.528299  653531 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0701 12:26:15.535569  653531 system_pods.go:59] 26 kube-system pods found

	I0701 12:26:15.535603  653531 system_pods.go:61] "coredns-7db6d8ff4d-nk4lf" [c03dd635-a82d-4f18-bd72-ec575f91867e] Running

	I0701 12:26:15.535608  653531 system_pods.go:61] "coredns-7db6d8ff4d-p4rtz" [267efba7-bf34-48d5-ab15-5bda45ff2f4f] Running

	I0701 12:26:15.535613  653531 system_pods.go:61] "etcd-ha-735960" [4b98745c-292f-42b5-977c-69c50fd241f1] Running

	I0701 12:26:15.535617  653531 system_pods.go:61] "etcd-ha-735960-m02" [fed8cdfa-8428-47e0-84ef-05297ad232f8] Running

	I0701 12:26:15.535622  653531 system_pods.go:61] "etcd-ha-735960-m03" [50b07bc3-ff6b-487d-8654-901d96892868] Running

	I0701 12:26:15.535625  653531 system_pods.go:61] "kindnet-2424m" [aa18d5dd-f6eb-4f04-a61e-b0b257e214af] Running

	I0701 12:26:15.535628  653531 system_pods.go:61] "kindnet-6gx8s" [7f46a773-a075-476c-9e54-89f125b4b57a] Running

	I0701 12:26:15.535631  653531 system_pods.go:61] "kindnet-7f6hm" [a8c302b4-1163-4d4f-bfe3-4fd3b5d23cf0] Running

	I0701 12:26:15.535633  653531 system_pods.go:61] "kindnet-bztzv" [7afa0e45-3d10-40bc-b422-7005a3ca9d3a] Running

	I0701 12:26:15.535636  653531 system_pods.go:61] "kube-apiserver-ha-735960" [ad041aaa-465a-4d8a-a8dc-b7665e1d587d] Running

	I0701 12:26:15.535640  653531 system_pods.go:61] "kube-apiserver-ha-735960-m02" [ba28f48e-1c18-47e3-ab11-a9b5588c5c32] Running

	I0701 12:26:15.535642  653531 system_pods.go:61] "kube-apiserver-ha-735960-m03" [baafa3bf-78ee-4269-9591-b0440927e055] Running

	I0701 12:26:15.535646  653531 system_pods.go:61] "kube-controller-manager-ha-735960" [3f0f0cf5-329d-47bc-b922-7583902e2607] Running

	I0701 12:26:15.535649  653531 system_pods.go:61] "kube-controller-manager-ha-735960-m02" [258fde18-ac5c-4446-842b-9465529b154c] Running

	I0701 12:26:15.535652  653531 system_pods.go:61] "kube-controller-manager-ha-735960-m03" [79acc56b-a9e0-4d4b-bc64-1a3a36ddf051] Running

	I0701 12:26:15.535655  653531 system_pods.go:61] "kube-proxy-25ssf" [11f0dc23-ab9d-4d39-988d-4c44dfde86cd] Running

	I0701 12:26:15.535658  653531 system_pods.go:61] "kube-proxy-776rt" [5666dac7-924e-4429-bd1d-a1a5647cc611] Running

	I0701 12:26:15.535661  653531 system_pods.go:61] "kube-proxy-b6knb" [eb36e930-5799-4ff7-821a-ccb22303cd1b] Running

	I0701 12:26:15.535664  653531 system_pods.go:61] "kube-proxy-lphzn" [0761a7a6-740e-4cde-9ab5-e02e8d417907] Running

	I0701 12:26:15.535667  653531 system_pods.go:61] "kube-scheduler-ha-735960" [c624cf42-a7d6-4aaf-859d-1aeaf29f9acb] Running

	I0701 12:26:15.535670  653531 system_pods.go:61] "kube-scheduler-ha-735960-m02" [7de78af7-2d79-46dc-bd34-f221d79fde06] Running

	I0701 12:26:15.535673  653531 system_pods.go:61] "kube-scheduler-ha-735960-m03" [9f9a2030-9332-44af-b8dc-3b4609e53f91] Running

	I0701 12:26:15.535676  653531 system_pods.go:61] "kube-vip-ha-735960" [4299679a-c145-4f4f-8ec6-3cd468b98ef1] Running

	I0701 12:26:15.535679  653531 system_pods.go:61] "kube-vip-ha-735960-m02" [1c9b13e1-515c-43c0-8d99-5ad1c1807727] Running

	I0701 12:26:15.535684  653531 system_pods.go:61] "kube-vip-ha-735960-m03" [7069ea7c-5461-4fe6-a969-97fe33396ebb] Running

	I0701 12:26:15.535688  653531 system_pods.go:61] "storage-provisioner" [f5c4f7f9-d648-4019-a5ea-6ce59f6c5663] Running

	I0701 12:26:15.535693  653531 system_pods.go:74] duration metric: took 3.47862483s to wait for pod list to return data ...

	I0701 12:26:15.535701  653531 default_sa.go:34] waiting for default service account to be created ...

	I0701 12:26:15.535798  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/default/serviceaccounts

	I0701 12:26:15.535809  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:15.535816  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:15.535820  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:15.539198  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:15.539410  653531 default_sa.go:45] found service account: "default"

	I0701 12:26:15.539425  653531 default_sa.go:55] duration metric: took 3.71568ms for default service account to be created ...

	I0701 12:26:15.539433  653531 system_pods.go:116] waiting for k8s-apps to be running ...

	I0701 12:26:15.539483  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods

	I0701 12:26:15.539490  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:15.539497  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:15.539503  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:15.547242  653531 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0701 12:26:15.553992  653531 system_pods.go:86] 26 kube-system pods found

	I0701 12:26:15.554026  653531 system_pods.go:89] "coredns-7db6d8ff4d-nk4lf" [c03dd635-a82d-4f18-bd72-ec575f91867e] Running

	I0701 12:26:15.554034  653531 system_pods.go:89] "coredns-7db6d8ff4d-p4rtz" [267efba7-bf34-48d5-ab15-5bda45ff2f4f] Running

	I0701 12:26:15.554040  653531 system_pods.go:89] "etcd-ha-735960" [4b98745c-292f-42b5-977c-69c50fd241f1] Running

	I0701 12:26:15.554046  653531 system_pods.go:89] "etcd-ha-735960-m02" [fed8cdfa-8428-47e0-84ef-05297ad232f8] Running

	I0701 12:26:15.554050  653531 system_pods.go:89] "etcd-ha-735960-m03" [50b07bc3-ff6b-487d-8654-901d96892868] Running

	I0701 12:26:15.554056  653531 system_pods.go:89] "kindnet-2424m" [aa18d5dd-f6eb-4f04-a61e-b0b257e214af] Running

	I0701 12:26:15.554062  653531 system_pods.go:89] "kindnet-6gx8s" [7f46a773-a075-476c-9e54-89f125b4b57a] Running

	I0701 12:26:15.554069  653531 system_pods.go:89] "kindnet-7f6hm" [a8c302b4-1163-4d4f-bfe3-4fd3b5d23cf0] Running

	I0701 12:26:15.554075  653531 system_pods.go:89] "kindnet-bztzv" [7afa0e45-3d10-40bc-b422-7005a3ca9d3a] Running

	I0701 12:26:15.554081  653531 system_pods.go:89] "kube-apiserver-ha-735960" [ad041aaa-465a-4d8a-a8dc-b7665e1d587d] Running

	I0701 12:26:15.554088  653531 system_pods.go:89] "kube-apiserver-ha-735960-m02" [ba28f48e-1c18-47e3-ab11-a9b5588c5c32] Running

	I0701 12:26:15.554099  653531 system_pods.go:89] "kube-apiserver-ha-735960-m03" [baafa3bf-78ee-4269-9591-b0440927e055] Running

	I0701 12:26:15.554107  653531 system_pods.go:89] "kube-controller-manager-ha-735960" [3f0f0cf5-329d-47bc-b922-7583902e2607] Running

	I0701 12:26:15.554115  653531 system_pods.go:89] "kube-controller-manager-ha-735960-m02" [258fde18-ac5c-4446-842b-9465529b154c] Running

	I0701 12:26:15.554123  653531 system_pods.go:89] "kube-controller-manager-ha-735960-m03" [79acc56b-a9e0-4d4b-bc64-1a3a36ddf051] Running

	I0701 12:26:15.554131  653531 system_pods.go:89] "kube-proxy-25ssf" [11f0dc23-ab9d-4d39-988d-4c44dfde86cd] Running

	I0701 12:26:15.554140  653531 system_pods.go:89] "kube-proxy-776rt" [5666dac7-924e-4429-bd1d-a1a5647cc611] Running

	I0701 12:26:15.554148  653531 system_pods.go:89] "kube-proxy-b6knb" [eb36e930-5799-4ff7-821a-ccb22303cd1b] Running

	I0701 12:26:15.554163  653531 system_pods.go:89] "kube-proxy-lphzn" [0761a7a6-740e-4cde-9ab5-e02e8d417907] Running

	I0701 12:26:15.554170  653531 system_pods.go:89] "kube-scheduler-ha-735960" [c624cf42-a7d6-4aaf-859d-1aeaf29f9acb] Running

	I0701 12:26:15.554176  653531 system_pods.go:89] "kube-scheduler-ha-735960-m02" [7de78af7-2d79-46dc-bd34-f221d79fde06] Running

	I0701 12:26:15.554183  653531 system_pods.go:89] "kube-scheduler-ha-735960-m03" [9f9a2030-9332-44af-b8dc-3b4609e53f91] Running

	I0701 12:26:15.554192  653531 system_pods.go:89] "kube-vip-ha-735960" [4299679a-c145-4f4f-8ec6-3cd468b98ef1] Running

	I0701 12:26:15.554199  653531 system_pods.go:89] "kube-vip-ha-735960-m02" [1c9b13e1-515c-43c0-8d99-5ad1c1807727] Running

	I0701 12:26:15.554207  653531 system_pods.go:89] "kube-vip-ha-735960-m03" [7069ea7c-5461-4fe6-a969-97fe33396ebb] Running

	I0701 12:26:15.554216  653531 system_pods.go:89] "storage-provisioner" [f5c4f7f9-d648-4019-a5ea-6ce59f6c5663] Running

	I0701 12:26:15.554229  653531 system_pods.go:126] duration metric: took 14.787055ms to wait for k8s-apps to be running ...

	I0701 12:26:15.554241  653531 system_svc.go:44] waiting for kubelet service to be running ....

	I0701 12:26:15.554296  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0701 12:26:15.567890  653531 system_svc.go:56] duration metric: took 13.638054ms WaitForService to wait for kubelet

	I0701 12:26:15.567925  653531 kubeadm.go:576] duration metric: took 1m25.555790211s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0701 12:26:15.567951  653531 node_conditions.go:102] verifying NodePressure condition ...

	I0701 12:26:15.568047  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes

	I0701 12:26:15.568057  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:15.568067  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:15.568074  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:15.575311  653531 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0701 12:26:15.577277  653531 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0701 12:26:15.577310  653531 node_conditions.go:123] node cpu capacity is 2

	I0701 12:26:15.577328  653531 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0701 12:26:15.577334  653531 node_conditions.go:123] node cpu capacity is 2

	I0701 12:26:15.577339  653531 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0701 12:26:15.577343  653531 node_conditions.go:123] node cpu capacity is 2

	I0701 12:26:15.577348  653531 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0701 12:26:15.577352  653531 node_conditions.go:123] node cpu capacity is 2

	I0701 12:26:15.577358  653531 node_conditions.go:105] duration metric: took 9.401356ms to run NodePressure ...

	I0701 12:26:15.577372  653531 start.go:240] waiting for startup goroutines ...

	I0701 12:26:15.577418  653531 start.go:254] writing updated cluster config ...

	I0701 12:26:15.579876  653531 out.go:177] 

	I0701 12:26:15.581466  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:26:15.581562  653531 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:26:15.583519  653531 out.go:177] * Starting "ha-735960-m03" control-plane node in "ha-735960" cluster

	I0701 12:26:15.584707  653531 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:26:15.584732  653531 cache.go:56] Caching tarball of preloaded images

	I0701 12:26:15.584831  653531 preload.go:173] Found /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0701 12:26:15.584841  653531 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on docker

	I0701 12:26:15.584932  653531 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:26:15.585716  653531 start.go:360] acquireMachinesLock for ha-735960-m03: {Name:mk43a6c0c0c15a237623df377ad65b82186c0ad8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0701 12:26:15.585768  653531 start.go:364] duration metric: took 28.47µs to acquireMachinesLock for "ha-735960-m03"

	I0701 12:26:15.585785  653531 start.go:96] Skipping create...Using existing machine configuration

	I0701 12:26:15.585798  653531 fix.go:54] fixHost starting: m03

	I0701 12:26:15.586107  653531 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:26:15.586143  653531 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:26:15.603500  653531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:43455

	I0701 12:26:15.603962  653531 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:26:15.604555  653531 main.go:141] libmachine: Using API Version  1

	I0701 12:26:15.604579  653531 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:26:15.604930  653531 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:26:15.605195  653531 main.go:141] libmachine: (ha-735960-m03) Calling .DriverName

	I0701 12:26:15.605384  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetState

	I0701 12:26:15.607018  653531 fix.go:112] recreateIfNeeded on ha-735960-m03: state=Stopped err=<nil>

	I0701 12:26:15.607042  653531 main.go:141] libmachine: (ha-735960-m03) Calling .DriverName

	W0701 12:26:15.607213  653531 fix.go:138] unexpected machine state, will restart: <nil>

	I0701 12:26:15.609349  653531 out.go:177] * Restarting existing kvm2 VM for "ha-735960-m03" ...

	I0701 12:26:15.610714  653531 main.go:141] libmachine: (ha-735960-m03) Calling .Start

	I0701 12:26:15.610921  653531 main.go:141] libmachine: (ha-735960-m03) Ensuring networks are active...

	I0701 12:26:15.611706  653531 main.go:141] libmachine: (ha-735960-m03) Ensuring network default is active

	I0701 12:26:15.612087  653531 main.go:141] libmachine: (ha-735960-m03) Ensuring network mk-ha-735960 is active

	I0701 12:26:15.612457  653531 main.go:141] libmachine: (ha-735960-m03) Getting domain xml...

	I0701 12:26:15.613082  653531 main.go:141] libmachine: (ha-735960-m03) Creating domain...

	I0701 12:26:16.855928  653531 main.go:141] libmachine: (ha-735960-m03) Waiting to get IP...

	I0701 12:26:16.856767  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:16.857131  653531 main.go:141] libmachine: (ha-735960-m03) DBG | unable to find current IP address of domain ha-735960-m03 in network mk-ha-735960

	I0701 12:26:16.857182  653531 main.go:141] libmachine: (ha-735960-m03) DBG | I0701 12:26:16.857114  654164 retry.go:31] will retry after 232.687433ms: waiting for machine to come up

	I0701 12:26:17.091660  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:17.092187  653531 main.go:141] libmachine: (ha-735960-m03) DBG | unable to find current IP address of domain ha-735960-m03 in network mk-ha-735960

	I0701 12:26:17.092229  653531 main.go:141] libmachine: (ha-735960-m03) DBG | I0701 12:26:17.092112  654164 retry.go:31] will retry after 320.051772ms: waiting for machine to come up

	I0701 12:26:17.413613  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:17.414125  653531 main.go:141] libmachine: (ha-735960-m03) DBG | unable to find current IP address of domain ha-735960-m03 in network mk-ha-735960

	I0701 12:26:17.414157  653531 main.go:141] libmachine: (ha-735960-m03) DBG | I0701 12:26:17.414063  654164 retry.go:31] will retry after 415.446228ms: waiting for machine to come up

	I0701 12:26:17.830725  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:17.831413  653531 main.go:141] libmachine: (ha-735960-m03) DBG | unable to find current IP address of domain ha-735960-m03 in network mk-ha-735960

	I0701 12:26:17.831445  653531 main.go:141] libmachine: (ha-735960-m03) DBG | I0701 12:26:17.831349  654164 retry.go:31] will retry after 522.707968ms: waiting for machine to come up

	I0701 12:26:18.356092  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:18.356521  653531 main.go:141] libmachine: (ha-735960-m03) DBG | unable to find current IP address of domain ha-735960-m03 in network mk-ha-735960

	I0701 12:26:18.356543  653531 main.go:141] libmachine: (ha-735960-m03) DBG | I0701 12:26:18.356485  654164 retry.go:31] will retry after 572.783424ms: waiting for machine to come up

	I0701 12:26:18.931377  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:18.931831  653531 main.go:141] libmachine: (ha-735960-m03) DBG | unable to find current IP address of domain ha-735960-m03 in network mk-ha-735960

	I0701 12:26:18.931856  653531 main.go:141] libmachine: (ha-735960-m03) DBG | I0701 12:26:18.931778  654164 retry.go:31] will retry after 662.269299ms: waiting for machine to come up

	I0701 12:26:19.595406  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:19.595831  653531 main.go:141] libmachine: (ha-735960-m03) DBG | unable to find current IP address of domain ha-735960-m03 in network mk-ha-735960

	I0701 12:26:19.595862  653531 main.go:141] libmachine: (ha-735960-m03) DBG | I0701 12:26:19.595779  654164 retry.go:31] will retry after 965.977644ms: waiting for machine to come up

	I0701 12:26:20.562930  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:20.563372  653531 main.go:141] libmachine: (ha-735960-m03) DBG | unable to find current IP address of domain ha-735960-m03 in network mk-ha-735960

	I0701 12:26:20.563432  653531 main.go:141] libmachine: (ha-735960-m03) DBG | I0701 12:26:20.563328  654164 retry.go:31] will retry after 1.166893605s: waiting for machine to come up

	I0701 12:26:21.731632  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:21.732082  653531 main.go:141] libmachine: (ha-735960-m03) DBG | unable to find current IP address of domain ha-735960-m03 in network mk-ha-735960

	I0701 12:26:21.732114  653531 main.go:141] libmachine: (ha-735960-m03) DBG | I0701 12:26:21.732040  654164 retry.go:31] will retry after 1.800222328s: waiting for machine to come up

	I0701 12:26:23.534948  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:23.535342  653531 main.go:141] libmachine: (ha-735960-m03) DBG | unable to find current IP address of domain ha-735960-m03 in network mk-ha-735960

	I0701 12:26:23.535372  653531 main.go:141] libmachine: (ha-735960-m03) DBG | I0701 12:26:23.535277  654164 retry.go:31] will retry after 1.820829305s: waiting for machine to come up

	I0701 12:26:25.357271  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:25.357677  653531 main.go:141] libmachine: (ha-735960-m03) DBG | unable to find current IP address of domain ha-735960-m03 in network mk-ha-735960

	I0701 12:26:25.357701  653531 main.go:141] libmachine: (ha-735960-m03) DBG | I0701 12:26:25.357630  654164 retry.go:31] will retry after 1.816274117s: waiting for machine to come up

	I0701 12:26:27.176155  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:27.176621  653531 main.go:141] libmachine: (ha-735960-m03) DBG | unable to find current IP address of domain ha-735960-m03 in network mk-ha-735960

	I0701 12:26:27.176653  653531 main.go:141] libmachine: (ha-735960-m03) DBG | I0701 12:26:27.176598  654164 retry.go:31] will retry after 2.782602178s: waiting for machine to come up

	I0701 12:26:29.960991  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:29.961388  653531 main.go:141] libmachine: (ha-735960-m03) DBG | unable to find current IP address of domain ha-735960-m03 in network mk-ha-735960

	I0701 12:26:29.961421  653531 main.go:141] libmachine: (ha-735960-m03) DBG | I0701 12:26:29.961334  654164 retry.go:31] will retry after 3.816886888s: waiting for machine to come up

	I0701 12:26:33.779810  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:33.780404  653531 main.go:141] libmachine: (ha-735960-m03) Found IP for machine: 192.168.39.97

	I0701 12:26:33.780436  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has current primary IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:33.780448  653531 main.go:141] libmachine: (ha-735960-m03) Reserving static IP address...

	I0701 12:26:33.780953  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "ha-735960-m03", mac: "52:54:00:93:88:f2", ip: "192.168.39.97"} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:33.780975  653531 main.go:141] libmachine: (ha-735960-m03) DBG | skip adding static IP to network mk-ha-735960 - found existing host DHCP lease matching {name: "ha-735960-m03", mac: "52:54:00:93:88:f2", ip: "192.168.39.97"}

	I0701 12:26:33.780986  653531 main.go:141] libmachine: (ha-735960-m03) Reserved static IP address: 192.168.39.97

	I0701 12:26:33.780995  653531 main.go:141] libmachine: (ha-735960-m03) Waiting for SSH to be available...

	I0701 12:26:33.781005  653531 main.go:141] libmachine: (ha-735960-m03) DBG | Getting to WaitForSSH function...

	I0701 12:26:33.783239  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:33.783609  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:33.783636  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:33.783742  653531 main.go:141] libmachine: (ha-735960-m03) DBG | Using SSH client type: external

	I0701 12:26:33.783770  653531 main.go:141] libmachine: (ha-735960-m03) DBG | Using SSH private key: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m03/id_rsa (-rw-------)

	I0701 12:26:33.783810  653531 main.go:141] libmachine: (ha-735960-m03) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.97 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m03/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0701 12:26:33.783825  653531 main.go:141] libmachine: (ha-735960-m03) DBG | About to run SSH command:

	I0701 12:26:33.783839  653531 main.go:141] libmachine: (ha-735960-m03) DBG | exit 0

	I0701 12:26:33.906528  653531 main.go:141] libmachine: (ha-735960-m03) DBG | SSH cmd err, output: <nil>: 

	I0701 12:26:33.906854  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetConfigRaw

	I0701 12:26:33.907659  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetIP

	I0701 12:26:33.910504  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:33.910919  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:33.910952  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:33.911199  653531 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:26:33.911468  653531 machine.go:94] provisionDockerMachine start ...

	I0701 12:26:33.911493  653531 main.go:141] libmachine: (ha-735960-m03) Calling .DriverName

	I0701 12:26:33.911726  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHHostname

	I0701 12:26:33.913742  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:33.914049  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:33.914079  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:33.914213  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHPort

	I0701 12:26:33.914440  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:33.914614  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:33.914781  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHUsername

	I0701 12:26:33.914952  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:26:33.915169  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0701 12:26:33.915186  653531 main.go:141] libmachine: About to run SSH command:

	hostname

	I0701 12:26:34.022720  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0701 12:26:34.022751  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetMachineName

	I0701 12:26:34.023048  653531 buildroot.go:166] provisioning hostname "ha-735960-m03"

	I0701 12:26:34.023086  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetMachineName

	I0701 12:26:34.023302  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHHostname

	I0701 12:26:34.026253  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.026699  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:34.026731  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.026891  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHPort

	I0701 12:26:34.027100  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:34.027330  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:34.027468  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHUsername

	I0701 12:26:34.027637  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:26:34.027853  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0701 12:26:34.027872  653531 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-735960-m03 && echo "ha-735960-m03" | sudo tee /etc/hostname

	I0701 12:26:34.143884  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-735960-m03

	I0701 12:26:34.143919  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHHostname

	I0701 12:26:34.146876  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.147233  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:34.147259  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.147410  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHPort

	I0701 12:26:34.147595  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:34.147764  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:34.147906  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHUsername

	I0701 12:26:34.148107  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:26:34.148271  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0701 12:26:34.148287  653531 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-735960-m03' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-735960-m03/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-735960-m03' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0701 12:26:34.259290  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0701 12:26:34.259326  653531 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19166-630650/.minikube CaCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19166-630650/.minikube}

	I0701 12:26:34.259348  653531 buildroot.go:174] setting up certificates

	I0701 12:26:34.259361  653531 provision.go:84] configureAuth start

	I0701 12:26:34.259373  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetMachineName

	I0701 12:26:34.259700  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetIP

	I0701 12:26:34.262660  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.263056  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:34.263088  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.263229  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHHostname

	I0701 12:26:34.265709  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.266104  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:34.266129  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.266291  653531 provision.go:143] copyHostCerts

	I0701 12:26:34.266320  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:26:34.266385  653531 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem, removing ...

	I0701 12:26:34.266399  653531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:26:34.266510  653531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem (1078 bytes)

	I0701 12:26:34.266616  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:26:34.266642  653531 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem, removing ...

	I0701 12:26:34.266651  653531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:26:34.266687  653531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem (1123 bytes)

	I0701 12:26:34.266758  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:26:34.266785  653531 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem, removing ...

	I0701 12:26:34.266794  653531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:26:34.266828  653531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem (1675 bytes)

	I0701 12:26:34.266895  653531 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem org=jenkins.ha-735960-m03 san=[127.0.0.1 192.168.39.97 ha-735960-m03 localhost minikube]

	I0701 12:26:34.565581  653531 provision.go:177] copyRemoteCerts

	I0701 12:26:34.565649  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0701 12:26:34.565676  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHHostname

	I0701 12:26:34.568539  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.568839  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:34.568870  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.569025  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHPort

	I0701 12:26:34.569261  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:34.569428  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHUsername

	I0701 12:26:34.569588  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m03/id_rsa Username:docker}

	I0701 12:26:34.652136  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0701 12:26:34.652230  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0701 12:26:34.676227  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0701 12:26:34.676305  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0701 12:26:34.699234  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0701 12:26:34.699313  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0701 12:26:34.721885  653531 provision.go:87] duration metric: took 462.509686ms to configureAuth

	I0701 12:26:34.721915  653531 buildroot.go:189] setting minikube options for container-runtime

	I0701 12:26:34.722137  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:26:34.722181  653531 main.go:141] libmachine: (ha-735960-m03) Calling .DriverName

	I0701 12:26:34.722494  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHHostname

	I0701 12:26:34.725227  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.725601  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:34.725629  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.725789  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHPort

	I0701 12:26:34.725994  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:34.726175  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:34.726384  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHUsername

	I0701 12:26:34.726572  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:26:34.726794  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0701 12:26:34.726809  653531 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0701 12:26:34.831674  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0701 12:26:34.831699  653531 buildroot.go:70] root file system type: tmpfs

	I0701 12:26:34.831846  653531 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0701 12:26:34.831923  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHHostname

	I0701 12:26:34.835107  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.835603  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:34.835626  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.835928  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHPort

	I0701 12:26:34.836184  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:34.836401  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:34.836577  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHUsername

	I0701 12:26:34.836754  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:26:34.836963  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0701 12:26:34.837056  653531 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment="NO_PROXY=192.168.39.16"

	Environment="NO_PROXY=192.168.39.16,192.168.39.86"

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0701 12:26:34.951789  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment=NO_PROXY=192.168.39.16

	Environment=NO_PROXY=192.168.39.16,192.168.39.86

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0701 12:26:34.951830  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHHostname

	I0701 12:26:34.954854  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.955349  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:34.955376  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:34.955552  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHPort

	I0701 12:26:34.955761  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:34.955952  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:34.956104  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHUsername

	I0701 12:26:34.956269  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:26:34.956436  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0701 12:26:34.956451  653531 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0701 12:26:36.820196  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0701 12:26:36.820235  653531 machine.go:97] duration metric: took 2.908749821s to provisionDockerMachine

	I0701 12:26:36.820254  653531 start.go:293] postStartSetup for "ha-735960-m03" (driver="kvm2")

	I0701 12:26:36.820269  653531 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0701 12:26:36.820322  653531 main.go:141] libmachine: (ha-735960-m03) Calling .DriverName

	I0701 12:26:36.820717  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0701 12:26:36.820758  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHHostname

	I0701 12:26:36.823679  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:36.824131  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:36.824158  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:36.824315  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHPort

	I0701 12:26:36.824557  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:36.824862  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHUsername

	I0701 12:26:36.825025  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m03/id_rsa Username:docker}

	I0701 12:26:36.909262  653531 ssh_runner.go:195] Run: cat /etc/os-release

	I0701 12:26:36.913798  653531 info.go:137] Remote host: Buildroot 2023.02.9

	I0701 12:26:36.913830  653531 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/addons for local assets ...

	I0701 12:26:36.913904  653531 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/files for local assets ...

	I0701 12:26:36.913973  653531 filesync.go:149] local asset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> 6378542.pem in /etc/ssl/certs

	I0701 12:26:36.913983  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /etc/ssl/certs/6378542.pem

	I0701 12:26:36.914063  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0701 12:26:36.924147  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:26:36.949103  653531 start.go:296] duration metric: took 128.830664ms for postStartSetup

	I0701 12:26:36.949169  653531 main.go:141] libmachine: (ha-735960-m03) Calling .DriverName

	I0701 12:26:36.949541  653531 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup

	I0701 12:26:36.949572  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHHostname

	I0701 12:26:36.952321  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:36.952670  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:36.952703  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:36.952895  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHPort

	I0701 12:26:36.953116  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:36.953299  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHUsername

	I0701 12:26:36.953494  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m03/id_rsa Username:docker}

	I0701 12:26:37.037086  653531 machine.go:198] restoring vm config from /var/lib/minikube/backup: [etc]

	I0701 12:26:37.037223  653531 ssh_runner.go:195] Run: sudo rsync --archive --update /var/lib/minikube/backup/etc /

	I0701 12:26:37.097170  653531 fix.go:56] duration metric: took 21.511363009s for fixHost

	I0701 12:26:37.097229  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHHostname

	I0701 12:26:37.100519  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:37.100936  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:37.100988  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:37.101235  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHPort

	I0701 12:26:37.101494  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:37.101681  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:37.101864  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHUsername

	I0701 12:26:37.102058  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:26:37.102248  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.97 22 <nil> <nil>}

	I0701 12:26:37.102261  653531 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0701 12:26:37.210872  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: 1719836797.190240924

	I0701 12:26:37.210897  653531 fix.go:216] guest clock: 1719836797.190240924

	I0701 12:26:37.210906  653531 fix.go:229] Guest: 2024-07-01 12:26:37.190240924 +0000 UTC Remote: 2024-07-01 12:26:37.09720405 +0000 UTC m=+154.567055715 (delta=93.036874ms)

	I0701 12:26:37.210928  653531 fix.go:200] guest clock delta is within tolerance: 93.036874ms

	I0701 12:26:37.210935  653531 start.go:83] releasing machines lock for "ha-735960-m03", held for 21.625157566s

	I0701 12:26:37.210966  653531 main.go:141] libmachine: (ha-735960-m03) Calling .DriverName

	I0701 12:26:37.211304  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetIP

	I0701 12:26:37.213807  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:37.214222  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:37.214255  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:37.216716  653531 out.go:177] * Found network options:

	I0701 12:26:37.218305  653531 out.go:177]   - NO_PROXY=192.168.39.16,192.168.39.86

	W0701 12:26:37.219816  653531 proxy.go:119] fail to check proxy env: Error ip not in block

	W0701 12:26:37.219845  653531 proxy.go:119] fail to check proxy env: Error ip not in block

	I0701 12:26:37.219865  653531 main.go:141] libmachine: (ha-735960-m03) Calling .DriverName

	I0701 12:26:37.220522  653531 main.go:141] libmachine: (ha-735960-m03) Calling .DriverName

	I0701 12:26:37.220737  653531 main.go:141] libmachine: (ha-735960-m03) Calling .DriverName

	I0701 12:26:37.220844  653531 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0701 12:26:37.220887  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHHostname

	W0701 12:26:37.220953  653531 proxy.go:119] fail to check proxy env: Error ip not in block

	W0701 12:26:37.220981  653531 proxy.go:119] fail to check proxy env: Error ip not in block

	I0701 12:26:37.221057  653531 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I0701 12:26:37.221077  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHHostname

	I0701 12:26:37.223616  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:37.223976  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:37.224003  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:37.224022  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:37.224163  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHPort

	I0701 12:26:37.224349  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:37.224476  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:37.224495  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:37.224522  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHUsername

	I0701 12:26:37.224684  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHPort

	I0701 12:26:37.224708  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m03/id_rsa Username:docker}

	I0701 12:26:37.224822  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHKeyPath

	I0701 12:26:37.224957  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetSSHUsername

	I0701 12:26:37.225089  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.97 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m03/id_rsa Username:docker}

	W0701 12:26:37.324512  653531 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0701 12:26:37.324590  653531 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0701 12:26:37.342354  653531 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0701 12:26:37.342401  653531 start.go:494] detecting cgroup driver to use...

	I0701 12:26:37.342553  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:26:37.361964  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0701 12:26:37.372356  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0701 12:26:37.382741  653531 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0701 12:26:37.382800  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0701 12:26:37.393672  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:26:37.404182  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0701 12:26:37.413967  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:26:37.425102  653531 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0701 12:26:37.436486  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0701 12:26:37.448119  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0701 12:26:37.459499  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0701 12:26:37.470904  653531 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0701 12:26:37.480202  653531 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0701 12:26:37.489935  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:26:37.612275  653531 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0701 12:26:37.635575  653531 start.go:494] detecting cgroup driver to use...

	I0701 12:26:37.635692  653531 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0701 12:26:37.653571  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:26:37.670438  653531 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0701 12:26:37.688000  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:26:37.705115  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:26:37.718914  653531 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0701 12:26:37.744858  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:26:37.759980  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:26:37.779721  653531 ssh_runner.go:195] Run: which cri-dockerd

	I0701 12:26:37.783771  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0701 12:26:37.794141  653531 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0701 12:26:37.811510  653531 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0701 12:26:37.931976  653531 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0701 12:26:38.066164  653531 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0701 12:26:38.066230  653531 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0701 12:26:38.083572  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:26:38.206358  653531 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0701 12:26:40.648995  653531 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.442581628s)

	I0701 12:26:40.649094  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0701 12:26:40.663523  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:26:40.678231  653531 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0701 12:26:40.794839  653531 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0701 12:26:40.936707  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:26:41.068605  653531 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0701 12:26:41.086480  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:26:41.102238  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:26:41.225877  653531 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0701 12:26:41.309074  653531 start.go:541] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0701 12:26:41.309144  653531 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0701 12:26:41.314764  653531 start.go:562] Will wait 60s for crictl version

	I0701 12:26:41.314839  653531 ssh_runner.go:195] Run: which crictl

	I0701 12:26:41.318792  653531 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0701 12:26:41.356836  653531 start.go:578] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.0.1

	RuntimeApiVersion:  v1

	I0701 12:26:41.356927  653531 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:26:41.383790  653531 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:26:41.409143  653531 out.go:204] * Preparing Kubernetes v1.30.2 on Docker 27.0.1 ...

	I0701 12:26:41.410603  653531 out.go:177]   - env NO_PROXY=192.168.39.16

	I0701 12:26:41.412215  653531 out.go:177]   - env NO_PROXY=192.168.39.16,192.168.39.86

	I0701 12:26:41.413404  653531 main.go:141] libmachine: (ha-735960-m03) Calling .GetIP

	I0701 12:26:41.416274  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:41.416763  653531 main.go:141] libmachine: (ha-735960-m03) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:93:88:f2", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:26:25 +0000 UTC Type:0 Mac:52:54:00:93:88:f2 Iaid: IPaddr:192.168.39.97 Prefix:24 Hostname:ha-735960-m03 Clientid:01:52:54:00:93:88:f2}

	I0701 12:26:41.416796  653531 main.go:141] libmachine: (ha-735960-m03) DBG | domain ha-735960-m03 has defined IP address 192.168.39.97 and MAC address 52:54:00:93:88:f2 in network mk-ha-735960

	I0701 12:26:41.417070  653531 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0701 12:26:41.421392  653531 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:26:41.434549  653531 mustload.go:65] Loading cluster: ha-735960

	I0701 12:26:41.434797  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:26:41.435079  653531 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:26:41.435129  653531 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:26:41.451156  653531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:45677

	I0701 12:26:41.451676  653531 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:26:41.452212  653531 main.go:141] libmachine: Using API Version  1

	I0701 12:26:41.452237  653531 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:26:41.452614  653531 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:26:41.452827  653531 main.go:141] libmachine: (ha-735960) Calling .GetState

	I0701 12:26:41.454575  653531 host.go:66] Checking if "ha-735960" exists ...

	I0701 12:26:41.454891  653531 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:26:41.454938  653531 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:26:41.471129  653531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:33243

	I0701 12:26:41.471681  653531 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:26:41.472198  653531 main.go:141] libmachine: Using API Version  1

	I0701 12:26:41.472222  653531 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:26:41.472612  653531 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:26:41.472844  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:26:41.473032  653531 certs.go:68] Setting up /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960 for IP: 192.168.39.97

	I0701 12:26:41.473049  653531 certs.go:194] generating shared ca certs ...

	I0701 12:26:41.473074  653531 certs.go:226] acquiring lock for ca certs: {Name:mk34e166bfd069e523b2325e14d1812c523bff53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:26:41.473230  653531 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key

	I0701 12:26:41.473268  653531 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key

	I0701 12:26:41.473278  653531 certs.go:256] generating profile certs ...

	I0701 12:26:41.473349  653531 certs.go:359] skipping valid signed profile cert regeneration for "minikube-user": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key

	I0701 12:26:41.473405  653531 certs.go:359] skipping valid signed profile cert regeneration for "minikube": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key.f1482ab5

	I0701 12:26:41.473453  653531 certs.go:359] skipping valid signed profile cert regeneration for "aggregator": /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key

	I0701 12:26:41.473465  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0701 12:26:41.473478  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0701 12:26:41.473490  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0701 12:26:41.473503  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0701 12:26:41.473514  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt -> /var/lib/minikube/certs/apiserver.crt

	I0701 12:26:41.473528  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key -> /var/lib/minikube/certs/apiserver.key

	I0701 12:26:41.473537  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt

	I0701 12:26:41.473548  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key -> /var/lib/minikube/certs/proxy-client.key

	I0701 12:26:41.473603  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem (1338 bytes)

	W0701 12:26:41.473630  653531 certs.go:480] ignoring /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854_empty.pem, impossibly tiny 0 bytes

	I0701 12:26:41.473639  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem (1675 bytes)

	I0701 12:26:41.473659  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem (1078 bytes)

	I0701 12:26:41.473680  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem (1123 bytes)

	I0701 12:26:41.473702  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem (1675 bytes)

	I0701 12:26:41.473736  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:26:41.473759  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem -> /usr/share/ca-certificates/637854.pem

	I0701 12:26:41.473772  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /usr/share/ca-certificates/6378542.pem

	I0701 12:26:41.473784  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:26:41.494518  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHHostname

	I0701 12:26:41.498371  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:26:41.498974  653531 main.go:141] libmachine: (ha-735960) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:6c:20:7c", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:24:12 +0000 UTC Type:0 Mac:52:54:00:6c:20:7c Iaid: IPaddr:192.168.39.16 Prefix:24 Hostname:ha-735960 Clientid:01:52:54:00:6c:20:7c}

	I0701 12:26:41.499011  653531 main.go:141] libmachine: (ha-735960) DBG | domain ha-735960 has defined IP address 192.168.39.16 and MAC address 52:54:00:6c:20:7c in network mk-ha-735960

	I0701 12:26:41.499158  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHPort

	I0701 12:26:41.499416  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHKeyPath

	I0701 12:26:41.499610  653531 main.go:141] libmachine: (ha-735960) Calling .GetSSHUsername

	I0701 12:26:41.499835  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.16 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960/id_rsa Username:docker}

	I0701 12:26:41.570757  653531 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.pub

	I0701 12:26:41.575932  653531 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.pub --> memory (451 bytes)

	I0701 12:26:41.587511  653531 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/sa.key

	I0701 12:26:41.591633  653531 ssh_runner.go:447] scp /var/lib/minikube/certs/sa.key --> memory (1675 bytes)

	I0701 12:26:41.604961  653531 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.crt

	I0701 12:26:41.609152  653531 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.crt --> memory (1123 bytes)

	I0701 12:26:41.619653  653531 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/front-proxy-ca.key

	I0701 12:26:41.623572  653531 ssh_runner.go:447] scp /var/lib/minikube/certs/front-proxy-ca.key --> memory (1679 bytes)

	I0701 12:26:41.634171  653531 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.crt

	I0701 12:26:41.638176  653531 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.crt --> memory (1094 bytes)

	I0701 12:26:41.654120  653531 ssh_runner.go:195] Run: stat -c %!s(MISSING) /var/lib/minikube/certs/etcd/ca.key

	I0701 12:26:41.659095  653531 ssh_runner.go:447] scp /var/lib/minikube/certs/etcd/ca.key --> memory (1679 bytes)

	I0701 12:26:41.671865  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0701 12:26:41.701740  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0701 12:26:41.726445  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0701 12:26:41.751925  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0701 12:26:41.776782  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.crt --> /var/lib/minikube/certs/apiserver.crt (1440 bytes)

	I0701 12:26:41.801611  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/apiserver.key --> /var/lib/minikube/certs/apiserver.key (1679 bytes)

	I0701 12:26:41.825786  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.crt --> /var/lib/minikube/certs/proxy-client.crt (1147 bytes)

	I0701 12:26:41.849992  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/proxy-client.key --> /var/lib/minikube/certs/proxy-client.key (1679 bytes)

	I0701 12:26:41.873760  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem --> /usr/share/ca-certificates/637854.pem (1338 bytes)

	I0701 12:26:41.898685  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /usr/share/ca-certificates/6378542.pem (1708 bytes)

	I0701 12:26:41.923397  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0701 12:26:41.948251  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.pub (451 bytes)

	I0701 12:26:41.965919  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/sa.key (1675 bytes)

	I0701 12:26:41.982966  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.crt (1123 bytes)

	I0701 12:26:42.001626  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/front-proxy-ca.key (1679 bytes)

	I0701 12:26:42.019386  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.crt (1094 bytes)

	I0701 12:26:42.036382  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/certs/etcd/ca.key (1679 bytes)

	I0701 12:26:42.053238  653531 ssh_runner.go:362] scp memory --> /var/lib/minikube/kubeconfig (744 bytes)

	I0701 12:26:42.070881  653531 ssh_runner.go:195] Run: openssl version

	I0701 12:26:42.076651  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/637854.pem && ln -fs /usr/share/ca-certificates/637854.pem /etc/ssl/certs/637854.pem"

	I0701 12:26:42.087389  653531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/637854.pem

	I0701 12:26:42.093055  653531 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul  1 12:11 /usr/share/ca-certificates/637854.pem

	I0701 12:26:42.093154  653531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/637854.pem

	I0701 12:26:42.099823  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/637854.pem /etc/ssl/certs/51391683.0"

	I0701 12:26:42.111701  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6378542.pem && ln -fs /usr/share/ca-certificates/6378542.pem /etc/ssl/certs/6378542.pem"

	I0701 12:26:42.125593  653531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6378542.pem

	I0701 12:26:42.130163  653531 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul  1 12:11 /usr/share/ca-certificates/6378542.pem

	I0701 12:26:42.130246  653531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6378542.pem

	I0701 12:26:42.136102  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/6378542.pem /etc/ssl/certs/3ec20f2e.0"

	I0701 12:26:42.147064  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0701 12:26:42.159086  653531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:26:42.163767  653531 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul  1 12:05 /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:26:42.163864  653531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:26:42.170462  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0701 12:26:42.181119  653531 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0701 12:26:42.185711  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-etcd-client.crt -checkend 86400

	I0701 12:26:42.191736  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/apiserver-kubelet-client.crt -checkend 86400

	I0701 12:26:42.198232  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/server.crt -checkend 86400

	I0701 12:26:42.204698  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/healthcheck-client.crt -checkend 86400

	I0701 12:26:42.210909  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/etcd/peer.crt -checkend 86400

	I0701 12:26:42.216837  653531 ssh_runner.go:195] Run: openssl x509 -noout -in /var/lib/minikube/certs/front-proxy-client.crt -checkend 86400

	I0701 12:26:42.222755  653531 kubeadm.go:928] updating node {m03 192.168.39.97 8443 v1.30.2 docker true true} ...

	I0701 12:26:42.222878  653531 kubeadm.go:940] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-735960-m03 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.97

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0701 12:26:42.222906  653531 kube-vip.go:115] generating kube-vip config ...

	I0701 12:26:42.222955  653531 ssh_runner.go:195] Run: sudo sh -c "modprobe --all ip_vs ip_vs_rr ip_vs_wrr ip_vs_sh nf_conntrack"

	I0701 12:26:42.237298  653531 kube-vip.go:167] auto-enabling control-plane load-balancing in kube-vip

	I0701 12:26:42.237376  653531 kube-vip.go:137] kube-vip config:

	apiVersion: v1

	kind: Pod

	metadata:

	  creationTimestamp: null

	  name: kube-vip

	  namespace: kube-system

	spec:

	  containers:

	  - args:

	    - manager

	    env:

	    - name: vip_arp

	      value: "true"

	    - name: port

	      value: "8443"

	    - name: vip_nodename

	      valueFrom:

	        fieldRef:

	          fieldPath: spec.nodeName

	    - name: vip_interface

	      value: eth0

	    - name: vip_cidr

	      value: "32"

	    - name: dns_mode

	      value: first

	    - name: cp_enable

	      value: "true"

	    - name: cp_namespace

	      value: kube-system

	    - name: vip_leaderelection

	      value: "true"

	    - name: vip_leasename

	      value: plndr-cp-lock

	    - name: vip_leaseduration

	      value: "5"

	    - name: vip_renewdeadline

	      value: "3"

	    - name: vip_retryperiod

	      value: "1"

	    - name: address

	      value: 192.168.39.254

	    - name: prometheus_server

	      value: :2112

	    - name : lb_enable

	      value: "true"

	    - name: lb_port

	      value: "8443"

	    image: ghcr.io/kube-vip/kube-vip:v0.8.0

	    imagePullPolicy: IfNotPresent

	    name: kube-vip

	    resources: {}

	    securityContext:

	      capabilities:

	        add:

	        - NET_ADMIN

	        - NET_RAW

	    volumeMounts:

	    - mountPath: /etc/kubernetes/admin.conf

	      name: kubeconfig

	  hostAliases:

	  - hostnames:

	    - kubernetes

	    ip: 127.0.0.1

	  hostNetwork: true

	  volumes:

	  - hostPath:

	      path: "/etc/kubernetes/admin.conf"

	    name: kubeconfig

	status: {}

	I0701 12:26:42.237455  653531 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0701 12:26:42.247439  653531 binaries.go:44] Found k8s binaries, skipping transfer

	I0701 12:26:42.247515  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system /etc/kubernetes/manifests

	I0701 12:26:42.257290  653531 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0701 12:26:42.274152  653531 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0701 12:26:42.290241  653531 ssh_runner.go:362] scp memory --> /etc/kubernetes/manifests/kube-vip.yaml (1441 bytes)

	I0701 12:26:42.308095  653531 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0701 12:26:42.312034  653531 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:26:42.325214  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:26:42.447612  653531 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0701 12:26:42.465983  653531 start.go:234] Will wait 6m0s for node &{Name:m03 IP:192.168.39.97 Port:8443 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:true Worker:true}

	I0701 12:26:42.466298  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:26:42.468248  653531 out.go:177] * Verifying Kubernetes components...

	I0701 12:26:42.469706  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:26:42.625060  653531 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0701 12:26:42.647149  653531 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:26:42.647532  653531 kapi.go:59] client config for ha-735960: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.crt", KeyFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key", CAFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1cfbb80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0701 12:26:42.647632  653531 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.16:8443

	I0701 12:26:42.647948  653531 node_ready.go:35] waiting up to 6m0s for node "ha-735960-m03" to be "Ready" ...

	I0701 12:26:42.648043  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:42.648055  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:42.648066  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:42.648079  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:42.652553  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:26:43.148887  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:43.148913  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:43.148924  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:43.148931  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:43.152504  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:43.153020  653531 node_ready.go:49] node "ha-735960-m03" has status "Ready":"True"

	I0701 12:26:43.153041  653531 node_ready.go:38] duration metric: took 505.070913ms for node "ha-735960-m03" to be "Ready" ...

	I0701 12:26:43.153051  653531 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0701 12:26:43.153132  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods

	I0701 12:26:43.153144  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:43.153154  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:43.153161  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:43.159789  653531 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0701 12:26:43.167076  653531 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:43.167158  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:26:43.167167  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:43.167175  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:43.167179  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:43.169757  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:43.170310  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:26:43.170347  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:43.170357  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:43.170362  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:43.173097  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:43.173879  653531 pod_ready.go:92] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:43.173897  653531 pod_ready.go:81] duration metric: took 6.79477ms for pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:43.173905  653531 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-p4rtz" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:43.173970  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-p4rtz

	I0701 12:26:43.173977  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:43.173984  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:43.173987  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:43.176719  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:43.177389  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:26:43.177403  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:43.177410  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:43.177415  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:43.180272  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:43.180876  653531 pod_ready.go:92] pod "coredns-7db6d8ff4d-p4rtz" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:43.180892  653531 pod_ready.go:81] duration metric: took 6.981686ms for pod "coredns-7db6d8ff4d-p4rtz" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:43.180901  653531 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:43.180946  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960

	I0701 12:26:43.180953  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:43.180959  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:43.180963  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:43.183979  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:43.184715  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:26:43.184733  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:43.184744  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:43.184750  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:43.187303  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:43.187727  653531 pod_ready.go:92] pod "etcd-ha-735960" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:43.187743  653531 pod_ready.go:81] duration metric: took 6.837753ms for pod "etcd-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:43.187751  653531 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:43.187803  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m02

	I0701 12:26:43.187810  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:43.187816  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:43.187820  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:43.190206  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:43.190728  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:26:43.190744  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:43.190753  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:43.190761  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:43.193433  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:43.194190  653531 pod_ready.go:92] pod "etcd-ha-735960-m02" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:43.194207  653531 pod_ready.go:81] duration metric: took 6.448739ms for pod "etcd-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:43.194216  653531 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:43.349638  653531 request.go:629] Waited for 155.349ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:43.349754  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:43.349767  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:43.349778  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:43.349790  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:43.354862  653531 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0701 12:26:43.548911  653531 request.go:629] Waited for 193.270032ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:43.548983  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:43.549014  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:43.549029  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:43.549034  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:43.554047  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:26:43.749322  653531 request.go:629] Waited for 54.224497ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:43.749397  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:43.749405  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:43.749423  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:43.749433  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:43.753610  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:26:43.949318  653531 request.go:629] Waited for 194.40537ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:43.949442  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:43.949455  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:43.949466  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:43.949475  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:43.953476  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:44.195013  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:44.195041  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:44.195053  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:44.195058  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:44.198623  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:44.349775  653531 request.go:629] Waited for 150.337133ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:44.349881  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:44.349890  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:44.349901  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:44.349909  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:44.354832  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:26:44.694539  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:44.694560  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:44.694569  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:44.694573  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:44.698072  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:44.749262  653531 request.go:629] Waited for 50.212385ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:44.749342  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:44.749357  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:44.749376  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:44.749400  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:44.759594  653531 round_trippers.go:574] Response Status: 200 OK in 10 milliseconds

	I0701 12:26:45.194608  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:45.194639  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:45.194651  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:45.194656  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:45.198135  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:45.199157  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:45.199178  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:45.199187  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:45.199193  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:45.201747  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:45.202475  653531 pod_ready.go:102] pod "etcd-ha-735960-m03" in "kube-system" namespace has status "Ready":"False"

	I0701 12:26:45.695358  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:45.695387  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:45.695398  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:45.695405  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:45.698583  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:45.699570  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:45.699591  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:45.699603  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:45.699611  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:45.702299  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:46.195334  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:46.195357  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:46.195366  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:46.195369  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:46.199158  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:46.200116  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:46.200134  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:46.200146  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:46.200153  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:46.203740  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:46.695210  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:46.695238  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:46.695250  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:46.695257  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:46.698972  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:46.699688  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:46.699709  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:46.699722  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:46.699728  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:46.703576  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:47.194463  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:47.194494  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:47.194504  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:47.194512  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:47.197423  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:47.198125  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:47.198144  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:47.198156  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:47.198166  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:47.201172  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:47.695417  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:47.695446  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:47.695457  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:47.695463  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:47.698528  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:47.699400  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:47.699424  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:47.699435  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:47.699440  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:47.702619  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:47.703202  653531 pod_ready.go:102] pod "etcd-ha-735960-m03" in "kube-system" namespace has status "Ready":"False"

	I0701 12:26:48.194609  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:48.194632  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:48.194640  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:48.194656  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:48.197877  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:48.198784  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:48.198804  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:48.198815  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:48.198819  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:48.201611  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:48.694433  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:48.694459  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:48.694471  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:48.694478  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:48.697539  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:48.698170  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:48.698185  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:48.698193  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:48.698196  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:48.700886  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:49.194905  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:49.194931  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:49.194942  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:49.194954  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:49.199572  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:26:49.200541  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:49.200560  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:49.200570  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:49.200575  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:49.204090  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:49.694531  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:49.694551  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:49.694559  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:49.694563  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:49.698105  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:49.699044  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:49.699062  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:49.699073  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:49.699078  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:49.701617  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:50.195294  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:50.195322  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:50.195333  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:50.195338  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:50.198820  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:50.199561  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:50.199579  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:50.199588  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:50.199594  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:50.202455  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:50.203029  653531 pod_ready.go:102] pod "etcd-ha-735960-m03" in "kube-system" namespace has status "Ready":"False"

	I0701 12:26:50.694678  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:50.694700  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:50.694708  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:50.694712  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:50.697694  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:50.698383  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:50.698401  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:50.698409  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:50.698413  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:50.701398  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:51.195484  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:51.195522  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:51.195535  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:51.195539  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:51.199113  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:51.199788  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:51.199804  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:51.199811  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:51.199815  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:51.202679  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:51.695276  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:51.695304  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:51.695318  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:51.695325  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:51.698725  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:51.699425  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:51.699444  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:51.699454  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:51.699461  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:51.702960  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:52.195136  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:52.195168  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:52.195178  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:52.195182  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:52.198421  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:52.199068  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:52.199081  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:52.199089  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:52.199133  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:52.201737  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:52.695128  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:52.695153  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:52.695161  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:52.695165  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:52.698791  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:52.699625  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:52.699640  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:52.699647  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:52.699666  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:52.702284  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:52.702827  653531 pod_ready.go:102] pod "etcd-ha-735960-m03" in "kube-system" namespace has status "Ready":"False"

	I0701 12:26:53.194518  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:53.194542  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:53.194550  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:53.194555  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:53.197969  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:53.198583  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:53.198602  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:53.198610  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:53.198615  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:53.201376  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:53.695296  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:53.695318  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:53.695326  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:53.695331  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:53.699078  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:53.699884  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:53.699910  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:53.699922  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:53.699929  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:53.703186  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:54.195014  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:54.195043  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:54.195054  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:54.195058  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:54.199057  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:54.199733  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:54.199750  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:54.199758  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:54.199763  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:54.202961  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:54.695177  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:54.695212  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:54.695225  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:54.695233  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:54.698371  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:54.699201  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:54.699216  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:54.699224  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:54.699227  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:54.702002  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:55.194543  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:55.194566  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:55.194574  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:55.194579  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:55.198201  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:55.198814  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:55.198832  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:55.198839  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:55.198843  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:55.201469  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:55.201993  653531 pod_ready.go:102] pod "etcd-ha-735960-m03" in "kube-system" namespace has status "Ready":"False"

	I0701 12:26:55.694950  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:55.694972  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:55.694983  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:55.694990  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:55.698498  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:55.699087  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:55.699101  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:55.699108  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:55.699112  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:55.701817  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:56.194521  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:26:56.194544  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:56.194552  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:56.194557  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:56.197837  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:56.198482  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:56.198499  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:56.198505  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:56.198509  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:56.201147  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:56.201653  653531 pod_ready.go:92] pod "etcd-ha-735960-m03" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:56.201674  653531 pod_ready.go:81] duration metric: took 13.007452083s for pod "etcd-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:56.201692  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:56.201750  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960

	I0701 12:26:56.201757  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:56.201764  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:56.201770  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:56.204418  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:56.205132  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:26:56.205148  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:56.205154  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:56.205158  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:56.207485  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:56.207887  653531 pod_ready.go:92] pod "kube-apiserver-ha-735960" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:56.207907  653531 pod_ready.go:81] duration metric: took 6.206212ms for pod "kube-apiserver-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:56.207916  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:56.207971  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m02

	I0701 12:26:56.207981  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:56.207988  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:56.207992  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:56.210274  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:56.210769  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:26:56.210784  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:56.210791  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:56.210795  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:56.213307  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:56.213730  653531 pod_ready.go:92] pod "kube-apiserver-ha-735960-m02" in "kube-system" namespace has status "Ready":"True"

	I0701 12:26:56.213745  653531 pod_ready.go:81] duration metric: took 5.823695ms for pod "kube-apiserver-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:56.213752  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:26:56.213799  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:26:56.213806  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:56.213813  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:56.213817  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:56.221893  653531 round_trippers.go:574] Response Status: 200 OK in 8 milliseconds

	I0701 12:26:56.222630  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:56.222650  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:56.222661  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:56.222665  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:56.225298  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:56.714434  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:26:56.714457  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:56.714466  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:56.714473  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:56.717715  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:56.718387  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:56.718404  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:56.718414  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:56.718420  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:56.721172  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:57.213955  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:26:57.213979  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:57.213987  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:57.213992  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:57.217394  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:57.218050  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:57.218071  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:57.218082  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:57.218088  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:57.221478  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:57.714757  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:26:57.714779  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:57.714787  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:57.714792  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:57.717911  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:57.718695  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:57.718720  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:57.718734  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:57.718740  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:57.721551  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:58.214582  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:26:58.214605  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:58.214613  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:58.214616  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:58.218396  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:58.219147  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:58.219167  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:58.219174  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:58.219178  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:58.221830  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:58.222386  653531 pod_ready.go:102] pod "kube-apiserver-ha-735960-m03" in "kube-system" namespace has status "Ready":"False"

	I0701 12:26:58.714864  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:26:58.714890  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:58.714901  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:58.714906  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:58.718181  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:58.718855  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:58.718874  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:58.718881  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:58.718885  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:58.722484  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:59.214439  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:26:59.214472  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:59.214484  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:59.214491  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:59.217758  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:59.218712  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:59.218732  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:59.218738  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:59.218742  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:59.221527  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:26:59.713995  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:26:59.714020  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:59.714028  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:59.714033  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:59.717121  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:26:59.717838  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:26:59.717855  653531 round_trippers.go:469] Request Headers:

	I0701 12:26:59.717862  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:26:59.717866  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:26:59.720568  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:27:00.214542  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:27:00.214568  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:00.214578  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:00.214583  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:00.218220  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:00.218919  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:00.218938  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:00.218947  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:00.218954  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:00.222119  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:00.223039  653531 pod_ready.go:102] pod "kube-apiserver-ha-735960-m03" in "kube-system" namespace has status "Ready":"False"

	I0701 12:27:00.714993  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:27:00.715015  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:00.715023  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:00.715027  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:00.718022  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:27:00.718871  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:00.718894  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:00.718905  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:00.718910  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:00.721660  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:27:01.214293  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:27:01.214320  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:01.214345  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:01.214354  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:01.217660  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:01.218619  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:01.218636  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:01.218645  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:01.218649  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:01.221248  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:27:01.714569  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:27:01.714593  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:01.714602  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:01.714607  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:01.717986  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:01.718877  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:01.718900  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:01.718912  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:01.718917  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:01.722103  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:02.213928  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:27:02.213953  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:02.213961  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:02.213965  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:02.217318  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:02.218078  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:02.218093  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:02.218099  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:02.218102  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:02.221493  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:02.714825  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:27:02.714849  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:02.714857  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:02.714862  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:02.718359  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:02.719162  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:02.719180  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:02.719188  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:02.719193  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:02.722363  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:02.723005  653531 pod_ready.go:92] pod "kube-apiserver-ha-735960-m03" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:02.723029  653531 pod_ready.go:81] duration metric: took 6.509269845s for pod "kube-apiserver-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:02.723044  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:02.723152  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960

	I0701 12:27:02.723163  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:02.723174  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:02.723186  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:02.726502  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:02.727250  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:02.727266  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:02.727277  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:02.727280  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:02.730522  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:02.731090  653531 pod_ready.go:92] pod "kube-controller-manager-ha-735960" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:02.731116  653531 pod_ready.go:81] duration metric: took 8.062099ms for pod "kube-controller-manager-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:02.731129  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:02.731206  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960-m02

	I0701 12:27:02.731216  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:02.731226  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:02.731232  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:02.734354  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:02.735350  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:27:02.735370  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:02.735378  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:02.735381  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:02.738250  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:27:02.739014  653531 pod_ready.go:92] pod "kube-controller-manager-ha-735960-m02" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:02.739035  653531 pod_ready.go:81] duration metric: took 7.898052ms for pod "kube-controller-manager-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:02.739045  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:02.739108  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960-m03

	I0701 12:27:02.739116  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:02.739125  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:02.739134  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:02.742376  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:02.743084  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:02.743106  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:02.743117  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:02.743121  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:02.746455  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:02.747046  653531 pod_ready.go:92] pod "kube-controller-manager-ha-735960-m03" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:02.747075  653531 pod_ready.go:81] duration metric: took 8.017741ms for pod "kube-controller-manager-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:02.747091  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-25ssf" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:02.747213  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-25ssf

	I0701 12:27:02.747226  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:02.747237  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:02.747242  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:02.750009  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:27:02.750887  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m04

	I0701 12:27:02.750910  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:02.750941  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:02.750947  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:02.753841  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:27:02.754410  653531 pod_ready.go:97] node "ha-735960-m04" hosting pod "kube-proxy-25ssf" in "kube-system" namespace is currently not "Ready" (skipping!): node "ha-735960-m04" has status "Ready":"Unknown"

	I0701 12:27:02.754439  653531 pod_ready.go:81] duration metric: took 7.336267ms for pod "kube-proxy-25ssf" in "kube-system" namespace to be "Ready" ...

	E0701 12:27:02.754453  653531 pod_ready.go:66] WaitExtra: waitPodCondition: node "ha-735960-m04" hosting pod "kube-proxy-25ssf" in "kube-system" namespace is currently not "Ready" (skipping!): node "ha-735960-m04" has status "Ready":"Unknown"

	I0701 12:27:02.754464  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-776rt" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:02.915931  653531 request.go:629] Waited for 161.334912ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-776rt

	I0701 12:27:02.916009  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-776rt

	I0701 12:27:02.916016  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:02.916026  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:02.916032  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:02.922578  653531 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0701 12:27:03.115563  653531 request.go:629] Waited for 192.243271ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:03.115665  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:03.115679  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:03.115693  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:03.115702  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:03.119673  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:03.120379  653531 pod_ready.go:92] pod "kube-proxy-776rt" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:03.120399  653531 pod_ready.go:81] duration metric: took 365.926734ms for pod "kube-proxy-776rt" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:03.120409  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-b6knb" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:03.315515  653531 request.go:629] Waited for 195.003147ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-b6knb

	I0701 12:27:03.315575  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-b6knb

	I0701 12:27:03.315580  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:03.315588  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:03.315593  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:03.319367  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:03.515329  653531 request.go:629] Waited for 195.408895ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:27:03.515421  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:27:03.515429  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:03.515440  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:03.515452  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:03.518825  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:03.519611  653531 pod_ready.go:92] pod "kube-proxy-b6knb" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:03.519633  653531 pod_ready.go:81] duration metric: took 399.213433ms for pod "kube-proxy-b6knb" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:03.519642  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-lphzn" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:03.715721  653531 request.go:629] Waited for 195.977677ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-lphzn

	I0701 12:27:03.715811  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-lphzn

	I0701 12:27:03.715820  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:03.715828  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:03.715833  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:03.720058  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:27:03.915338  653531 request.go:629] Waited for 194.486914ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:03.915438  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:03.915447  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:03.915455  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:03.915462  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:03.919143  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:03.919765  653531 pod_ready.go:92] pod "kube-proxy-lphzn" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:03.919789  653531 pod_ready.go:81] duration metric: took 400.14123ms for pod "kube-proxy-lphzn" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:03.919800  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:04.114907  653531 request.go:629] Waited for 195.032639ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960

	I0701 12:27:04.114983  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960

	I0701 12:27:04.115004  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:04.115019  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:04.115027  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:04.119283  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:27:04.315128  653531 request.go:629] Waited for 195.065236ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:04.315231  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:04.315243  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:04.315255  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:04.315264  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:04.319107  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:04.319792  653531 pod_ready.go:92] pod "kube-scheduler-ha-735960" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:04.319821  653531 pod_ready.go:81] duration metric: took 400.011957ms for pod "kube-scheduler-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:04.319838  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:04.515786  653531 request.go:629] Waited for 195.848501ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960-m02

	I0701 12:27:04.515865  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960-m02

	I0701 12:27:04.515872  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:04.515885  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:04.515894  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:04.519607  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:04.715555  653531 request.go:629] Waited for 195.254305ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:27:04.715662  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:27:04.715673  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:04.715686  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:04.715696  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:04.718989  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:04.719533  653531 pod_ready.go:92] pod "kube-scheduler-ha-735960-m02" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:04.719555  653531 pod_ready.go:81] duration metric: took 399.709368ms for pod "kube-scheduler-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:04.719565  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:04.915742  653531 request.go:629] Waited for 196.076319ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960-m03

	I0701 12:27:04.915873  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960-m03

	I0701 12:27:04.915884  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:04.915892  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:04.915896  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:04.919910  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:05.114903  653531 request.go:629] Waited for 194.321141ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:05.114998  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:05.115010  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:05.115020  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:05.115029  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:05.118835  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:05.119325  653531 pod_ready.go:92] pod "kube-scheduler-ha-735960-m03" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:05.119348  653531 pod_ready.go:81] duration metric: took 399.776156ms for pod "kube-scheduler-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:05.119360  653531 pod_ready.go:38] duration metric: took 21.966297492s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0701 12:27:05.119380  653531 api_server.go:52] waiting for apiserver process to appear ...

	I0701 12:27:05.119446  653531 ssh_runner.go:195] Run: sudo pgrep -xnf kube-apiserver.*minikube.*

	I0701 12:27:05.134970  653531 api_server.go:72] duration metric: took 22.668924734s to wait for apiserver process to appear ...

	I0701 12:27:05.135005  653531 api_server.go:88] waiting for apiserver healthz status ...

	I0701 12:27:05.135037  653531 api_server.go:253] Checking apiserver healthz at https://192.168.39.16:8443/healthz ...

	I0701 12:27:05.139924  653531 api_server.go:279] https://192.168.39.16:8443/healthz returned 200:

	ok

	I0701 12:27:05.140029  653531 round_trippers.go:463] GET https://192.168.39.16:8443/version

	I0701 12:27:05.140040  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:05.140052  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:05.140060  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:05.141045  653531 round_trippers.go:574] Response Status: 200 OK in 0 milliseconds

	I0701 12:27:05.141124  653531 api_server.go:141] control plane version: v1.30.2

	I0701 12:27:05.141142  653531 api_server.go:131] duration metric: took 6.129152ms to wait for apiserver health ...

	I0701 12:27:05.141156  653531 system_pods.go:43] waiting for kube-system pods to appear ...

	I0701 12:27:05.315496  653531 request.go:629] Waited for 174.257848ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods

	I0701 12:27:05.315603  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods

	I0701 12:27:05.315615  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:05.315627  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:05.315640  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:05.331176  653531 round_trippers.go:574] Response Status: 200 OK in 15 milliseconds

	I0701 12:27:05.341126  653531 system_pods.go:59] 26 kube-system pods found

	I0701 12:27:05.341168  653531 system_pods.go:61] "coredns-7db6d8ff4d-nk4lf" [c03dd635-a82d-4f18-bd72-ec575f91867e] Running

	I0701 12:27:05.341173  653531 system_pods.go:61] "coredns-7db6d8ff4d-p4rtz" [267efba7-bf34-48d5-ab15-5bda45ff2f4f] Running

	I0701 12:27:05.341177  653531 system_pods.go:61] "etcd-ha-735960" [4b98745c-292f-42b5-977c-69c50fd241f1] Running

	I0701 12:27:05.341181  653531 system_pods.go:61] "etcd-ha-735960-m02" [fed8cdfa-8428-47e0-84ef-05297ad232f8] Running

	I0701 12:27:05.341184  653531 system_pods.go:61] "etcd-ha-735960-m03" [50b07bc3-ff6b-487d-8654-901d96892868] Running

	I0701 12:27:05.341187  653531 system_pods.go:61] "kindnet-2424m" [aa18d5dd-f6eb-4f04-a61e-b0b257e214af] Running

	I0701 12:27:05.341190  653531 system_pods.go:61] "kindnet-6gx8s" [7f46a773-a075-476c-9e54-89f125b4b57a] Running

	I0701 12:27:05.341195  653531 system_pods.go:61] "kindnet-7f6hm" [a8c302b4-1163-4d4f-bfe3-4fd3b5d23cf0] Running

	I0701 12:27:05.341199  653531 system_pods.go:61] "kindnet-bztzv" [7afa0e45-3d10-40bc-b422-7005a3ca9d3a] Running

	I0701 12:27:05.341203  653531 system_pods.go:61] "kube-apiserver-ha-735960" [ad041aaa-465a-4d8a-a8dc-b7665e1d587d] Running

	I0701 12:27:05.341208  653531 system_pods.go:61] "kube-apiserver-ha-735960-m02" [ba28f48e-1c18-47e3-ab11-a9b5588c5c32] Running

	I0701 12:27:05.341213  653531 system_pods.go:61] "kube-apiserver-ha-735960-m03" [baafa3bf-78ee-4269-9591-b0440927e055] Running

	I0701 12:27:05.341218  653531 system_pods.go:61] "kube-controller-manager-ha-735960" [3f0f0cf5-329d-47bc-b922-7583902e2607] Running

	I0701 12:27:05.341222  653531 system_pods.go:61] "kube-controller-manager-ha-735960-m02" [258fde18-ac5c-4446-842b-9465529b154c] Running

	I0701 12:27:05.341231  653531 system_pods.go:61] "kube-controller-manager-ha-735960-m03" [79acc56b-a9e0-4d4b-bc64-1a3a36ddf051] Running

	I0701 12:27:05.341235  653531 system_pods.go:61] "kube-proxy-25ssf" [11f0dc23-ab9d-4d39-988d-4c44dfde86cd] Running

	I0701 12:27:05.341244  653531 system_pods.go:61] "kube-proxy-776rt" [5666dac7-924e-4429-bd1d-a1a5647cc611] Running

	I0701 12:27:05.341248  653531 system_pods.go:61] "kube-proxy-b6knb" [eb36e930-5799-4ff7-821a-ccb22303cd1b] Running

	I0701 12:27:05.341253  653531 system_pods.go:61] "kube-proxy-lphzn" [0761a7a6-740e-4cde-9ab5-e02e8d417907] Running

	I0701 12:27:05.341258  653531 system_pods.go:61] "kube-scheduler-ha-735960" [c624cf42-a7d6-4aaf-859d-1aeaf29f9acb] Running

	I0701 12:27:05.341266  653531 system_pods.go:61] "kube-scheduler-ha-735960-m02" [7de78af7-2d79-46dc-bd34-f221d79fde06] Running

	I0701 12:27:05.341276  653531 system_pods.go:61] "kube-scheduler-ha-735960-m03" [9f9a2030-9332-44af-b8dc-3b4609e53f91] Running

	I0701 12:27:05.341284  653531 system_pods.go:61] "kube-vip-ha-735960" [4299679a-c145-4f4f-8ec6-3cd468b98ef1] Running

	I0701 12:27:05.341289  653531 system_pods.go:61] "kube-vip-ha-735960-m02" [1c9b13e1-515c-43c0-8d99-5ad1c1807727] Running

	I0701 12:27:05.341296  653531 system_pods.go:61] "kube-vip-ha-735960-m03" [7069ea7c-5461-4fe6-a969-97fe33396ebb] Running

	I0701 12:27:05.341300  653531 system_pods.go:61] "storage-provisioner" [f5c4f7f9-d648-4019-a5ea-6ce59f6c5663] Running

	I0701 12:27:05.341308  653531 system_pods.go:74] duration metric: took 200.142768ms to wait for pod list to return data ...

	I0701 12:27:05.341319  653531 default_sa.go:34] waiting for default service account to be created ...

	I0701 12:27:05.515805  653531 request.go:629] Waited for 174.38988ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/default/serviceaccounts

	I0701 12:27:05.515869  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/default/serviceaccounts

	I0701 12:27:05.515874  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:05.515882  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:05.515886  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:05.519545  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:05.519680  653531 default_sa.go:45] found service account: "default"

	I0701 12:27:05.519701  653531 default_sa.go:55] duration metric: took 178.373792ms for default service account to be created ...

	I0701 12:27:05.519712  653531 system_pods.go:116] waiting for k8s-apps to be running ...

	I0701 12:27:05.715337  653531 request.go:629] Waited for 195.548539ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods

	I0701 12:27:05.715405  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods

	I0701 12:27:05.715411  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:05.715423  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:05.715431  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:05.722571  653531 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0701 12:27:05.729587  653531 system_pods.go:86] 26 kube-system pods found

	I0701 12:27:05.729628  653531 system_pods.go:89] "coredns-7db6d8ff4d-nk4lf" [c03dd635-a82d-4f18-bd72-ec575f91867e] Running

	I0701 12:27:05.729636  653531 system_pods.go:89] "coredns-7db6d8ff4d-p4rtz" [267efba7-bf34-48d5-ab15-5bda45ff2f4f] Running

	I0701 12:27:05.729642  653531 system_pods.go:89] "etcd-ha-735960" [4b98745c-292f-42b5-977c-69c50fd241f1] Running

	I0701 12:27:05.729649  653531 system_pods.go:89] "etcd-ha-735960-m02" [fed8cdfa-8428-47e0-84ef-05297ad232f8] Running

	I0701 12:27:05.729655  653531 system_pods.go:89] "etcd-ha-735960-m03" [50b07bc3-ff6b-487d-8654-901d96892868] Running

	I0701 12:27:05.729661  653531 system_pods.go:89] "kindnet-2424m" [aa18d5dd-f6eb-4f04-a61e-b0b257e214af] Running

	I0701 12:27:05.729666  653531 system_pods.go:89] "kindnet-6gx8s" [7f46a773-a075-476c-9e54-89f125b4b57a] Running

	I0701 12:27:05.729671  653531 system_pods.go:89] "kindnet-7f6hm" [a8c302b4-1163-4d4f-bfe3-4fd3b5d23cf0] Running

	I0701 12:27:05.729677  653531 system_pods.go:89] "kindnet-bztzv" [7afa0e45-3d10-40bc-b422-7005a3ca9d3a] Running

	I0701 12:27:05.729684  653531 system_pods.go:89] "kube-apiserver-ha-735960" [ad041aaa-465a-4d8a-a8dc-b7665e1d587d] Running

	I0701 12:27:05.729689  653531 system_pods.go:89] "kube-apiserver-ha-735960-m02" [ba28f48e-1c18-47e3-ab11-a9b5588c5c32] Running

	I0701 12:27:05.729695  653531 system_pods.go:89] "kube-apiserver-ha-735960-m03" [baafa3bf-78ee-4269-9591-b0440927e055] Running

	I0701 12:27:05.729702  653531 system_pods.go:89] "kube-controller-manager-ha-735960" [3f0f0cf5-329d-47bc-b922-7583902e2607] Running

	I0701 12:27:05.729710  653531 system_pods.go:89] "kube-controller-manager-ha-735960-m02" [258fde18-ac5c-4446-842b-9465529b154c] Running

	I0701 12:27:05.729720  653531 system_pods.go:89] "kube-controller-manager-ha-735960-m03" [79acc56b-a9e0-4d4b-bc64-1a3a36ddf051] Running

	I0701 12:27:05.729729  653531 system_pods.go:89] "kube-proxy-25ssf" [11f0dc23-ab9d-4d39-988d-4c44dfde86cd] Running

	I0701 12:27:05.729737  653531 system_pods.go:89] "kube-proxy-776rt" [5666dac7-924e-4429-bd1d-a1a5647cc611] Running

	I0701 12:27:05.729745  653531 system_pods.go:89] "kube-proxy-b6knb" [eb36e930-5799-4ff7-821a-ccb22303cd1b] Running

	I0701 12:27:05.729755  653531 system_pods.go:89] "kube-proxy-lphzn" [0761a7a6-740e-4cde-9ab5-e02e8d417907] Running

	I0701 12:27:05.729764  653531 system_pods.go:89] "kube-scheduler-ha-735960" [c624cf42-a7d6-4aaf-859d-1aeaf29f9acb] Running

	I0701 12:27:05.729770  653531 system_pods.go:89] "kube-scheduler-ha-735960-m02" [7de78af7-2d79-46dc-bd34-f221d79fde06] Running

	I0701 12:27:05.729776  653531 system_pods.go:89] "kube-scheduler-ha-735960-m03" [9f9a2030-9332-44af-b8dc-3b4609e53f91] Running

	I0701 12:27:05.729783  653531 system_pods.go:89] "kube-vip-ha-735960" [4299679a-c145-4f4f-8ec6-3cd468b98ef1] Running

	I0701 12:27:05.729789  653531 system_pods.go:89] "kube-vip-ha-735960-m02" [1c9b13e1-515c-43c0-8d99-5ad1c1807727] Running

	I0701 12:27:05.729796  653531 system_pods.go:89] "kube-vip-ha-735960-m03" [7069ea7c-5461-4fe6-a969-97fe33396ebb] Running

	I0701 12:27:05.729802  653531 system_pods.go:89] "storage-provisioner" [f5c4f7f9-d648-4019-a5ea-6ce59f6c5663] Running

	I0701 12:27:05.729815  653531 system_pods.go:126] duration metric: took 210.095212ms to wait for k8s-apps to be running ...

	I0701 12:27:05.729829  653531 system_svc.go:44] waiting for kubelet service to be running ....

	I0701 12:27:05.729888  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0701 12:27:05.745646  653531 system_svc.go:56] duration metric: took 15.808828ms WaitForService to wait for kubelet

	I0701 12:27:05.745679  653531 kubeadm.go:576] duration metric: took 23.279640822s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0701 12:27:05.745702  653531 node_conditions.go:102] verifying NodePressure condition ...

	I0701 12:27:05.915161  653531 request.go:629] Waited for 169.354932ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes

	I0701 12:27:05.915221  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes

	I0701 12:27:05.915226  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:05.915234  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:05.915239  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:05.919105  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:05.920307  653531 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0701 12:27:05.920336  653531 node_conditions.go:123] node cpu capacity is 2

	I0701 12:27:05.920352  653531 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0701 12:27:05.920357  653531 node_conditions.go:123] node cpu capacity is 2

	I0701 12:27:05.920361  653531 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0701 12:27:05.920366  653531 node_conditions.go:123] node cpu capacity is 2

	I0701 12:27:05.920370  653531 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0701 12:27:05.920375  653531 node_conditions.go:123] node cpu capacity is 2

	I0701 12:27:05.920382  653531 node_conditions.go:105] duration metric: took 174.672945ms to run NodePressure ...

	I0701 12:27:05.920400  653531 start.go:240] waiting for startup goroutines ...

	I0701 12:27:05.920438  653531 start.go:254] writing updated cluster config ...

	I0701 12:27:05.922556  653531 out.go:177] 

	I0701 12:27:05.924320  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:27:05.924444  653531 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:27:05.926228  653531 out.go:177] * Starting "ha-735960-m04" worker node in "ha-735960" cluster

	I0701 12:27:05.927583  653531 preload.go:132] Checking if preload exists for k8s version v1.30.2 and runtime docker

	I0701 12:27:05.927623  653531 cache.go:56] Caching tarball of preloaded images

	I0701 12:27:05.927740  653531 preload.go:173] Found /home/jenkins/minikube-integration/19166-630650/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.30.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download

	I0701 12:27:05.927753  653531 cache.go:59] Finished verifying existence of preloaded tar for v1.30.2 on docker

	I0701 12:27:05.927868  653531 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:27:05.928081  653531 start.go:360] acquireMachinesLock for ha-735960-m04: {Name:mk43a6c0c0c15a237623df377ad65b82186c0ad8 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}

	I0701 12:27:05.928138  653531 start.go:364] duration metric: took 34.293µs to acquireMachinesLock for "ha-735960-m04"

	I0701 12:27:05.928160  653531 start.go:96] Skipping create...Using existing machine configuration

	I0701 12:27:05.928170  653531 fix.go:54] fixHost starting: m04

	I0701 12:27:05.928452  653531 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:27:05.928496  653531 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:27:05.944734  653531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39337

	I0701 12:27:05.945306  653531 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:27:05.945856  653531 main.go:141] libmachine: Using API Version  1

	I0701 12:27:05.945878  653531 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:27:05.946270  653531 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:27:05.946505  653531 main.go:141] libmachine: (ha-735960-m04) Calling .DriverName

	I0701 12:27:05.946718  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetState

	I0701 12:27:05.948900  653531 fix.go:112] recreateIfNeeded on ha-735960-m04: state=Stopped err=<nil>

	I0701 12:27:05.948936  653531 main.go:141] libmachine: (ha-735960-m04) Calling .DriverName

	W0701 12:27:05.949137  653531 fix.go:138] unexpected machine state, will restart: <nil>

	I0701 12:27:05.951007  653531 out.go:177] * Restarting existing kvm2 VM for "ha-735960-m04" ...

	I0701 12:27:05.952219  653531 main.go:141] libmachine: (ha-735960-m04) Calling .Start

	I0701 12:27:05.952428  653531 main.go:141] libmachine: (ha-735960-m04) Ensuring networks are active...

	I0701 12:27:05.953378  653531 main.go:141] libmachine: (ha-735960-m04) Ensuring network default is active

	I0701 12:27:05.953815  653531 main.go:141] libmachine: (ha-735960-m04) Ensuring network mk-ha-735960 is active

	I0701 12:27:05.954229  653531 main.go:141] libmachine: (ha-735960-m04) Getting domain xml...

	I0701 12:27:05.954857  653531 main.go:141] libmachine: (ha-735960-m04) Creating domain...

	I0701 12:27:07.274791  653531 main.go:141] libmachine: (ha-735960-m04) Waiting to get IP...

	I0701 12:27:07.275684  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:07.276224  653531 main.go:141] libmachine: (ha-735960-m04) DBG | unable to find current IP address of domain ha-735960-m04 in network mk-ha-735960

	I0701 12:27:07.276269  653531 main.go:141] libmachine: (ha-735960-m04) DBG | I0701 12:27:07.276176  654403 retry.go:31] will retry after 236.931472ms: waiting for machine to come up

	I0701 12:27:07.514910  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:07.515487  653531 main.go:141] libmachine: (ha-735960-m04) DBG | unable to find current IP address of domain ha-735960-m04 in network mk-ha-735960

	I0701 12:27:07.515520  653531 main.go:141] libmachine: (ha-735960-m04) DBG | I0701 12:27:07.515422  654403 retry.go:31] will retry after 376.766943ms: waiting for machine to come up

	I0701 12:27:07.894235  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:07.894716  653531 main.go:141] libmachine: (ha-735960-m04) DBG | unable to find current IP address of domain ha-735960-m04 in network mk-ha-735960

	I0701 12:27:07.894748  653531 main.go:141] libmachine: (ha-735960-m04) DBG | I0701 12:27:07.894658  654403 retry.go:31] will retry after 389.939732ms: waiting for machine to come up

	I0701 12:27:08.286528  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:08.287041  653531 main.go:141] libmachine: (ha-735960-m04) DBG | unable to find current IP address of domain ha-735960-m04 in network mk-ha-735960

	I0701 12:27:08.287066  653531 main.go:141] libmachine: (ha-735960-m04) DBG | I0701 12:27:08.286982  654403 retry.go:31] will retry after 542.184171ms: waiting for machine to come up

	I0701 12:27:08.831459  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:08.832024  653531 main.go:141] libmachine: (ha-735960-m04) DBG | unable to find current IP address of domain ha-735960-m04 in network mk-ha-735960

	I0701 12:27:08.832105  653531 main.go:141] libmachine: (ha-735960-m04) DBG | I0701 12:27:08.832069  654403 retry.go:31] will retry after 609.488369ms: waiting for machine to come up

	I0701 12:27:09.442798  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:09.443236  653531 main.go:141] libmachine: (ha-735960-m04) DBG | unable to find current IP address of domain ha-735960-m04 in network mk-ha-735960

	I0701 12:27:09.443272  653531 main.go:141] libmachine: (ha-735960-m04) DBG | I0701 12:27:09.443174  654403 retry.go:31] will retry after 777.604605ms: waiting for machine to come up

	I0701 12:27:10.221860  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:10.222317  653531 main.go:141] libmachine: (ha-735960-m04) DBG | unable to find current IP address of domain ha-735960-m04 in network mk-ha-735960

	I0701 12:27:10.222352  653531 main.go:141] libmachine: (ha-735960-m04) DBG | I0701 12:27:10.222242  654403 retry.go:31] will retry after 1.013463977s: waiting for machine to come up

	I0701 12:27:11.237171  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:11.237628  653531 main.go:141] libmachine: (ha-735960-m04) DBG | unable to find current IP address of domain ha-735960-m04 in network mk-ha-735960

	I0701 12:27:11.237658  653531 main.go:141] libmachine: (ha-735960-m04) DBG | I0701 12:27:11.237572  654403 retry.go:31] will retry after 1.368493369s: waiting for machine to come up

	I0701 12:27:12.607736  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:12.608308  653531 main.go:141] libmachine: (ha-735960-m04) DBG | unable to find current IP address of domain ha-735960-m04 in network mk-ha-735960

	I0701 12:27:12.608342  653531 main.go:141] libmachine: (ha-735960-m04) DBG | I0701 12:27:12.608254  654403 retry.go:31] will retry after 1.709127759s: waiting for machine to come up

	I0701 12:27:14.320033  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:14.320531  653531 main.go:141] libmachine: (ha-735960-m04) DBG | unable to find current IP address of domain ha-735960-m04 in network mk-ha-735960

	I0701 12:27:14.320565  653531 main.go:141] libmachine: (ha-735960-m04) DBG | I0701 12:27:14.320491  654403 retry.go:31] will retry after 2.145058749s: waiting for machine to come up

	I0701 12:27:16.466840  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:16.467246  653531 main.go:141] libmachine: (ha-735960-m04) DBG | unable to find current IP address of domain ha-735960-m04 in network mk-ha-735960

	I0701 12:27:16.467275  653531 main.go:141] libmachine: (ha-735960-m04) DBG | I0701 12:27:16.467196  654403 retry.go:31] will retry after 2.340416682s: waiting for machine to come up

	I0701 12:27:18.809756  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:18.810215  653531 main.go:141] libmachine: (ha-735960-m04) DBG | unable to find current IP address of domain ha-735960-m04 in network mk-ha-735960

	I0701 12:27:18.810245  653531 main.go:141] libmachine: (ha-735960-m04) DBG | I0701 12:27:18.810155  654403 retry.go:31] will retry after 2.893605535s: waiting for machine to come up

	I0701 12:27:21.705535  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:21.706011  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has current primary IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:21.706036  653531 main.go:141] libmachine: (ha-735960-m04) Found IP for machine: 192.168.39.60

	I0701 12:27:21.706050  653531 main.go:141] libmachine: (ha-735960-m04) Reserving static IP address...

	I0701 12:27:21.706638  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "ha-735960-m04", mac: "52:54:00:2d:8e:6d", ip: "192.168.39.60"} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:21.706671  653531 main.go:141] libmachine: (ha-735960-m04) Reserved static IP address: 192.168.39.60

	I0701 12:27:21.706689  653531 main.go:141] libmachine: (ha-735960-m04) DBG | skip adding static IP to network mk-ha-735960 - found existing host DHCP lease matching {name: "ha-735960-m04", mac: "52:54:00:2d:8e:6d", ip: "192.168.39.60"}

	I0701 12:27:21.706703  653531 main.go:141] libmachine: (ha-735960-m04) DBG | Getting to WaitForSSH function...

	I0701 12:27:21.706715  653531 main.go:141] libmachine: (ha-735960-m04) Waiting for SSH to be available...

	I0701 12:27:21.709236  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:21.709702  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:21.709729  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:21.709818  653531 main.go:141] libmachine: (ha-735960-m04) DBG | Using SSH client type: external

	I0701 12:27:21.709841  653531 main.go:141] libmachine: (ha-735960-m04) DBG | Using SSH private key: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m04/id_rsa (-rw-------)

	I0701 12:27:21.709870  653531 main.go:141] libmachine: (ha-735960-m04) DBG | &{[-F /dev/null -o ConnectionAttempts=3 -o ConnectTimeout=10 -o ControlMaster=no -o ControlPath=none -o LogLevel=quiet -o PasswordAuthentication=no -o ServerAliveInterval=60 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null docker@192.168.39.60 -o IdentitiesOnly=yes -i /home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m04/id_rsa -p 22] /usr/bin/ssh <nil>}

	I0701 12:27:21.709885  653531 main.go:141] libmachine: (ha-735960-m04) DBG | About to run SSH command:

	I0701 12:27:21.709897  653531 main.go:141] libmachine: (ha-735960-m04) DBG | exit 0

	I0701 12:27:21.838462  653531 main.go:141] libmachine: (ha-735960-m04) DBG | SSH cmd err, output: <nil>: 

	I0701 12:27:21.838803  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetConfigRaw

	I0701 12:27:21.839497  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetIP

	I0701 12:27:21.842255  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:21.842727  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:21.842764  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:21.843067  653531 profile.go:143] Saving config to /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/config.json ...

	I0701 12:27:21.843309  653531 machine.go:94] provisionDockerMachine start ...

	I0701 12:27:21.843332  653531 main.go:141] libmachine: (ha-735960-m04) Calling .DriverName

	I0701 12:27:21.843625  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHHostname

	I0701 12:27:21.846158  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:21.846625  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:21.846658  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:21.846874  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHPort

	I0701 12:27:21.847122  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:21.847313  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:21.847496  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHUsername

	I0701 12:27:21.847763  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:27:21.847995  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.60 22 <nil> <nil>}

	I0701 12:27:21.848012  653531 main.go:141] libmachine: About to run SSH command:

	hostname

	I0701 12:27:21.958527  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: minikube

	I0701 12:27:21.958560  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetMachineName

	I0701 12:27:21.958896  653531 buildroot.go:166] provisioning hostname "ha-735960-m04"

	I0701 12:27:21.958928  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetMachineName

	I0701 12:27:21.959168  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHHostname

	I0701 12:27:21.961718  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:21.962176  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:21.962212  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:21.962410  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHPort

	I0701 12:27:21.962629  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:21.962804  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:21.962930  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHUsername

	I0701 12:27:21.963089  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:27:21.963293  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.60 22 <nil> <nil>}

	I0701 12:27:21.963311  653531 main.go:141] libmachine: About to run SSH command:

	sudo hostname ha-735960-m04 && echo "ha-735960-m04" | sudo tee /etc/hostname

	I0701 12:27:22.089150  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: ha-735960-m04

	I0701 12:27:22.089185  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHHostname

	I0701 12:27:22.092352  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:22.092805  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:22.092829  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:22.093059  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHPort

	I0701 12:27:22.093293  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:22.093532  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:22.093680  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHUsername

	I0701 12:27:22.093947  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:27:22.094124  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.60 22 <nil> <nil>}

	I0701 12:27:22.094152  653531 main.go:141] libmachine: About to run SSH command:

			if ! grep -xq '.*\sha-735960-m04' /etc/hosts; then

				if grep -xq '127.0.1.1\s.*' /etc/hosts; then

					sudo sed -i 's/^127.0.1.1\s.*/127.0.1.1 ha-735960-m04/g' /etc/hosts;

				else 

					echo '127.0.1.1 ha-735960-m04' | sudo tee -a /etc/hosts; 

				fi

			fi

	I0701 12:27:22.211873  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: 

	I0701 12:27:22.211908  653531 buildroot.go:172] set auth options {CertDir:/home/jenkins/minikube-integration/19166-630650/.minikube CaCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem CaPrivateKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem CaCertRemotePath:/etc/docker/ca.pem ServerCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ServerKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem ClientKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem ServerCertRemotePath:/etc/docker/server.pem ServerKeyRemotePath:/etc/docker/server-key.pem ClientCertPath:/home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem ServerCertSANs:[] StorePath:/home/jenkins/minikube-integration/19166-630650/.minikube}

	I0701 12:27:22.211930  653531 buildroot.go:174] setting up certificates

	I0701 12:27:22.211938  653531 provision.go:84] configureAuth start

	I0701 12:27:22.211947  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetMachineName

	I0701 12:27:22.212269  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetIP

	I0701 12:27:22.215120  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:22.215523  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:22.215555  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:22.215810  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHHostname

	I0701 12:27:22.218161  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:22.218800  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:22.218836  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:22.219044  653531 provision.go:143] copyHostCerts

	I0701 12:27:22.219086  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:27:22.219130  653531 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem, removing ...

	I0701 12:27:22.219141  653531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem

	I0701 12:27:22.219226  653531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/ca.pem (1078 bytes)

	I0701 12:27:22.219330  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:27:22.219356  653531 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem, removing ...

	I0701 12:27:22.219365  653531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem

	I0701 12:27:22.219402  653531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/cert.pem (1123 bytes)

	I0701 12:27:22.219472  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem -> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:27:22.219497  653531 exec_runner.go:144] found /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem, removing ...

	I0701 12:27:22.219503  653531 exec_runner.go:203] rm: /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem

	I0701 12:27:22.219534  653531 exec_runner.go:151] cp: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem --> /home/jenkins/minikube-integration/19166-630650/.minikube/key.pem (1675 bytes)

	I0701 12:27:22.219602  653531 provision.go:117] generating server cert: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem ca-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem private-key=/home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem org=jenkins.ha-735960-m04 san=[127.0.0.1 192.168.39.60 ha-735960-m04 localhost minikube]

	I0701 12:27:22.329827  653531 provision.go:177] copyRemoteCerts

	I0701 12:27:22.329892  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/docker /etc/docker /etc/docker

	I0701 12:27:22.329923  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHHostname

	I0701 12:27:22.332967  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:22.333373  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:22.333406  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:22.333651  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHPort

	I0701 12:27:22.333896  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:22.334062  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHUsername

	I0701 12:27:22.334281  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m04/id_rsa Username:docker}

	I0701 12:27:22.417286  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem -> /etc/docker/ca.pem

	I0701 12:27:22.417383  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem --> /etc/docker/ca.pem (1078 bytes)

	I0701 12:27:22.441229  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem -> /etc/docker/server.pem

	I0701 12:27:22.441316  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server.pem --> /etc/docker/server.pem (1208 bytes)

	I0701 12:27:22.465192  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem -> /etc/docker/server-key.pem

	I0701 12:27:22.465262  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/machines/server-key.pem --> /etc/docker/server-key.pem (1675 bytes)

	I0701 12:27:22.489482  653531 provision.go:87] duration metric: took 277.524425ms to configureAuth

	I0701 12:27:22.489525  653531 buildroot.go:189] setting minikube options for container-runtime

	I0701 12:27:22.489832  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:27:22.489882  653531 main.go:141] libmachine: (ha-735960-m04) Calling .DriverName

	I0701 12:27:22.490191  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHHostname

	I0701 12:27:22.493387  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:22.493808  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:22.493842  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:22.494001  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHPort

	I0701 12:27:22.494272  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:22.494482  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:22.494666  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHUsername

	I0701 12:27:22.494871  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:27:22.495082  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.60 22 <nil> <nil>}

	I0701 12:27:22.495096  653531 main.go:141] libmachine: About to run SSH command:

	df --output=fstype / | tail -n 1

	I0701 12:27:22.603693  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: tmpfs

	I0701 12:27:22.603722  653531 buildroot.go:70] root file system type: tmpfs

	I0701 12:27:22.603868  653531 provision.go:314] Updating docker unit: /lib/systemd/system/docker.service ...

	I0701 12:27:22.603921  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHHostname

	I0701 12:27:22.606932  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:22.607406  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:22.607441  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:22.607659  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHPort

	I0701 12:27:22.607881  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:22.608030  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:22.608161  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHUsername

	I0701 12:27:22.608332  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:27:22.608539  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.60 22 <nil> <nil>}

	I0701 12:27:22.608607  653531 main.go:141] libmachine: About to run SSH command:

	sudo mkdir -p /lib/systemd/system && printf %!s(MISSING) "[Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment="NO_PROXY=192.168.39.16"

	Environment="NO_PROXY=192.168.39.16,192.168.39.86"

	Environment="NO_PROXY=192.168.39.16,192.168.39.86,192.168.39.97"

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP \$MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	" | sudo tee /lib/systemd/system/docker.service.new

	I0701 12:27:22.729176  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: [Unit]

	Description=Docker Application Container Engine

	Documentation=https://docs.docker.com

	After=network.target  minikube-automount.service docker.socket

	Requires= minikube-automount.service docker.socket 

	StartLimitBurst=3

	StartLimitIntervalSec=60

	[Service]

	Type=notify

	Restart=on-failure

	Environment=NO_PROXY=192.168.39.16

	Environment=NO_PROXY=192.168.39.16,192.168.39.86

	Environment=NO_PROXY=192.168.39.16,192.168.39.86,192.168.39.97

	# This file is a systemd drop-in unit that inherits from the base dockerd configuration.

	# The base configuration already specifies an 'ExecStart=...' command. The first directive

	# here is to clear out that command inherited from the base configuration. Without this,

	# the command from the base configuration and the command specified here are treated as

	# a sequence of commands, which is not the desired behavior, nor is it valid -- systemd

	# will catch this invalid input and refuse to start the service with an error like:

	#  Service has more than one ExecStart= setting, which is only allowed for Type=oneshot services.

	# NOTE: default-ulimit=nofile is set to an arbitrary number for consistency with other

	# container runtimes. If left unlimited, it may result in OOM issues with MySQL.

	ExecStart=

	ExecStart=/usr/bin/dockerd -H tcp://0.0.0.0:2376 -H unix:///var/run/docker.sock --default-ulimit=nofile=1048576:1048576 --tlsverify --tlscacert /etc/docker/ca.pem --tlscert /etc/docker/server.pem --tlskey /etc/docker/server-key.pem --label provider=kvm2 --insecure-registry 10.96.0.0/12 

	ExecReload=/bin/kill -s HUP $MAINPID

	# Having non-zero Limit*s causes performance problems due to accounting overhead

	# in the kernel. We recommend using cgroups to do container-local accounting.

	LimitNOFILE=infinity

	LimitNPROC=infinity

	LimitCORE=infinity

	# Uncomment TasksMax if your systemd version supports it.

	# Only systemd 226 and above support this version.

	TasksMax=infinity

	TimeoutStartSec=0

	# set delegate yes so that systemd does not reset the cgroups of docker containers

	Delegate=yes

	# kill only the docker process, not all processes in the cgroup

	KillMode=process

	[Install]

	WantedBy=multi-user.target

	I0701 12:27:22.729234  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHHostname

	I0701 12:27:22.732936  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:22.733425  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:22.733462  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:22.733653  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHPort

	I0701 12:27:22.733908  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:22.734181  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:22.734376  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHUsername

	I0701 12:27:22.734607  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:27:22.734842  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.60 22 <nil> <nil>}

	I0701 12:27:22.734871  653531 main.go:141] libmachine: About to run SSH command:

	sudo diff -u /lib/systemd/system/docker.service /lib/systemd/system/docker.service.new || { sudo mv /lib/systemd/system/docker.service.new /lib/systemd/system/docker.service; sudo systemctl -f daemon-reload && sudo systemctl -f enable docker && sudo systemctl -f restart docker; }

	I0701 12:27:24.534039  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: diff: can't stat '/lib/systemd/system/docker.service': No such file or directory

	Created symlink /etc/systemd/system/multi-user.target.wants/docker.service → /usr/lib/systemd/system/docker.service.

	I0701 12:27:24.534075  653531 machine.go:97] duration metric: took 2.690748128s to provisionDockerMachine

	I0701 12:27:24.534091  653531 start.go:293] postStartSetup for "ha-735960-m04" (driver="kvm2")

	I0701 12:27:24.534104  653531 start.go:322] creating required directories: [/etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs]

	I0701 12:27:24.534123  653531 main.go:141] libmachine: (ha-735960-m04) Calling .DriverName

	I0701 12:27:24.534499  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/kubernetes/addons /etc/kubernetes/manifests /var/tmp/minikube /var/lib/minikube /var/lib/minikube/certs /var/lib/minikube/images /var/lib/minikube/binaries /tmp/gvisor /usr/share/ca-certificates /etc/ssl/certs

	I0701 12:27:24.534541  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHHostname

	I0701 12:27:24.537254  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:24.537740  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:24.537779  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:24.537959  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHPort

	I0701 12:27:24.538181  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:24.538373  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHUsername

	I0701 12:27:24.538597  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m04/id_rsa Username:docker}

	I0701 12:27:24.622239  653531 ssh_runner.go:195] Run: cat /etc/os-release

	I0701 12:27:24.626566  653531 info.go:137] Remote host: Buildroot 2023.02.9

	I0701 12:27:24.626597  653531 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/addons for local assets ...

	I0701 12:27:24.626682  653531 filesync.go:126] Scanning /home/jenkins/minikube-integration/19166-630650/.minikube/files for local assets ...

	I0701 12:27:24.626776  653531 filesync.go:149] local asset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> 6378542.pem in /etc/ssl/certs

	I0701 12:27:24.626790  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /etc/ssl/certs/6378542.pem

	I0701 12:27:24.626899  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/ssl/certs

	I0701 12:27:24.638615  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:27:24.662568  653531 start.go:296] duration metric: took 128.459164ms for postStartSetup

	I0701 12:27:24.662618  653531 main.go:141] libmachine: (ha-735960-m04) Calling .DriverName

	I0701 12:27:24.663010  653531 ssh_runner.go:195] Run: sudo ls --almost-all -1 /var/lib/minikube/backup

	I0701 12:27:24.663051  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHHostname

	I0701 12:27:24.665748  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:24.666087  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:24.666114  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:24.666265  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHPort

	I0701 12:27:24.666549  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:24.666727  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHUsername

	I0701 12:27:24.666943  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m04/id_rsa Username:docker}

	I0701 12:27:24.753987  653531 machine.go:198] restoring vm config from /var/lib/minikube/backup: [etc]

	I0701 12:27:24.754081  653531 ssh_runner.go:195] Run: sudo rsync --archive --update /var/lib/minikube/backup/etc /

	I0701 12:27:24.791910  653531 fix.go:56] duration metric: took 18.863722464s for fixHost

	I0701 12:27:24.791970  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHHostname

	I0701 12:27:24.795473  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:24.795824  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:24.795860  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:24.796063  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHPort

	I0701 12:27:24.796321  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:24.796518  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:24.796690  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHUsername

	I0701 12:27:24.796892  653531 main.go:141] libmachine: Using SSH client type: native

	I0701 12:27:24.797130  653531 main.go:141] libmachine: &{{{<nil> 0 [] [] []} docker [0x82d960] 0x8306c0 <nil>  [] 0s} 192.168.39.60 22 <nil> <nil>}

	I0701 12:27:24.797146  653531 main.go:141] libmachine: About to run SSH command:

	date +%!s(MISSING).%!N(MISSING)

	I0701 12:27:24.911069  653531 main.go:141] libmachine: SSH cmd err, output: <nil>: 1719836844.884316737

	I0701 12:27:24.911100  653531 fix.go:216] guest clock: 1719836844.884316737

	I0701 12:27:24.911110  653531 fix.go:229] Guest: 2024-07-01 12:27:24.884316737 +0000 UTC Remote: 2024-07-01 12:27:24.791945819 +0000 UTC m=+202.261797488 (delta=92.370918ms)

	I0701 12:27:24.911131  653531 fix.go:200] guest clock delta is within tolerance: 92.370918ms

	I0701 12:27:24.911137  653531 start.go:83] releasing machines lock for "ha-735960-m04", held for 18.982986548s

	I0701 12:27:24.911163  653531 main.go:141] libmachine: (ha-735960-m04) Calling .DriverName

	I0701 12:27:24.911481  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetIP

	I0701 12:27:24.914298  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:24.914691  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:24.914721  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:24.917119  653531 out.go:177] * Found network options:

	I0701 12:27:24.918569  653531 out.go:177]   - NO_PROXY=192.168.39.16,192.168.39.86,192.168.39.97

	W0701 12:27:24.919961  653531 proxy.go:119] fail to check proxy env: Error ip not in block

	W0701 12:27:24.919987  653531 proxy.go:119] fail to check proxy env: Error ip not in block

	W0701 12:27:24.919997  653531 proxy.go:119] fail to check proxy env: Error ip not in block

	I0701 12:27:24.920012  653531 main.go:141] libmachine: (ha-735960-m04) Calling .DriverName

	I0701 12:27:24.920847  653531 main.go:141] libmachine: (ha-735960-m04) Calling .DriverName

	I0701 12:27:24.921063  653531 main.go:141] libmachine: (ha-735960-m04) Calling .DriverName

	I0701 12:27:24.921170  653531 ssh_runner.go:195] Run: curl -sS -m 2 https://registry.k8s.io/

	I0701 12:27:24.921210  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHHostname

	W0701 12:27:24.921252  653531 proxy.go:119] fail to check proxy env: Error ip not in block

	W0701 12:27:24.921277  653531 proxy.go:119] fail to check proxy env: Error ip not in block

	W0701 12:27:24.921290  653531 proxy.go:119] fail to check proxy env: Error ip not in block

	I0701 12:27:24.921364  653531 ssh_runner.go:195] Run: sh -c "stat /etc/cni/net.d/*loopback.conf*"

	I0701 12:27:24.921385  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHHostname

	I0701 12:27:24.924253  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:24.924561  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:24.924715  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:24.924742  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:24.924933  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHPort

	I0701 12:27:24.925058  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:24.925080  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:24.925110  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:24.925325  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHUsername

	I0701 12:27:24.925339  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHPort

	I0701 12:27:24.925519  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHKeyPath

	I0701 12:27:24.925615  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m04/id_rsa Username:docker}

	I0701 12:27:24.925685  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetSSHUsername

	I0701 12:27:24.925840  653531 sshutil.go:53] new ssh client: &{IP:192.168.39.60 Port:22 SSHKeyPath:/home/jenkins/minikube-integration/19166-630650/.minikube/machines/ha-735960-m04/id_rsa Username:docker}

	W0701 12:27:25.004044  653531 cni.go:209] loopback cni configuration skipped: "/etc/cni/net.d/*loopback.conf*" not found

	I0701 12:27:25.004109  653531 ssh_runner.go:195] Run: sudo find /etc/cni/net.d -maxdepth 1 -type f ( ( -name *bridge* -or -name *podman* ) -and -not -name *.mk_disabled ) -printf "%!p(MISSING), " -exec sh -c "sudo mv {} {}.mk_disabled" ;

	I0701 12:27:25.029712  653531 cni.go:262] disabled [/etc/cni/net.d/87-podman-bridge.conflist] bridge cni config(s)

	I0701 12:27:25.029746  653531 start.go:494] detecting cgroup driver to use...

	I0701 12:27:25.029880  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///run/containerd/containerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:27:25.052034  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)sandbox_image = .*$|\1sandbox_image = "registry.k8s.io/pause:3.9"|' /etc/containerd/config.toml"

	I0701 12:27:25.062847  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)restrict_oom_score_adj = .*$|\1restrict_oom_score_adj = false|' /etc/containerd/config.toml"

	I0701 12:27:25.073005  653531 containerd.go:146] configuring containerd to use "cgroupfs" as cgroup driver...

	I0701 12:27:25.073080  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)SystemdCgroup = .*$|\1SystemdCgroup = false|g' /etc/containerd/config.toml"

	I0701 12:27:25.083300  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runtime.v1.linux"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:27:25.093834  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i '/systemd_cgroup/d' /etc/containerd/config.toml"

	I0701 12:27:25.104814  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i 's|"io.containerd.runc.v1"|"io.containerd.runc.v2"|g' /etc/containerd/config.toml"

	I0701 12:27:25.115006  653531 ssh_runner.go:195] Run: sh -c "sudo rm -rf /etc/cni/net.mk"

	I0701 12:27:25.126080  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)conf_dir = .*$|\1conf_dir = "/etc/cni/net.d"|g' /etc/containerd/config.toml"

	I0701 12:27:25.136492  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i '/^ *enable_unprivileged_ports = .*/d' /etc/containerd/config.toml"

	I0701 12:27:25.147986  653531 ssh_runner.go:195] Run: sh -c "sudo sed -i -r 's|^( *)\[plugins."io.containerd.grpc.v1.cri"\]|&\n\1  enable_unprivileged_ports = true|' /etc/containerd/config.toml"

	I0701 12:27:25.158638  653531 ssh_runner.go:195] Run: sudo sysctl net.bridge.bridge-nf-call-iptables

	I0701 12:27:25.168301  653531 ssh_runner.go:195] Run: sudo sh -c "echo 1 > /proc/sys/net/ipv4/ip_forward"

	I0701 12:27:25.177427  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:27:25.290645  653531 ssh_runner.go:195] Run: sudo systemctl restart containerd

	I0701 12:27:25.317946  653531 start.go:494] detecting cgroup driver to use...

	I0701 12:27:25.318090  653531 ssh_runner.go:195] Run: sudo systemctl cat docker.service

	I0701 12:27:25.333522  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:27:25.349308  653531 ssh_runner.go:195] Run: sudo systemctl stop -f containerd

	I0701 12:27:25.366057  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service containerd

	I0701 12:27:25.379554  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:27:25.393005  653531 ssh_runner.go:195] Run: sudo systemctl stop -f crio

	I0701 12:27:25.427883  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service crio

	I0701 12:27:25.443710  653531 ssh_runner.go:195] Run: /bin/bash -c "sudo mkdir -p /etc && printf %!s(MISSING) "runtime-endpoint: unix:///var/run/cri-dockerd.sock

	" | sudo tee /etc/crictl.yaml"

	I0701 12:27:25.462653  653531 ssh_runner.go:195] Run: which cri-dockerd

	I0701 12:27:25.466440  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/cri-docker.service.d

	I0701 12:27:25.475817  653531 ssh_runner.go:362] scp memory --> /etc/systemd/system/cri-docker.service.d/10-cni.conf (189 bytes)

	I0701 12:27:25.491900  653531 ssh_runner.go:195] Run: sudo systemctl unmask docker.service

	I0701 12:27:25.609810  653531 ssh_runner.go:195] Run: sudo systemctl enable docker.socket

	I0701 12:27:25.736607  653531 docker.go:574] configuring docker to use "cgroupfs" as cgroup driver...

	I0701 12:27:25.736666  653531 ssh_runner.go:362] scp memory --> /etc/docker/daemon.json (130 bytes)

	I0701 12:27:25.753218  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:27:25.872913  653531 ssh_runner.go:195] Run: sudo systemctl restart docker

	I0701 12:27:28.274644  653531 ssh_runner.go:235] Completed: sudo systemctl restart docker: (2.401692528s)

	I0701 12:27:28.274730  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.socket

	I0701 12:27:28.288270  653531 ssh_runner.go:195] Run: sudo systemctl stop cri-docker.socket

	I0701 12:27:28.306360  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:27:28.320063  653531 ssh_runner.go:195] Run: sudo systemctl unmask cri-docker.socket

	I0701 12:27:28.444909  653531 ssh_runner.go:195] Run: sudo systemctl enable cri-docker.socket

	I0701 12:27:28.582500  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:27:28.708064  653531 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.socket

	I0701 12:27:28.728173  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service cri-docker.service

	I0701 12:27:28.743660  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:27:28.873765  653531 ssh_runner.go:195] Run: sudo systemctl restart cri-docker.service

	I0701 12:27:28.960958  653531 start.go:541] Will wait 60s for socket path /var/run/cri-dockerd.sock

	I0701 12:27:28.961063  653531 ssh_runner.go:195] Run: stat /var/run/cri-dockerd.sock

	I0701 12:27:28.967089  653531 start.go:562] Will wait 60s for crictl version

	I0701 12:27:28.967205  653531 ssh_runner.go:195] Run: which crictl

	I0701 12:27:28.971404  653531 ssh_runner.go:195] Run: sudo /usr/bin/crictl version

	I0701 12:27:29.011615  653531 start.go:578] Version:  0.1.0

	RuntimeName:  docker

	RuntimeVersion:  27.0.1

	RuntimeApiVersion:  v1

	I0701 12:27:29.011699  653531 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:27:29.041339  653531 ssh_runner.go:195] Run: docker version --format {{.Server.Version}}

	I0701 12:27:29.073461  653531 out.go:204] * Preparing Kubernetes v1.30.2 on Docker 27.0.1 ...

	I0701 12:27:29.075110  653531 out.go:177]   - env NO_PROXY=192.168.39.16

	I0701 12:27:29.076621  653531 out.go:177]   - env NO_PROXY=192.168.39.16,192.168.39.86

	I0701 12:27:29.078186  653531 out.go:177]   - env NO_PROXY=192.168.39.16,192.168.39.86,192.168.39.97

	I0701 12:27:29.079949  653531 main.go:141] libmachine: (ha-735960-m04) Calling .GetIP

	I0701 12:27:29.083268  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:29.083683  653531 main.go:141] libmachine: (ha-735960-m04) DBG | found host DHCP lease matching {name: "", mac: "52:54:00:2d:8e:6d", ip: ""} in network mk-ha-735960: {Iface:virbr1 ExpiryTime:2024-07-01 13:27:16 +0000 UTC Type:0 Mac:52:54:00:2d:8e:6d Iaid: IPaddr:192.168.39.60 Prefix:24 Hostname:ha-735960-m04 Clientid:01:52:54:00:2d:8e:6d}

	I0701 12:27:29.083711  653531 main.go:141] libmachine: (ha-735960-m04) DBG | domain ha-735960-m04 has defined IP address 192.168.39.60 and MAC address 52:54:00:2d:8e:6d in network mk-ha-735960

	I0701 12:27:29.084018  653531 ssh_runner.go:195] Run: grep 192.168.39.1	host.minikube.internal$ /etc/hosts

	I0701 12:27:29.088562  653531 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\thost.minikube.internal$' "/etc/hosts"; echo "192.168.39.1	host.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:27:29.105010  653531 mustload.go:65] Loading cluster: ha-735960

	I0701 12:27:29.105303  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:27:29.105654  653531 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:27:29.105708  653531 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:27:29.121628  653531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:39389

	I0701 12:27:29.122222  653531 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:27:29.122816  653531 main.go:141] libmachine: Using API Version  1

	I0701 12:27:29.122844  653531 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:27:29.123210  653531 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:27:29.123475  653531 main.go:141] libmachine: (ha-735960) Calling .GetState

	I0701 12:27:29.125364  653531 host.go:66] Checking if "ha-735960" exists ...

	I0701 12:27:29.125670  653531 main.go:141] libmachine: Found binary path at /home/jenkins/workspace/KVM_Linux_integration/out/docker-machine-driver-kvm2

	I0701 12:27:29.125708  653531 main.go:141] libmachine: Launching plugin server for driver kvm2

	I0701 12:27:29.141532  653531 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:36053

	I0701 12:27:29.142051  653531 main.go:141] libmachine: () Calling .GetVersion

	I0701 12:27:29.142638  653531 main.go:141] libmachine: Using API Version  1

	I0701 12:27:29.142662  653531 main.go:141] libmachine: () Calling .SetConfigRaw

	I0701 12:27:29.143010  653531 main.go:141] libmachine: () Calling .GetMachineName

	I0701 12:27:29.143254  653531 main.go:141] libmachine: (ha-735960) Calling .DriverName

	I0701 12:27:29.143488  653531 certs.go:68] Setting up /home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960 for IP: 192.168.39.60

	I0701 12:27:29.143501  653531 certs.go:194] generating shared ca certs ...

	I0701 12:27:29.143518  653531 certs.go:226] acquiring lock for ca certs: {Name:mk34e166bfd069e523b2325e14d1812c523bff53 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}

	I0701 12:27:29.143646  653531 certs.go:235] skipping valid "minikubeCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key

	I0701 12:27:29.143686  653531 certs.go:235] skipping valid "proxyClientCA" ca cert: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key

	I0701 12:27:29.143702  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /var/lib/minikube/certs/ca.crt

	I0701 12:27:29.143722  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key -> /var/lib/minikube/certs/ca.key

	I0701 12:27:29.143739  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt

	I0701 12:27:29.143757  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key

	I0701 12:27:29.143817  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem (1338 bytes)

	W0701 12:27:29.143851  653531 certs.go:480] ignoring /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854_empty.pem, impossibly tiny 0 bytes

	I0701 12:27:29.143871  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca-key.pem (1675 bytes)

	I0701 12:27:29.143894  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/ca.pem (1078 bytes)

	I0701 12:27:29.143916  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/cert.pem (1123 bytes)

	I0701 12:27:29.143937  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/key.pem (1675 bytes)

	I0701 12:27:29.143972  653531 certs.go:484] found cert: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem (1708 bytes)

	I0701 12:27:29.144004  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt -> /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:27:29.144021  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem -> /usr/share/ca-certificates/637854.pem

	I0701 12:27:29.144041  653531 vm_assets.go:164] NewFileAsset: /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem -> /usr/share/ca-certificates/6378542.pem

	I0701 12:27:29.144072  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /var/lib/minikube/certs/ca.crt (1111 bytes)

	I0701 12:27:29.171419  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.key --> /var/lib/minikube/certs/ca.key (1679 bytes)

	I0701 12:27:29.196509  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.crt --> /var/lib/minikube/certs/proxy-client-ca.crt (1119 bytes)

	I0701 12:27:29.222599  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/proxy-client-ca.key --> /var/lib/minikube/certs/proxy-client-ca.key (1679 bytes)

	I0701 12:27:29.248989  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt --> /usr/share/ca-certificates/minikubeCA.pem (1111 bytes)

	I0701 12:27:29.275034  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/certs/637854.pem --> /usr/share/ca-certificates/637854.pem (1338 bytes)

	I0701 12:27:29.300102  653531 ssh_runner.go:362] scp /home/jenkins/minikube-integration/19166-630650/.minikube/files/etc/ssl/certs/6378542.pem --> /usr/share/ca-certificates/6378542.pem (1708 bytes)

	I0701 12:27:29.327329  653531 ssh_runner.go:195] Run: openssl version

	I0701 12:27:29.333121  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/minikubeCA.pem && ln -fs /usr/share/ca-certificates/minikubeCA.pem /etc/ssl/certs/minikubeCA.pem"

	I0701 12:27:29.344555  653531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:27:29.349319  653531 certs.go:528] hashing: -rw-r--r-- 1 root root 1111 Jul  1 12:05 /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:27:29.349394  653531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/minikubeCA.pem

	I0701 12:27:29.355247  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/b5213941.0 || ln -fs /etc/ssl/certs/minikubeCA.pem /etc/ssl/certs/b5213941.0"

	I0701 12:27:29.366285  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/637854.pem && ln -fs /usr/share/ca-certificates/637854.pem /etc/ssl/certs/637854.pem"

	I0701 12:27:29.376931  653531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/637854.pem

	I0701 12:27:29.381303  653531 certs.go:528] hashing: -rw-r--r-- 1 root root 1338 Jul  1 12:11 /usr/share/ca-certificates/637854.pem

	I0701 12:27:29.381385  653531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/637854.pem

	I0701 12:27:29.387458  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/51391683.0 || ln -fs /etc/ssl/certs/637854.pem /etc/ssl/certs/51391683.0"

	I0701 12:27:29.398343  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -s /usr/share/ca-certificates/6378542.pem && ln -fs /usr/share/ca-certificates/6378542.pem /etc/ssl/certs/6378542.pem"

	I0701 12:27:29.409321  653531 ssh_runner.go:195] Run: ls -la /usr/share/ca-certificates/6378542.pem

	I0701 12:27:29.414299  653531 certs.go:528] hashing: -rw-r--r-- 1 root root 1708 Jul  1 12:11 /usr/share/ca-certificates/6378542.pem

	I0701 12:27:29.414400  653531 ssh_runner.go:195] Run: openssl x509 -hash -noout -in /usr/share/ca-certificates/6378542.pem

	I0701 12:27:29.420975  653531 ssh_runner.go:195] Run: sudo /bin/bash -c "test -L /etc/ssl/certs/3ec20f2e.0 || ln -fs /etc/ssl/certs/6378542.pem /etc/ssl/certs/3ec20f2e.0"

	I0701 12:27:29.434286  653531 ssh_runner.go:195] Run: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt

	I0701 12:27:29.438767  653531 certs.go:399] 'apiserver-kubelet-client' cert doesn't exist, likely first start: stat /var/lib/minikube/certs/apiserver-kubelet-client.crt: Process exited with status 1

	stdout:

	stderr:

	stat: cannot statx '/var/lib/minikube/certs/apiserver-kubelet-client.crt': No such file or directory

	I0701 12:27:29.438817  653531 kubeadm.go:928] updating node {m04 192.168.39.60 0 v1.30.2 docker false true} ...

	I0701 12:27:29.438918  653531 kubeadm.go:940] kubelet [Unit]

	Wants=docker.socket

	[Service]

	ExecStart=

	ExecStart=/var/lib/minikube/binaries/v1.30.2/kubelet --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --config=/var/lib/kubelet/config.yaml --hostname-override=ha-735960-m04 --kubeconfig=/etc/kubernetes/kubelet.conf --node-ip=192.168.39.60

	[Install]

	 config:

	{KubernetesVersion:v1.30.2 ClusterName:ha-735960 Namespace:default APIServerHAVIP:192.168.39.254 APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:}

	I0701 12:27:29.438988  653531 ssh_runner.go:195] Run: sudo ls /var/lib/minikube/binaries/v1.30.2

	I0701 12:27:29.450811  653531 binaries.go:44] Found k8s binaries, skipping transfer

	I0701 12:27:29.450895  653531 ssh_runner.go:195] Run: sudo mkdir -p /etc/systemd/system/kubelet.service.d /lib/systemd/system

	I0701 12:27:29.462511  653531 ssh_runner.go:362] scp memory --> /etc/systemd/system/kubelet.service.d/10-kubeadm.conf (313 bytes)

	I0701 12:27:29.480246  653531 ssh_runner.go:362] scp memory --> /lib/systemd/system/kubelet.service (352 bytes)

	I0701 12:27:29.497624  653531 ssh_runner.go:195] Run: grep 192.168.39.254	control-plane.minikube.internal$ /etc/hosts

	I0701 12:27:29.502554  653531 ssh_runner.go:195] Run: /bin/bash -c "{ grep -v $'\tcontrol-plane.minikube.internal$' "/etc/hosts"; echo "192.168.39.254	control-plane.minikube.internal"; } > /tmp/h.$$; sudo cp /tmp/h.$$ "/etc/hosts""

	I0701 12:27:29.515005  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:27:29.648948  653531 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0701 12:27:29.668809  653531 start.go:234] Will wait 6m0s for node &{Name:m04 IP:192.168.39.60 Port:0 KubernetesVersion:v1.30.2 ContainerRuntime:docker ControlPlane:false Worker:true}

	I0701 12:27:29.669186  653531 config.go:182] Loaded profile config "ha-735960": Driver=kvm2, ContainerRuntime=docker, KubernetesVersion=v1.30.2

	I0701 12:27:29.671772  653531 out.go:177] * Verifying Kubernetes components...

	I0701 12:27:29.673288  653531 ssh_runner.go:195] Run: sudo systemctl daemon-reload

	I0701 12:27:29.823420  653531 ssh_runner.go:195] Run: sudo systemctl start kubelet

	I0701 12:27:29.839349  653531 loader.go:395] Config loaded from file:  /home/jenkins/minikube-integration/19166-630650/kubeconfig

	I0701 12:27:29.839675  653531 kapi.go:59] client config for ha-735960: &rest.Config{Host:"https://192.168.39.254:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", UID:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:<nil>, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:<nil>, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.crt", KeyFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/profiles/ha-735960/client.key", CAFile:"/home/jenkins/minikube-integration/19166-630650/.minikube/ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil), NextProtos:[]string(n

il)}, UserAgent:"", DisableCompression:false, Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x1cfbb80), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), WarningHandler:rest.WarningHandler(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil), Proxy:(func(*http.Request) (*url.URL, error))(nil)}

	W0701 12:27:29.839746  653531 kubeadm.go:477] Overriding stale ClientConfig host https://192.168.39.254:8443 with https://192.168.39.16:8443

	I0701 12:27:29.840001  653531 node_ready.go:35] waiting up to 6m0s for node "ha-735960-m04" to be "Ready" ...

	I0701 12:27:29.840108  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m04

	I0701 12:27:29.840118  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:29.840130  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:29.840138  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:29.843740  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:30.340654  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m04

	I0701 12:27:30.340679  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:30.340687  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:30.340691  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:30.344079  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:30.344547  653531 node_ready.go:49] node "ha-735960-m04" has status "Ready":"True"

	I0701 12:27:30.344570  653531 node_ready.go:38] duration metric: took 504.547887ms for node "ha-735960-m04" to be "Ready" ...

	I0701 12:27:30.344579  653531 pod_ready.go:35] extra waiting up to 6m0s for all system-critical pods including labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0701 12:27:30.344650  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods

	I0701 12:27:30.344660  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:30.344668  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:30.344675  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:30.351108  653531 round_trippers.go:574] Response Status: 200 OK in 6 milliseconds

	I0701 12:27:30.358660  653531 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:30.358749  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-nk4lf

	I0701 12:27:30.358758  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:30.358766  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:30.358771  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:30.362032  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:30.362784  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:30.362802  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:30.362812  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:30.362816  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:30.365450  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:27:30.365914  653531 pod_ready.go:92] pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:30.365936  653531 pod_ready.go:81] duration metric: took 7.248792ms for pod "coredns-7db6d8ff4d-nk4lf" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:30.365949  653531 pod_ready.go:78] waiting up to 6m0s for pod "coredns-7db6d8ff4d-p4rtz" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:30.366016  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/coredns-7db6d8ff4d-p4rtz

	I0701 12:27:30.366025  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:30.366035  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:30.366043  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:30.368928  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:27:30.369820  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:30.369836  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:30.369843  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:30.369858  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:30.373004  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:30.373769  653531 pod_ready.go:92] pod "coredns-7db6d8ff4d-p4rtz" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:30.373785  653531 pod_ready.go:81] duration metric: took 7.830149ms for pod "coredns-7db6d8ff4d-p4rtz" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:30.373794  653531 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:30.373848  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960

	I0701 12:27:30.373856  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:30.373862  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:30.373867  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:30.376565  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:27:30.377340  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:30.377356  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:30.377363  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:30.377367  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:30.379523  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:27:30.379966  653531 pod_ready.go:92] pod "etcd-ha-735960" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:30.379982  653531 pod_ready.go:81] duration metric: took 6.178731ms for pod "etcd-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:30.379991  653531 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:30.380048  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m02

	I0701 12:27:30.380055  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:30.380062  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:30.380069  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:30.382485  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:27:30.383125  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:27:30.383141  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:30.383148  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:30.383155  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:30.385845  653531 round_trippers.go:574] Response Status: 200 OK in 2 milliseconds

	I0701 12:27:30.386599  653531 pod_ready.go:92] pod "etcd-ha-735960-m02" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:30.386616  653531 pod_ready.go:81] duration metric: took 6.619715ms for pod "etcd-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:30.386624  653531 pod_ready.go:78] waiting up to 6m0s for pod "etcd-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:30.541077  653531 request.go:629] Waited for 154.380092ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:27:30.541196  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/etcd-ha-735960-m03

	I0701 12:27:30.541207  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:30.541219  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:30.541229  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:30.544660  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:30.740754  653531 request.go:629] Waited for 195.337132ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:30.740847  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:30.740857  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:30.740865  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:30.740869  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:30.744492  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:30.745072  653531 pod_ready.go:92] pod "etcd-ha-735960-m03" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:30.745094  653531 pod_ready.go:81] duration metric: took 358.462325ms for pod "etcd-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:30.745123  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:30.941364  653531 request.go:629] Waited for 196.100673ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960

	I0701 12:27:30.941453  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960

	I0701 12:27:30.941466  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:30.941477  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:30.941487  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:30.946577  653531 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0701 12:27:31.140711  653531 request.go:629] Waited for 193.223112ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:31.140788  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:31.140793  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:31.140800  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:31.140804  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:31.146571  653531 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0701 12:27:31.147245  653531 pod_ready.go:92] pod "kube-apiserver-ha-735960" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:31.147269  653531 pod_ready.go:81] duration metric: took 402.135058ms for pod "kube-apiserver-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:31.147280  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:31.341367  653531 request.go:629] Waited for 193.988845ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m02

	I0701 12:27:31.341477  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m02

	I0701 12:27:31.341489  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:31.341500  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:31.341508  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:31.345561  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:27:31.540709  653531 request.go:629] Waited for 194.115472ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:27:31.540784  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:27:31.540789  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:31.540797  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:31.540800  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:31.544920  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:27:31.545652  653531 pod_ready.go:92] pod "kube-apiserver-ha-735960-m02" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:31.545679  653531 pod_ready.go:81] duration metric: took 398.391166ms for pod "kube-apiserver-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:31.545689  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-apiserver-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:31.741170  653531 request.go:629] Waited for 195.369232ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:27:31.741243  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-ha-735960-m03

	I0701 12:27:31.741251  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:31.741261  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:31.741272  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:31.745382  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:27:31.941422  653531 request.go:629] Waited for 195.397431ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:31.941512  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:31.941517  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:31.941526  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:31.941531  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:31.945358  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:31.945947  653531 pod_ready.go:92] pod "kube-apiserver-ha-735960-m03" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:31.945971  653531 pod_ready.go:81] duration metric: took 400.276204ms for pod "kube-apiserver-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:31.945982  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:32.140926  653531 request.go:629] Waited for 194.860847ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960

	I0701 12:27:32.141014  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960

	I0701 12:27:32.141023  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:32.141048  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:32.141058  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:32.146741  653531 round_trippers.go:574] Response Status: 200 OK in 5 milliseconds

	I0701 12:27:32.341040  653531 request.go:629] Waited for 193.334578ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:32.341112  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:32.341117  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:32.341126  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:32.341132  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:32.344664  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:32.345182  653531 pod_ready.go:92] pod "kube-controller-manager-ha-735960" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:32.345200  653531 pod_ready.go:81] duration metric: took 399.209545ms for pod "kube-controller-manager-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:32.345210  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:32.541314  653531 request.go:629] Waited for 196.016373ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960-m02

	I0701 12:27:32.541395  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960-m02

	I0701 12:27:32.541402  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:32.541414  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:32.541424  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:32.545663  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:27:32.741118  653531 request.go:629] Waited for 194.597088ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:27:32.741201  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:27:32.741209  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:32.741220  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:32.741228  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:32.745051  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:32.745612  653531 pod_ready.go:92] pod "kube-controller-manager-ha-735960-m02" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:32.745636  653531 pod_ready.go:81] duration metric: took 400.417224ms for pod "kube-controller-manager-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:32.745651  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-controller-manager-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:32.941594  653531 request.go:629] Waited for 195.859048ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960-m03

	I0701 12:27:32.941697  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-ha-735960-m03

	I0701 12:27:32.941704  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:32.941712  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:32.941720  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:32.945661  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:33.140796  653531 request.go:629] Waited for 194.297237ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:33.140872  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:33.140881  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:33.140892  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:33.140902  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:33.148523  653531 round_trippers.go:574] Response Status: 200 OK in 7 milliseconds

	I0701 12:27:33.149119  653531 pod_ready.go:92] pod "kube-controller-manager-ha-735960-m03" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:33.149229  653531 pod_ready.go:81] duration metric: took 403.561455ms for pod "kube-controller-manager-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:33.149274  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-25ssf" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:33.341103  653531 request.go:629] Waited for 191.712414ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-25ssf

	I0701 12:27:33.341203  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-25ssf

	I0701 12:27:33.341211  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:33.341222  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:33.341236  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:33.345005  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:33.541118  653531 request.go:629] Waited for 195.201433ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m04

	I0701 12:27:33.541195  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m04

	I0701 12:27:33.541202  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:33.541212  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:33.541220  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:33.544937  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:33.546208  653531 pod_ready.go:92] pod "kube-proxy-25ssf" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:33.546231  653531 pod_ready.go:81] duration metric: took 396.932438ms for pod "kube-proxy-25ssf" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:33.546244  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-776rt" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:33.741353  653531 request.go:629] Waited for 195.026851ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-776rt

	I0701 12:27:33.741456  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-776rt

	I0701 12:27:33.741466  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:33.741475  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:33.741481  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:33.745239  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:33.941300  653531 request.go:629] Waited for 195.397929ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:33.941381  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:33.941388  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:33.941399  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:33.941408  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:33.944917  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:33.945530  653531 pod_ready.go:92] pod "kube-proxy-776rt" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:33.945551  653531 pod_ready.go:81] duration metric: took 399.299813ms for pod "kube-proxy-776rt" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:33.945565  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-b6knb" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:34.140984  653531 request.go:629] Waited for 195.324742ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-b6knb

	I0701 12:27:34.141050  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-b6knb

	I0701 12:27:34.141055  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:34.141063  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:34.141075  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:34.144882  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:34.341131  653531 request.go:629] Waited for 195.426765ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:27:34.341198  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:27:34.341203  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:34.341211  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:34.341215  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:34.344938  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:34.345533  653531 pod_ready.go:92] pod "kube-proxy-b6knb" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:34.345554  653531 pod_ready.go:81] duration metric: took 399.982623ms for pod "kube-proxy-b6knb" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:34.345563  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-proxy-lphzn" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:34.540691  653531 request.go:629] Waited for 195.046851ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-lphzn

	I0701 12:27:34.540777  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-proxy-lphzn

	I0701 12:27:34.540782  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:34.540794  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:34.540798  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:34.544410  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:34.741782  653531 request.go:629] Waited for 196.474041ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:34.741851  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:34.741856  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:34.741864  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:34.741869  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:34.745447  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:34.746289  653531 pod_ready.go:92] pod "kube-proxy-lphzn" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:34.746312  653531 pod_ready.go:81] duration metric: took 400.742893ms for pod "kube-proxy-lphzn" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:34.746344  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:34.941411  653531 request.go:629] Waited for 194.97877ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960

	I0701 12:27:34.941489  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960

	I0701 12:27:34.941495  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:34.941502  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:34.941510  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:34.944984  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:35.141079  653531 request.go:629] Waited for 195.409668ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:35.141163  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960

	I0701 12:27:35.141168  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:35.141176  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:35.141194  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:35.144737  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:35.145431  653531 pod_ready.go:92] pod "kube-scheduler-ha-735960" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:35.145471  653531 pod_ready.go:81] duration metric: took 399.115782ms for pod "kube-scheduler-ha-735960" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:35.145485  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:35.341554  653531 request.go:629] Waited for 195.979537ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960-m02

	I0701 12:27:35.341639  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960-m02

	I0701 12:27:35.341650  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:35.341661  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:35.341672  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:35.345199  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:35.541252  653531 request.go:629] Waited for 195.403848ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:27:35.541340  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m02

	I0701 12:27:35.541346  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:35.541354  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:35.541362  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:35.545398  653531 round_trippers.go:574] Response Status: 200 OK in 4 milliseconds

	I0701 12:27:35.546010  653531 pod_ready.go:92] pod "kube-scheduler-ha-735960-m02" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:35.546037  653531 pod_ready.go:81] duration metric: took 400.543297ms for pod "kube-scheduler-ha-735960-m02" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:35.546051  653531 pod_ready.go:78] waiting up to 6m0s for pod "kube-scheduler-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:35.741442  653531 request.go:629] Waited for 195.294004ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960-m03

	I0701 12:27:35.741533  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-ha-735960-m03

	I0701 12:27:35.741541  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:35.741553  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:35.741565  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:35.744725  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:35.940687  653531 request.go:629] Waited for 195.284608ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:35.940760  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes/ha-735960-m03

	I0701 12:27:35.940766  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:35.940776  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:35.940783  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:35.944482  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:35.945011  653531 pod_ready.go:92] pod "kube-scheduler-ha-735960-m03" in "kube-system" namespace has status "Ready":"True"

	I0701 12:27:35.945032  653531 pod_ready.go:81] duration metric: took 398.973476ms for pod "kube-scheduler-ha-735960-m03" in "kube-system" namespace to be "Ready" ...

	I0701 12:27:35.945048  653531 pod_ready.go:38] duration metric: took 5.600458409s for extra waiting for all system-critical and pods with labels [k8s-app=kube-dns component=etcd component=kube-apiserver component=kube-controller-manager k8s-app=kube-proxy component=kube-scheduler] to be "Ready" ...

	I0701 12:27:35.945074  653531 system_svc.go:44] waiting for kubelet service to be running ....

	I0701 12:27:35.945143  653531 ssh_runner.go:195] Run: sudo systemctl is-active --quiet service kubelet

	I0701 12:27:35.962762  653531 system_svc.go:56] duration metric: took 17.680549ms WaitForService to wait for kubelet

	I0701 12:27:35.962795  653531 kubeadm.go:576] duration metric: took 6.293928606s to wait for: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]

	I0701 12:27:35.962817  653531 node_conditions.go:102] verifying NodePressure condition ...

	I0701 12:27:36.141286  653531 request.go:629] Waited for 178.366419ms due to client-side throttling, not priority and fairness, request: GET:https://192.168.39.16:8443/api/v1/nodes

	I0701 12:27:36.141375  653531 round_trippers.go:463] GET https://192.168.39.16:8443/api/v1/nodes

	I0701 12:27:36.141382  653531 round_trippers.go:469] Request Headers:

	I0701 12:27:36.141394  653531 round_trippers.go:473]     Accept: application/json, */*

	I0701 12:27:36.141404  653531 round_trippers.go:473]     User-Agent: minikube-linux-amd64/v0.0.0 (linux/amd64) kubernetes/$Format

	I0701 12:27:36.145426  653531 round_trippers.go:574] Response Status: 200 OK in 3 milliseconds

	I0701 12:27:36.146951  653531 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0701 12:27:36.146977  653531 node_conditions.go:123] node cpu capacity is 2

	I0701 12:27:36.146989  653531 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0701 12:27:36.146992  653531 node_conditions.go:123] node cpu capacity is 2

	I0701 12:27:36.146996  653531 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0701 12:27:36.146999  653531 node_conditions.go:123] node cpu capacity is 2

	I0701 12:27:36.147001  653531 node_conditions.go:122] node storage ephemeral capacity is 17734596Ki

	I0701 12:27:36.147004  653531 node_conditions.go:123] node cpu capacity is 2

	I0701 12:27:36.147009  653531 node_conditions.go:105] duration metric: took 184.187151ms to run NodePressure ...

	I0701 12:27:36.147024  653531 start.go:240] waiting for startup goroutines ...

	I0701 12:27:36.147054  653531 start.go:254] writing updated cluster config ...

	I0701 12:27:36.147403  653531 ssh_runner.go:195] Run: rm -f paused

	I0701 12:27:36.201170  653531 start.go:600] kubectl: 1.30.2, cluster: 1.30.2 (minor skew: 0)

	I0701 12:27:36.203376  653531 out.go:177] * Done! kubectl is now configured to use "ha-735960" cluster and "default" namespace by default

	==> Docker <==

	Jul 01 12:25:13 ha-735960 cri-dockerd[1398]: time="2024-07-01T12:25:13Z" level=info msg="Docker cri received runtime config &RuntimeConfig{NetworkConfig:&NetworkConfig{PodCidr:10.244.0.0/24,},}"

	Jul 01 12:25:23 ha-735960 dockerd[1125]: time="2024-07-01T12:25:23.366654170Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jul 01 12:25:23 ha-735960 dockerd[1125]: time="2024-07-01T12:25:23.366710385Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jul 01 12:25:23 ha-735960 dockerd[1125]: time="2024-07-01T12:25:23.366723641Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:25:23 ha-735960 dockerd[1125]: time="2024-07-01T12:25:23.367696676Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:25:23 ha-735960 dockerd[1125]: time="2024-07-01T12:25:23.388479723Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jul 01 12:25:23 ha-735960 dockerd[1125]: time="2024-07-01T12:25:23.388593936Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jul 01 12:25:23 ha-735960 dockerd[1125]: time="2024-07-01T12:25:23.389018347Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:25:23 ha-735960 dockerd[1125]: time="2024-07-01T12:25:23.389381366Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:25:23 ha-735960 dockerd[1125]: time="2024-07-01T12:25:23.390771396Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jul 01 12:25:23 ha-735960 dockerd[1125]: time="2024-07-01T12:25:23.391192786Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jul 01 12:25:23 ha-735960 dockerd[1125]: time="2024-07-01T12:25:23.391291548Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:25:23 ha-735960 dockerd[1125]: time="2024-07-01T12:25:23.391685449Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:25:24 ha-735960 dockerd[1125]: time="2024-07-01T12:25:24.321168284Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jul 01 12:25:24 ha-735960 dockerd[1125]: time="2024-07-01T12:25:24.321255362Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jul 01 12:25:24 ha-735960 dockerd[1125]: time="2024-07-01T12:25:24.321269990Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:25:24 ha-735960 dockerd[1125]: time="2024-07-01T12:25:24.321347198Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:25:25 ha-735960 dockerd[1125]: time="2024-07-01T12:25:25.309227018Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jul 01 12:25:25 ha-735960 dockerd[1125]: time="2024-07-01T12:25:25.309334545Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jul 01 12:25:25 ha-735960 dockerd[1125]: time="2024-07-01T12:25:25.309346230Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:25:25 ha-735960 dockerd[1125]: time="2024-07-01T12:25:25.309972461Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:25:26 ha-735960 dockerd[1125]: time="2024-07-01T12:25:26.350220788Z" level=info msg="loading plugin \"io.containerd.event.v1.publisher\"..." runtime=io.containerd.runc.v2 type=io.containerd.event.v1

	Jul 01 12:25:26 ha-735960 dockerd[1125]: time="2024-07-01T12:25:26.350306647Z" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

	Jul 01 12:25:26 ha-735960 dockerd[1125]: time="2024-07-01T12:25:26.350329844Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.task\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	Jul 01 12:25:26 ha-735960 dockerd[1125]: time="2024-07-01T12:25:26.350448560Z" level=info msg="loading plugin \"io.containerd.ttrpc.v1.pause\"..." runtime=io.containerd.runc.v2 type=io.containerd.ttrpc.v1

	==> container status <==

	CONTAINER           IMAGE                                                                                                 CREATED             STATE               NAME                      ATTEMPT             POD ID              POD

	51a34f4432461       6e38f40d628db                                                                                         2 minutes ago       Running             storage-provisioner       1                   d2dc46de092d5       storage-provisioner

	bf788c37e0912       ac1c61439df46                                                                                         2 minutes ago       Running             kindnet-cni               1                   afbde11b8a740       kindnet-7f6hm

	8cdf2026ed072       8c811b4aec35f                                                                                         2 minutes ago       Running             busybox                   1                   7d907d7b28c98       busybox-fc5497c4f-pjfcw

	710f5c3a9f856       53c535741fb44                                                                                         2 minutes ago       Running             kube-proxy                1                   e49ff3fb80595       kube-proxy-lphzn

	61dc29970290b       cbb01a7bd410d                                                                                         2 minutes ago       Running             coredns                   1                   de1daec45ac89       coredns-7db6d8ff4d-p4rtz

	4a151786b08f5       cbb01a7bd410d                                                                                         2 minutes ago       Running             coredns                   1                   26981372e6136       coredns-7db6d8ff4d-nk4lf

	8ee3e44a43c3b       56ce0fd9fb532                                                                                         2 minutes ago       Running             kube-apiserver            5                   1b92afc0e4763       kube-apiserver-ha-735960

	67dc946c8c45c       e874818b3caac                                                                                         2 minutes ago       Running             kube-controller-manager   5                   3379ae4b4d689       kube-controller-manager-ha-735960

	1c046b029aa4a       38af8ddebf499                                                                                         3 minutes ago       Running             kube-vip                  1                   32c93b266a82d       kube-vip-ha-735960

	693eb0b8f5d78       7820c83aa1394                                                                                         3 minutes ago       Running             kube-scheduler            2                   ec2e5d106b539       kube-scheduler-ha-735960

	ec2c061093f10       e874818b3caac                                                                                         3 minutes ago       Exited              kube-controller-manager   4                   3379ae4b4d689       kube-controller-manager-ha-735960

	852492f61fee7       3861cfcd7c04c                                                                                         3 minutes ago       Running             etcd                      2                   c9044136ea747       etcd-ha-735960

	a3cb59ee8d572       56ce0fd9fb532                                                                                         3 minutes ago       Exited              kube-apiserver            4                   1b92afc0e4763       kube-apiserver-ha-735960

	cecb3dd12e16e       38af8ddebf499                                                                                         5 minutes ago       Exited              kube-vip                  0                   8d1562fb4b8c3       kube-vip-ha-735960

	6a200a6b49020       3861cfcd7c04c                                                                                         5 minutes ago       Exited              etcd                      1                   5b1097d48d724       etcd-ha-735960

	2d71437c5f06d       7820c83aa1394                                                                                         5 minutes ago       Exited              kube-scheduler            1                   fa7dea6a1b8bd       kube-scheduler-ha-735960

	1ef6d9da6a9c5       gcr.io/k8s-minikube/busybox@sha256:9afb80db71730dbb303fe00765cbf34bddbdc6b66e49897fc2e1861967584b12   9 minutes ago       Exited              busybox                   0                   1f5ccc7b0e655       busybox-fc5497c4f-pjfcw

	a9c30cd4b3455       cbb01a7bd410d                                                                                         11 minutes ago      Exited              coredns                   0                   7b4b4f7ec4b63       coredns-7db6d8ff4d-nk4lf

	769b0b8751350       cbb01a7bd410d                                                                                         11 minutes ago      Exited              coredns                   0                   7a349370d4f88       coredns-7db6d8ff4d-p4rtz

	f472aef5302fd       kindest/kindnetd@sha256:9c2b5fcda3cb5a9725ecb893f3c8998a92d51a87465a886eb563e18d649383a8              11 minutes ago      Exited              kindnet-cni               0                   ab9c74a502295       kindnet-7f6hm

	6116abe6039dc       53c535741fb44                                                                                         11 minutes ago      Exited              kube-proxy                0                   da69191059798       kube-proxy-lphzn

	==> coredns [4a151786b08f] <==

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = 6c8bd46af3d98e03c4ae8e438c65dd0c69a5f817565481bcf1725dd66ff794963b7938c81e3a23d4c2ad9e52f818076e819219c79e8007dd90564767ed68ba4c

	CoreDNS-1.11.1

	linux/amd64, go1.20.7, ae2bbc2

	[INFO] 127.0.0.1:47509 - 49224 "HINFO IN 6979381009676685748.1822735874857968465. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.033568754s

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: Trace[177456986]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231 (01-Jul-2024 12:25:23.743) (total time: 30001ms):

	Trace[177456986]: ---"Objects listed" error:Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30000ms (12:25:53.744)

	Trace[177456986]: [30.001445665s] [30.001445665s] END

	[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: Trace[947462717]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231 (01-Jul-2024 12:25:23.742) (total time: 30003ms):

	Trace[947462717]: ---"Objects listed" error:Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30001ms (12:25:53.743)

	Trace[947462717]: [30.0032009s] [30.0032009s] END

	[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: Trace[886534813]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231 (01-Jul-2024 12:25:23.742) (total time: 30004ms):

	Trace[886534813]: ---"Objects listed" error:Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30003ms (12:25:53.745)

	Trace[886534813]: [30.004749172s] [30.004749172s] END

	[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	==> coredns [61dc29970290] <==

	[INFO] plugin/kubernetes: waiting for Kubernetes API before starting server

	[WARNING] plugin/kubernetes: starting server with unsynced Kubernetes API

	.:53

	[INFO] plugin/reload: Running configuration SHA512 = 6c8bd46af3d98e03c4ae8e438c65dd0c69a5f817565481bcf1725dd66ff794963b7938c81e3a23d4c2ad9e52f818076e819219c79e8007dd90564767ed68ba4c

	CoreDNS-1.11.1

	linux/amd64, go1.20.7, ae2bbc2

	[INFO] 127.0.0.1:49574 - 32592 "HINFO IN 7534101530096432962.1842168600618500663. udp 57 false 512" NXDOMAIN qr,rd,ra 57 0.017366932s

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/ready: Still waiting on: "kubernetes"

	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: Trace[2027452150]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231 (01-Jul-2024 12:25:23.742) (total time: 30003ms):

	Trace[2027452150]: ---"Objects listed" error:Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30001ms (12:25:53.743)

	Trace[2027452150]: [30.003896779s] [30.003896779s] END

	[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://10.96.0.1:443/api/v1/services?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: Trace[222503702]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231 (01-Jul-2024 12:25:23.743) (total time: 30003ms):

	Trace[222503702]: ---"Objects listed" error:Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30000ms (12:25:53.744)

	Trace[222503702]: [30.003901467s] [30.003901467s] END

	[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Get "https://10.96.0.1:443/apis/discovery.k8s.io/v1/endpointslices?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	[INFO] plugin/kubernetes: Trace[1950728267]: "Reflector ListAndWatch" name:pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231 (01-Jul-2024 12:25:23.742) (total time: 30005ms):

	Trace[1950728267]: ---"Objects listed" error:Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout 30003ms (12:25:53.745)

	Trace[1950728267]: [30.005235099s] [30.005235099s] END

	[ERROR] plugin/kubernetes: pkg/mod/k8s.io/client-go@v0.27.4/tools/cache/reflector.go:231: Failed to watch *v1.Namespace: failed to list *v1.Namespace: Get "https://10.96.0.1:443/api/v1/namespaces?limit=500&resourceVersion=0": dial tcp 10.96.0.1:443: i/o timeout

	==> coredns [769b0b875135] <==

	[INFO] 10.244.1.2:44221 - 4 "A IN kubernetes.io. udp 31 false 512" NOERROR qr,aa,rd,ra 60 0.000082797s

	[INFO] 10.244.2.2:33797 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000157729s

	[INFO] 10.244.2.2:52590 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.004055351s

	[INFO] 10.244.2.2:46983 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.003253494s

	[INFO] 10.244.2.2:56187 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000205215s

	[INFO] 10.244.2.2:41086 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000158307s

	[INFO] 10.244.0.4:47783 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000097077s

	[INFO] 10.244.0.4:50743 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.0001523s

	[INFO] 10.244.0.4:37141 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000138763s

	[INFO] 10.244.1.2:32981 - 5 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000132906s

	[INFO] 10.244.1.2:36762 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.001646552s

	[INFO] 10.244.1.2:33583 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000072434s

	[INFO] 10.244.2.2:37027 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000156518s

	[INFO] 10.244.2.2:58435 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000104504s

	[INFO] 10.244.2.2:36107 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000090251s

	[INFO] 10.244.0.4:44792 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000227164s

	[INFO] 10.244.0.4:56557 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000140925s

	[INFO] 10.244.1.2:38284 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000232717s

	[INFO] 10.244.2.2:37664 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000135198s

	[INFO] 10.244.2.2:60876 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.00032392s

	[INFO] 10.244.1.2:37461 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000133264s

	[INFO] 10.244.1.2:45182 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000117372s

	[INFO] 10.244.1.2:37156 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000240093s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> coredns [a9c30cd4b345] <==

	[INFO] 10.244.0.4:57095 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.002251804s

	[INFO] 10.244.0.4:42381 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000081215s

	[INFO] 10.244.0.4:53499 - 6 "A IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00124929s

	[INFO] 10.244.0.4:41287 - 7 "A IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.000174281s

	[INFO] 10.244.0.4:36433 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000142863s

	[INFO] 10.244.1.2:47688 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130034s

	[INFO] 10.244.1.2:40562 - 3 "AAAA IN kubernetes.default. udp 36 false 512" NXDOMAIN qr,rd,ra 36 0.00183587s

	[INFO] 10.244.1.2:35137 - 4 "AAAA IN kubernetes.default.default.svc.cluster.local. udp 62 false 512" NXDOMAIN qr,aa,rd 155 0.0000771s

	[INFO] 10.244.1.2:37798 - 8 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000184282s

	[INFO] 10.244.1.2:43876 - 9 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.00008807s

	[INFO] 10.244.2.2:35039 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000119303s

	[INFO] 10.244.0.4:53229 - 3 "AAAA IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 147 0.000090292s

	[INFO] 10.244.0.4:42097 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.00011308s

	[INFO] 10.244.1.2:42114 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000130767s

	[INFO] 10.244.1.2:56638 - 4 "A IN kubernetes.default.svc.cluster.local. udp 54 false 512" NOERROR qr,aa,rd 106 0.000110707s

	[INFO] 10.244.1.2:55805 - 5 "PTR IN 1.0.96.10.in-addr.arpa. udp 40 false 512" NOERROR qr,aa,rd 112 0.000093484s

	[INFO] 10.244.2.2:51675 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000145117s

	[INFO] 10.244.2.2:56838 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000136843s

	[INFO] 10.244.0.4:60951 - 2 "PTR IN 10.0.96.10.in-addr.arpa. udp 41 false 512" NOERROR qr,aa,rd 116 0.000162889s

	[INFO] 10.244.0.4:34776 - 3 "AAAA IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 40 0.000112367s

	[INFO] 10.244.0.4:45397 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000073771s

	[INFO] 10.244.0.4:52372 - 5 "PTR IN 1.39.168.192.in-addr.arpa. udp 43 false 512" NOERROR qr,aa,rd 104 0.000058127s

	[INFO] 10.244.1.2:41033 - 4 "A IN host.minikube.internal. udp 40 false 512" NOERROR qr,aa,rd 78 0.000131962s

	[INFO] SIGTERM: Shutting down servers then terminating

	[INFO] plugin/health: Going into lameduck mode for 5s

	==> describe nodes <==

	Name:               ha-735960

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-735960

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=f87dc4b1adfa3faf30393d14b8f7fb9acc5e991c

	                    minikube.k8s.io/name=ha-735960

	                    minikube.k8s.io/primary=true

	                    minikube.k8s.io/updated_at=2024_07_01T12_15_55_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 01 Jul 2024 12:15:53 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-735960

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 01 Jul 2024 12:27:35 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 01 Jul 2024 12:25:13 +0000   Mon, 01 Jul 2024 12:15:53 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 01 Jul 2024 12:25:13 +0000   Mon, 01 Jul 2024 12:15:53 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 01 Jul 2024 12:25:13 +0000   Mon, 01 Jul 2024 12:15:53 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 01 Jul 2024 12:25:13 +0000   Mon, 01 Jul 2024 12:16:15 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.16

	  Hostname:    ha-735960

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 a500128d5645446baeea5654afbcb060

	  System UUID:                a500128d-5645-446b-aeea-5654afbcb060

	  Boot ID:                    a9ffe936-2356-415e-aa5e-ceedcf15ed72

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://27.0.1

	  Kubelet Version:            v1.30.2

	  Kube-Proxy Version:         v1.30.2

	PodCIDR:                      10.244.0.0/24

	PodCIDRs:                     10.244.0.0/24

	Non-terminated Pods:          (11 in total)

	  Namespace                   Name                                 CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                 ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-pjfcw              0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m7s

	  kube-system                 coredns-7db6d8ff4d-nk4lf             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     11m

	  kube-system                 coredns-7db6d8ff4d-p4rtz             100m (5%!)(MISSING)     0 (0%!)(MISSING)      70Mi (3%!)(MISSING)        170Mi (8%!)(MISSING)     11m

	  kube-system                 etcd-ha-735960                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         11m

	  kube-system                 kindnet-7f6hm                        100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      11m

	  kube-system                 kube-apiserver-ha-735960             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m

	  kube-system                 kube-controller-manager-ha-735960    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m

	  kube-system                 kube-proxy-lphzn                     0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m

	  kube-system                 kube-scheduler-ha-735960             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m

	  kube-system                 kube-vip-ha-735960                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         2m29s

	  kube-system                 storage-provisioner                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         11m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests     Limits

	  --------           --------     ------

	  cpu                950m (47%!)(MISSING)   100m (5%!)(MISSING)

	  memory             290Mi (13%!)(MISSING)  390Mi (18%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)       0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)       0 (0%!)(MISSING)

	Events:

	  Type    Reason                   Age                    From             Message

	  ----    ------                   ----                   ----             -------

	  Normal  Starting                 11m                    kube-proxy       

	  Normal  Starting                 2m14s                  kube-proxy       

	  Normal  Starting                 11m                    kubelet          Starting kubelet.

	  Normal  NodeAllocatableEnforced  11m                    kubelet          Updated Node Allocatable limit across pods

	  Normal  NodeHasSufficientMemory  11m                    kubelet          Node ha-735960 status is now: NodeHasSufficientMemory

	  Normal  NodeHasNoDiskPressure    11m                    kubelet          Node ha-735960 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     11m                    kubelet          Node ha-735960 status is now: NodeHasSufficientPID

	  Normal  RegisteredNode           11m                    node-controller  Node ha-735960 event: Registered Node ha-735960 in Controller

	  Normal  NodeReady                11m                    kubelet          Node ha-735960 status is now: NodeReady

	  Normal  RegisteredNode           10m                    node-controller  Node ha-735960 event: Registered Node ha-735960 in Controller

	  Normal  RegisteredNode           9m12s                  node-controller  Node ha-735960 event: Registered Node ha-735960 in Controller

	  Normal  RegisteredNode           7m3s                   node-controller  Node ha-735960 event: Registered Node ha-735960 in Controller

	  Normal  NodeHasSufficientMemory  3m12s (x8 over 3m12s)  kubelet          Node ha-735960 status is now: NodeHasSufficientMemory

	  Normal  Starting                 3m12s                  kubelet          Starting kubelet.

	  Normal  NodeHasNoDiskPressure    3m12s (x8 over 3m12s)  kubelet          Node ha-735960 status is now: NodeHasNoDiskPressure

	  Normal  NodeHasSufficientPID     3m12s (x7 over 3m12s)  kubelet          Node ha-735960 status is now: NodeHasSufficientPID

	  Normal  NodeAllocatableEnforced  3m12s                  kubelet          Updated Node Allocatable limit across pods

	  Normal  RegisteredNode           2m25s                  node-controller  Node ha-735960 event: Registered Node ha-735960 in Controller

	  Normal  RegisteredNode           2m14s                  node-controller  Node ha-735960 event: Registered Node ha-735960 in Controller

	  Normal  RegisteredNode           38s                    node-controller  Node ha-735960 event: Registered Node ha-735960 in Controller

	Name:               ha-735960-m02

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-735960-m02

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=f87dc4b1adfa3faf30393d14b8f7fb9acc5e991c

	                    minikube.k8s.io/name=ha-735960

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_07_01T12_17_00_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 01 Jul 2024 12:16:57 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-735960-m02

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 01 Jul 2024 12:27:31 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 01 Jul 2024 12:25:08 +0000   Mon, 01 Jul 2024 12:16:57 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 01 Jul 2024 12:25:08 +0000   Mon, 01 Jul 2024 12:16:57 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 01 Jul 2024 12:25:08 +0000   Mon, 01 Jul 2024 12:16:57 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 01 Jul 2024 12:25:08 +0000   Mon, 01 Jul 2024 12:17:09 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.86

	  Hostname:    ha-735960-m02

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 58cf4e4771994f2084a06f7d76199172

	  System UUID:                58cf4e47-7199-4f20-84a0-6f7d76199172

	  Boot ID:                    41c32de2-f03a-41e4-b332-91dc3dc2ccaf

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://27.0.1

	  Kubelet Version:            v1.30.2

	  Kube-Proxy Version:         v1.30.2

	PodCIDR:                      10.244.1.0/24

	PodCIDRs:                     10.244.1.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-twnb4                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m7s

	  kube-system                 etcd-ha-735960-m02                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         10m

	  kube-system                 kindnet-bztzv                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      10m

	  kube-system                 kube-apiserver-ha-735960-m02             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 kube-controller-manager-ha-735960-m02    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 kube-proxy-b6knb                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 kube-scheduler-ha-735960-m02             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	  kube-system                 kube-vip-ha-735960-m02                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         10m

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type     Reason                   Age                    From             Message

	  ----     ------                   ----                   ----             -------

	  Normal   Starting                 2m20s                  kube-proxy       

	  Normal   Starting                 7m16s                  kube-proxy       

	  Normal   Starting                 10m                    kube-proxy       

	  Normal   NodeAllocatableEnforced  10m                    kubelet          Updated Node Allocatable limit across pods

	  Normal   NodeHasSufficientMemory  10m (x8 over 10m)      kubelet          Node ha-735960-m02 status is now: NodeHasSufficientMemory

	  Normal   NodeHasNoDiskPressure    10m (x8 over 10m)      kubelet          Node ha-735960-m02 status is now: NodeHasNoDiskPressure

	  Normal   NodeHasSufficientPID     10m (x7 over 10m)      kubelet          Node ha-735960-m02 status is now: NodeHasSufficientPID

	  Normal   RegisteredNode           10m                    node-controller  Node ha-735960-m02 event: Registered Node ha-735960-m02 in Controller

	  Normal   RegisteredNode           10m                    node-controller  Node ha-735960-m02 event: Registered Node ha-735960-m02 in Controller

	  Normal   RegisteredNode           9m12s                  node-controller  Node ha-735960-m02 event: Registered Node ha-735960-m02 in Controller

	  Normal   Starting                 7m21s                  kubelet          Starting kubelet.

	  Warning  Rebooted                 7m21s                  kubelet          Node ha-735960-m02 has been rebooted, boot id: 64290a4a-a20d-436b-8567-0d3e8b822776

	  Normal   NodeHasSufficientPID     7m21s                  kubelet          Node ha-735960-m02 status is now: NodeHasSufficientPID

	  Normal   NodeAllocatableEnforced  7m21s                  kubelet          Updated Node Allocatable limit across pods

	  Normal   NodeHasSufficientMemory  7m21s                  kubelet          Node ha-735960-m02 status is now: NodeHasSufficientMemory

	  Normal   NodeHasNoDiskPressure    7m21s                  kubelet          Node ha-735960-m02 status is now: NodeHasNoDiskPressure

	  Normal   RegisteredNode           7m3s                   node-controller  Node ha-735960-m02 event: Registered Node ha-735960-m02 in Controller

	  Normal   Starting                 2m48s                  kubelet          Starting kubelet.

	  Normal   NodeHasSufficientMemory  2m48s (x8 over 2m48s)  kubelet          Node ha-735960-m02 status is now: NodeHasSufficientMemory

	  Normal   NodeHasNoDiskPressure    2m48s (x8 over 2m48s)  kubelet          Node ha-735960-m02 status is now: NodeHasNoDiskPressure

	  Normal   NodeHasSufficientPID     2m48s (x7 over 2m48s)  kubelet          Node ha-735960-m02 status is now: NodeHasSufficientPID

	  Normal   NodeAllocatableEnforced  2m48s                  kubelet          Updated Node Allocatable limit across pods

	  Normal   RegisteredNode           2m25s                  node-controller  Node ha-735960-m02 event: Registered Node ha-735960-m02 in Controller

	  Normal   RegisteredNode           2m14s                  node-controller  Node ha-735960-m02 event: Registered Node ha-735960-m02 in Controller

	  Normal   RegisteredNode           38s                    node-controller  Node ha-735960-m02 event: Registered Node ha-735960-m02 in Controller

	Name:               ha-735960-m03

	Roles:              control-plane

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-735960-m03

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=f87dc4b1adfa3faf30393d14b8f7fb9acc5e991c

	                    minikube.k8s.io/name=ha-735960

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_07_01T12_18_11_0700

	                    minikube.k8s.io/version=v1.33.1

	                    node-role.kubernetes.io/control-plane=

	                    node.kubernetes.io/exclude-from-external-load-balancers=

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 01 Jul 2024 12:18:07 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-735960-m03

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 01 Jul 2024 12:27:33 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 01 Jul 2024 12:26:42 +0000   Mon, 01 Jul 2024 12:26:42 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 01 Jul 2024 12:26:42 +0000   Mon, 01 Jul 2024 12:26:42 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 01 Jul 2024 12:26:42 +0000   Mon, 01 Jul 2024 12:26:42 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 01 Jul 2024 12:26:42 +0000   Mon, 01 Jul 2024 12:26:42 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.97

	  Hostname:    ha-735960-m03

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 995d5c3b59f847378d8e94e940e73ad6

	  System UUID:                995d5c3b-59f8-4737-8d8e-94e940e73ad6

	  Boot ID:                    bc7ccd53-413f-4b49-a89c-18c93eb90ad9

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://27.0.1

	  Kubelet Version:            v1.30.2

	  Kube-Proxy Version:         v1.30.2

	PodCIDR:                      10.244.2.0/24

	PodCIDRs:                     10.244.2.0/24

	Non-terminated Pods:          (8 in total)

	  Namespace                   Name                                     CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                                     ------------  ----------  ---------------  -------------  ---

	  default                     busybox-fc5497c4f-cpsct                  0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m7s

	  kube-system                 etcd-ha-735960-m03                       100m (5%!)(MISSING)     0 (0%!)(MISSING)      100Mi (4%!)(MISSING)       0 (0%!)(MISSING)         9m29s

	  kube-system                 kindnet-2424m                            100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      9m31s

	  kube-system                 kube-apiserver-ha-735960-m03             250m (12%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m29s

	  kube-system                 kube-controller-manager-ha-735960-m03    200m (10%!)(MISSING)    0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m29s

	  kube-system                 kube-proxy-776rt                         0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m31s

	  kube-system                 kube-scheduler-ha-735960-m03             100m (5%!)(MISSING)     0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m29s

	  kube-system                 kube-vip-ha-735960-m03                   0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         9m26s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests    Limits

	  --------           --------    ------

	  cpu                750m (37%!)(MISSING)  100m (5%!)(MISSING)

	  memory             150Mi (7%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)      0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)      0 (0%!)(MISSING)

	Events:

	  Type     Reason                   Age                    From             Message

	  ----     ------                   ----                   ----             -------

	  Normal   Starting                 51s                    kube-proxy       

	  Normal   Starting                 9m26s                  kube-proxy       

	  Normal   NodeAllocatableEnforced  9m31s                  kubelet          Updated Node Allocatable limit across pods

	  Normal   NodeHasSufficientMemory  9m31s (x8 over 9m31s)  kubelet          Node ha-735960-m03 status is now: NodeHasSufficientMemory

	  Normal   NodeHasNoDiskPressure    9m31s (x8 over 9m31s)  kubelet          Node ha-735960-m03 status is now: NodeHasNoDiskPressure

	  Normal   NodeHasSufficientPID     9m31s (x7 over 9m31s)  kubelet          Node ha-735960-m03 status is now: NodeHasSufficientPID

	  Normal   RegisteredNode           9m28s                  node-controller  Node ha-735960-m03 event: Registered Node ha-735960-m03 in Controller

	  Normal   RegisteredNode           9m27s                  node-controller  Node ha-735960-m03 event: Registered Node ha-735960-m03 in Controller

	  Normal   RegisteredNode           9m12s                  node-controller  Node ha-735960-m03 event: Registered Node ha-735960-m03 in Controller

	  Normal   RegisteredNode           7m3s                   node-controller  Node ha-735960-m03 event: Registered Node ha-735960-m03 in Controller

	  Normal   RegisteredNode           2m25s                  node-controller  Node ha-735960-m03 event: Registered Node ha-735960-m03 in Controller

	  Normal   RegisteredNode           2m14s                  node-controller  Node ha-735960-m03 event: Registered Node ha-735960-m03 in Controller

	  Normal   NodeNotReady             105s                   node-controller  Node ha-735960-m03 status is now: NodeNotReady

	  Normal   Starting                 56s                    kubelet          Starting kubelet.

	  Normal   NodeAllocatableEnforced  56s                    kubelet          Updated Node Allocatable limit across pods

	  Normal   NodeHasSufficientMemory  56s (x3 over 56s)      kubelet          Node ha-735960-m03 status is now: NodeHasSufficientMemory

	  Normal   NodeHasNoDiskPressure    56s (x3 over 56s)      kubelet          Node ha-735960-m03 status is now: NodeHasNoDiskPressure

	  Normal   NodeHasSufficientPID     56s (x3 over 56s)      kubelet          Node ha-735960-m03 status is now: NodeHasSufficientPID

	  Warning  Rebooted                 56s (x2 over 56s)      kubelet          Node ha-735960-m03 has been rebooted, boot id: bc7ccd53-413f-4b49-a89c-18c93eb90ad9

	  Normal   NodeReady                56s (x2 over 56s)      kubelet          Node ha-735960-m03 status is now: NodeReady

	  Normal   RegisteredNode           38s                    node-controller  Node ha-735960-m03 event: Registered Node ha-735960-m03 in Controller

	Name:               ha-735960-m04

	Roles:              <none>

	Labels:             beta.kubernetes.io/arch=amd64

	                    beta.kubernetes.io/os=linux

	                    kubernetes.io/arch=amd64

	                    kubernetes.io/hostname=ha-735960-m04

	                    kubernetes.io/os=linux

	                    minikube.k8s.io/commit=f87dc4b1adfa3faf30393d14b8f7fb9acc5e991c

	                    minikube.k8s.io/name=ha-735960

	                    minikube.k8s.io/primary=false

	                    minikube.k8s.io/updated_at=2024_07_01T12_19_10_0700

	                    minikube.k8s.io/version=v1.33.1

	Annotations:        kubeadm.alpha.kubernetes.io/cri-socket: unix:///var/run/cri-dockerd.sock

	                    node.alpha.kubernetes.io/ttl: 0

	                    volumes.kubernetes.io/controller-managed-attach-detach: true

	CreationTimestamp:  Mon, 01 Jul 2024 12:19:09 +0000

	Taints:             <none>

	Unschedulable:      false

	Lease:

	  HolderIdentity:  ha-735960-m04

	  AcquireTime:     <unset>

	  RenewTime:       Mon, 01 Jul 2024 12:27:29 +0000

	Conditions:

	  Type             Status  LastHeartbeatTime                 LastTransitionTime                Reason                       Message

	  ----             ------  -----------------                 ------------------                ------                       -------

	  MemoryPressure   False   Mon, 01 Jul 2024 12:27:30 +0000   Mon, 01 Jul 2024 12:27:30 +0000   KubeletHasSufficientMemory   kubelet has sufficient memory available

	  DiskPressure     False   Mon, 01 Jul 2024 12:27:30 +0000   Mon, 01 Jul 2024 12:27:30 +0000   KubeletHasNoDiskPressure     kubelet has no disk pressure

	  PIDPressure      False   Mon, 01 Jul 2024 12:27:30 +0000   Mon, 01 Jul 2024 12:27:30 +0000   KubeletHasSufficientPID      kubelet has sufficient PID available

	  Ready            True    Mon, 01 Jul 2024 12:27:30 +0000   Mon, 01 Jul 2024 12:27:30 +0000   KubeletReady                 kubelet is posting ready status

	Addresses:

	  InternalIP:  192.168.39.60

	  Hostname:    ha-735960-m04

	Capacity:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	Allocatable:

	  cpu:                2

	  ephemeral-storage:  17734596Ki

	  hugepages-2Mi:      0

	  memory:             2164184Ki

	  pods:               110

	System Info:

	  Machine ID:                 fd9ce62e425d4b9a9ba9ce7045362f6f

	  System UUID:                fd9ce62e-425d-4b9a-9ba9-ce7045362f6f

	  Boot ID:                    ac395c38-b578-4b7c-8c31-9939ff570d11

	  Kernel Version:             5.10.207

	  OS Image:                   Buildroot 2023.02.9

	  Operating System:           linux

	  Architecture:               amd64

	  Container Runtime Version:  docker://27.0.1

	  Kubelet Version:            v1.30.2

	  Kube-Proxy Version:         v1.30.2

	PodCIDR:                      10.244.3.0/24

	PodCIDRs:                     10.244.3.0/24

	Non-terminated Pods:          (2 in total)

	  Namespace                   Name                CPU Requests  CPU Limits  Memory Requests  Memory Limits  Age

	  ---------                   ----                ------------  ----------  ---------------  -------------  ---

	  kube-system                 kindnet-6gx8s       100m (5%!)(MISSING)     100m (5%!)(MISSING)   50Mi (2%!)(MISSING)        50Mi (2%!)(MISSING)      8m29s

	  kube-system                 kube-proxy-25ssf    0 (0%!)(MISSING)        0 (0%!)(MISSING)      0 (0%!)(MISSING)           0 (0%!)(MISSING)         8m29s

	Allocated resources:

	  (Total limits may be over 100 percent, i.e., overcommitted.)

	  Resource           Requests   Limits

	  --------           --------   ------

	  cpu                100m (5%!)(MISSING)  100m (5%!)(MISSING)

	  memory             50Mi (2%!)(MISSING)  50Mi (2%!)(MISSING)

	  ephemeral-storage  0 (0%!)(MISSING)     0 (0%!)(MISSING)

	  hugepages-2Mi      0 (0%!)(MISSING)     0 (0%!)(MISSING)

	Events:

	  Type     Reason                   Age                    From             Message

	  ----     ------                   ----                   ----             -------

	  Normal   Starting                 8m22s                  kube-proxy       

	  Normal   Starting                 6s                     kube-proxy       

	  Normal   NodeHasSufficientMemory  8m29s (x2 over 8m29s)  kubelet          Node ha-735960-m04 status is now: NodeHasSufficientMemory

	  Normal   NodeHasNoDiskPressure    8m29s (x2 over 8m29s)  kubelet          Node ha-735960-m04 status is now: NodeHasNoDiskPressure

	  Normal   NodeHasSufficientPID     8m29s (x2 over 8m29s)  kubelet          Node ha-735960-m04 status is now: NodeHasSufficientPID

	  Normal   NodeAllocatableEnforced  8m29s                  kubelet          Updated Node Allocatable limit across pods

	  Normal   RegisteredNode           8m28s                  node-controller  Node ha-735960-m04 event: Registered Node ha-735960-m04 in Controller

	  Normal   RegisteredNode           8m27s                  node-controller  Node ha-735960-m04 event: Registered Node ha-735960-m04 in Controller

	  Normal   RegisteredNode           8m27s                  node-controller  Node ha-735960-m04 event: Registered Node ha-735960-m04 in Controller

	  Normal   NodeReady                8m17s                  kubelet          Node ha-735960-m04 status is now: NodeReady

	  Normal   RegisteredNode           7m3s                   node-controller  Node ha-735960-m04 event: Registered Node ha-735960-m04 in Controller

	  Normal   RegisteredNode           2m25s                  node-controller  Node ha-735960-m04 event: Registered Node ha-735960-m04 in Controller

	  Normal   RegisteredNode           2m14s                  node-controller  Node ha-735960-m04 event: Registered Node ha-735960-m04 in Controller

	  Normal   NodeNotReady             105s                   node-controller  Node ha-735960-m04 status is now: NodeNotReady

	  Normal   RegisteredNode           38s                    node-controller  Node ha-735960-m04 event: Registered Node ha-735960-m04 in Controller

	  Normal   Starting                 9s                     kubelet          Starting kubelet.

	  Normal   NodeAllocatableEnforced  9s                     kubelet          Updated Node Allocatable limit across pods

	  Normal   NodeHasSufficientMemory  8s (x2 over 8s)        kubelet          Node ha-735960-m04 status is now: NodeHasSufficientMemory

	  Normal   NodeHasNoDiskPressure    8s (x2 over 8s)        kubelet          Node ha-735960-m04 status is now: NodeHasNoDiskPressure

	  Normal   NodeHasSufficientPID     8s (x2 over 8s)        kubelet          Node ha-735960-m04 status is now: NodeHasSufficientPID

	  Warning  Rebooted                 8s                     kubelet          Node ha-735960-m04 has been rebooted, boot id: ac395c38-b578-4b7c-8c31-9939ff570d11

	  Normal   NodeReady                8s                     kubelet          Node ha-735960-m04 status is now: NodeReady

	==> dmesg <==

	[  +0.000001] Unless you actually understand what nomodeset does, you should reboot without enabling it

	[  +0.050613] Spectre V2 : WARNING: Unprivileged eBPF is enabled with eIBRS on, data leaks possible via Spectre v2 BHB attacks!

	[  +0.036847] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

	[  +4.466422] platform regulatory.0: Direct firmware load for regulatory.db failed with error -2

	[  +1.742414] systemd-fstab-generator[116]: Ignoring "noauto" option for root device

	[  +1.542503] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory

	[  +0.000005] NFSD: unable to find recovery directory /var/lib/nfs/v4recovery

	[  +0.000002] NFSD: Unable to initialize client recovery tracking! (-2)

	[  +5.890956] systemd-fstab-generator[479]: Ignoring "noauto" option for root device

	[  +0.054969] kauditd_printk_skb: 1 callbacks suppressed

	[  +0.050473] systemd-fstab-generator[491]: Ignoring "noauto" option for root device

	[  +2.186564] systemd-fstab-generator[1047]: Ignoring "noauto" option for root device

	[  +0.281745] systemd-fstab-generator[1084]: Ignoring "noauto" option for root device

	[  +0.110826] systemd-fstab-generator[1096]: Ignoring "noauto" option for root device

	[  +0.123894] systemd-fstab-generator[1110]: Ignoring "noauto" option for root device

	[  +2.248144] kauditd_printk_skb: 195 callbacks suppressed

	[  +0.296890] systemd-fstab-generator[1351]: Ignoring "noauto" option for root device

	[  +0.110572] systemd-fstab-generator[1363]: Ignoring "noauto" option for root device

	[  +0.111234] systemd-fstab-generator[1375]: Ignoring "noauto" option for root device

	[  +0.128120] systemd-fstab-generator[1390]: Ignoring "noauto" option for root device

	[  +0.483978] systemd-fstab-generator[1543]: Ignoring "noauto" option for root device

	[  +6.839985] kauditd_printk_skb: 176 callbacks suppressed

	[ +10.416982] kauditd_printk_skb: 40 callbacks suppressed

	[Jul 1 12:25] kauditd_printk_skb: 30 callbacks suppressed

	[ +36.086285] kauditd_printk_skb: 48 callbacks suppressed

	==> etcd [6a200a6b4902] <==

	{"level":"info","ts":"2024-07-01T12:23:54.888482Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:54.888629Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:54.888657Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:54.888687Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:54.88881Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:56.288805Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:56.288918Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:56.288952Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:56.289018Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:56.289055Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:57.688608Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:57.688647Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:57.688658Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:57.688677Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:57.688686Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	{"level":"warn","ts":"2024-07-01T12:23:57.772826Z","caller":"etcdserver/server.go:2089","msg":"failed to publish local member to cluster through raft","local-member-id":"b6c76b3131c1024","local-member-attributes":"{Name:ha-735960 ClientURLs:[https://192.168.39.16:2379]}","request-path":"/0/members/b6c76b3131c1024/attributes","publish-timeout":"7s","error":"etcdserver: request timed out"}

	{"level":"info","ts":"2024-07-01T12:23:59.088585Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 is starting a new election at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:59.088645Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 became pre-candidate at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:59.08866Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 received MsgPreVoteResp from b6c76b3131c1024 at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:59.088676Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to 77557cf66c24e9ff at term 2"}

	{"level":"info","ts":"2024-07-01T12:23:59.088691Z","logger":"raft","caller":"etcdserver/zap_raft.go:77","msg":"b6c76b3131c1024 [logterm: 2, index: 1880] sent MsgPreVote request to c77bbbee62c21090 at term 2"}

	{"level":"warn","ts":"2024-07-01T12:23:59.821067Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"c77bbbee62c21090","rtt":"0s","error":"dial tcp 192.168.39.86:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:23:59.821149Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"c77bbbee62c21090","rtt":"0s","error":"dial tcp 192.168.39.86:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:23:59.836394Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: connect: no route to host"}

	{"level":"warn","ts":"2024-07-01T12:23:59.837603Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: connect: no route to host"}

	==> etcd [852492f61fee] <==

	{"level":"warn","ts":"2024-07-01T12:26:26.327522Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"https://192.168.39.97:2380/version","remote-member-id":"77557cf66c24e9ff","error":"Get \"https://192.168.39.97:2380/version\": dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:26.327591Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"77557cf66c24e9ff","error":"Get \"https://192.168.39.97:2380/version\": dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:28.673762Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:28.673886Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:30.329643Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"https://192.168.39.97:2380/version","remote-member-id":"77557cf66c24e9ff","error":"Get \"https://192.168.39.97:2380/version\": dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:30.329708Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"77557cf66c24e9ff","error":"Get \"https://192.168.39.97:2380/version\": dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:33.674228Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:33.674291Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:34.331758Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"https://192.168.39.97:2380/version","remote-member-id":"77557cf66c24e9ff","error":"Get \"https://192.168.39.97:2380/version\": dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:34.331871Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"77557cf66c24e9ff","error":"Get \"https://192.168.39.97:2380/version\": dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:38.333902Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"https://192.168.39.97:2380/version","remote-member-id":"77557cf66c24e9ff","error":"Get \"https://192.168.39.97:2380/version\": dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:38.334199Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"77557cf66c24e9ff","error":"Get \"https://192.168.39.97:2380/version\": dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:38.674977Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:38.675107Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:42.336588Z","caller":"etcdserver/cluster_util.go:294","msg":"failed to reach the peer URL","address":"https://192.168.39.97:2380/version","remote-member-id":"77557cf66c24e9ff","error":"Get \"https://192.168.39.97:2380/version\": dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:42.336721Z","caller":"etcdserver/cluster_util.go:158","msg":"failed to get version","remote-member-id":"77557cf66c24e9ff","error":"Get \"https://192.168.39.97:2380/version\": dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:43.675872Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_SNAPSHOT","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"warn","ts":"2024-07-01T12:26:43.675816Z","caller":"rafthttp/probing_status.go:68","msg":"prober detected unhealthy status","round-tripper-name":"ROUND_TRIPPER_RAFT_MESSAGE","remote-peer-id":"77557cf66c24e9ff","rtt":"0s","error":"dial tcp 192.168.39.97:2380: connect: connection refused"}

	{"level":"info","ts":"2024-07-01T12:26:44.691256Z","caller":"rafthttp/peer_status.go:53","msg":"peer became active","peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:26:44.707815Z","caller":"rafthttp/stream.go:249","msg":"set message encoder","from":"b6c76b3131c1024","to":"77557cf66c24e9ff","stream-type":"stream MsgApp v2"}

	{"level":"info","ts":"2024-07-01T12:26:44.707933Z","caller":"rafthttp/stream.go:274","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream MsgApp v2","local-member-id":"b6c76b3131c1024","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:26:44.734098Z","caller":"rafthttp/stream.go:412","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream Message","local-member-id":"b6c76b3131c1024","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:26:44.734341Z","caller":"rafthttp/stream.go:412","msg":"established TCP streaming connection with remote peer","stream-reader-type":"stream MsgApp v2","local-member-id":"b6c76b3131c1024","remote-peer-id":"77557cf66c24e9ff"}

	{"level":"info","ts":"2024-07-01T12:26:44.734943Z","caller":"rafthttp/stream.go:249","msg":"set message encoder","from":"b6c76b3131c1024","to":"77557cf66c24e9ff","stream-type":"stream Message"}

	{"level":"info","ts":"2024-07-01T12:26:44.734997Z","caller":"rafthttp/stream.go:274","msg":"established TCP streaming connection with remote peer","stream-writer-type":"stream Message","local-member-id":"b6c76b3131c1024","remote-peer-id":"77557cf66c24e9ff"}

	==> kernel <==

	 12:27:38 up 3 min,  0 users,  load average: 0.12, 0.16, 0.08

	Linux ha-735960 5.10.207 #1 SMP Wed Jun 26 19:37:34 UTC 2024 x86_64 GNU/Linux

	PRETTY_NAME="Buildroot 2023.02.9"

	==> kindnet [bf788c37e091] <==

	I0701 12:27:06.456938       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:27:16.469806       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:27:16.469876       1 main.go:227] handling current node

	I0701 12:27:16.469887       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:27:16.469892       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:27:16.470093       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:27:16.470154       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:27:16.470277       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:27:16.470296       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:27:26.489056       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:27:26.489096       1 main.go:227] handling current node

	I0701 12:27:26.489107       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:27:26.489112       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:27:26.489365       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:27:26.489389       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:27:26.489445       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:27:26.489502       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:27:36.502509       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:27:36.502721       1 main.go:227] handling current node

	I0701 12:27:36.502867       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:27:36.502957       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:27:36.503231       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:27:36.503293       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:27:36.503421       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:27:36.503550       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	==> kindnet [f472aef5302f] <==

	I0701 12:20:12.428842       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:20:22.443154       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:20:22.443292       1 main.go:227] handling current node

	I0701 12:20:22.443323       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:20:22.443388       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:20:22.443605       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:20:22.443653       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:20:22.443793       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:20:22.443836       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:20:32.451395       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:20:32.451431       1 main.go:227] handling current node

	I0701 12:20:32.451481       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:20:32.451486       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:20:32.451947       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:20:32.451980       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:20:32.452873       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:20:32.453015       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	I0701 12:20:42.470169       1 main.go:223] Handling node with IPs: map[192.168.39.16:{}]

	I0701 12:20:42.470264       1 main.go:227] handling current node

	I0701 12:20:42.470289       1 main.go:223] Handling node with IPs: map[192.168.39.86:{}]

	I0701 12:20:42.470302       1 main.go:250] Node ha-735960-m02 has CIDR [10.244.1.0/24] 

	I0701 12:20:42.470523       1 main.go:223] Handling node with IPs: map[192.168.39.97:{}]

	I0701 12:20:42.470616       1 main.go:250] Node ha-735960-m03 has CIDR [10.244.2.0/24] 

	I0701 12:20:42.470868       1 main.go:223] Handling node with IPs: map[192.168.39.60:{}]

	I0701 12:20:42.470914       1 main.go:250] Node ha-735960-m04 has CIDR [10.244.3.0/24] 

	==> kube-apiserver [8ee3e44a43c3] <==

	I0701 12:25:11.632913       1 shared_informer.go:313] Waiting for caches to sync for configmaps

	I0701 12:25:11.645811       1 crdregistration_controller.go:111] Starting crd-autoregister controller

	I0701 12:25:11.645876       1 shared_informer.go:313] Waiting for caches to sync for crd-autoregister

	I0701 12:25:11.690103       1 shared_informer.go:320] Caches are synced for *generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]

	I0701 12:25:11.690292       1 policy_source.go:224] refreshing policies

	I0701 12:25:11.718179       1 controller.go:615] quota admission added evaluator for: leases.coordination.k8s.io

	I0701 12:25:11.726917       1 cache.go:39] Caches are synced for APIServiceRegistrationController controller

	I0701 12:25:11.729879       1 shared_informer.go:320] Caches are synced for cluster_authentication_trust_controller

	I0701 12:25:11.730212       1 apf_controller.go:379] Running API Priority and Fairness config worker

	I0701 12:25:11.730238       1 apf_controller.go:382] Running API Priority and Fairness periodic rebalancing process

	I0701 12:25:11.737552       1 shared_informer.go:320] Caches are synced for configmaps

	I0701 12:25:11.751625       1 shared_informer.go:320] Caches are synced for crd-autoregister

	I0701 12:25:11.752269       1 aggregator.go:165] initial CRD sync complete...

	I0701 12:25:11.752312       1 autoregister_controller.go:141] Starting autoregister controller

	I0701 12:25:11.752319       1 cache.go:32] Waiting for caches to sync for autoregister controller

	I0701 12:25:11.752325       1 cache.go:39] Caches are synced for autoregister controller

	I0701 12:25:11.756015       1 shared_informer.go:320] Caches are synced for node_authorizer

	I0701 12:25:11.757180       1 cache.go:39] Caches are synced for AvailableConditionController controller

	I0701 12:25:11.779526       1 handler_discovery.go:447] Starting ResourceDiscoveryManager

	W0701 12:25:11.807352       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.86]

	I0701 12:25:11.811699       1 controller.go:615] quota admission added evaluator for: endpoints

	I0701 12:25:11.839496       1 controller.go:615] quota admission added evaluator for: endpointslices.discovery.k8s.io

	E0701 12:25:11.843047       1 controller.go:95] Found stale data, removed previous endpoints on kubernetes service, apiserver didn't exit successfully previously

	I0701 12:25:12.631101       1 storage_scheduling.go:111] all system priority classes are created successfully or already exist.

	W0701 12:25:13.074615       1 lease.go:265] Resetting endpoints for master service "kubernetes" to [192.168.39.16 192.168.39.86]

	==> kube-apiserver [a3cb59ee8d57] <==

	I0701 12:24:33.660467       1 options.go:221] external host was not specified, using 192.168.39.16

	I0701 12:24:33.670142       1 server.go:148] Version: v1.30.2

	I0701 12:24:33.670491       1 server.go:150] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0701 12:24:34.296638       1 shared_informer.go:313] Waiting for caches to sync for node_authorizer

	I0701 12:24:34.308879       1 shared_informer.go:313] Waiting for caches to sync for *generic.policySource[*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicy,*k8s.io/api/admissionregistration/v1.ValidatingAdmissionPolicyBinding,k8s.io/apiserver/pkg/admission/plugin/policy/validating.Validator]

	I0701 12:24:34.324179       1 plugins.go:157] Loaded 12 mutating admission controller(s) successfully in the following order: NamespaceLifecycle,LimitRanger,ServiceAccount,NodeRestriction,TaintNodesByCondition,Priority,DefaultTolerationSeconds,DefaultStorageClass,StorageObjectInUseProtection,RuntimeClass,DefaultIngressClass,MutatingAdmissionWebhook.

	I0701 12:24:34.324219       1 plugins.go:160] Loaded 13 validating admission controller(s) successfully in the following order: LimitRanger,ServiceAccount,PodSecurity,Priority,PersistentVolumeClaimResize,RuntimeClass,CertificateApproval,CertificateSigning,ClusterTrustBundleAttest,CertificateSubjectRestriction,ValidatingAdmissionPolicy,ValidatingAdmissionWebhook,ResourceQuota.

	I0701 12:24:34.326894       1 instance.go:299] Using reconciler: lease

	W0701 12:24:54.288105       1 logging.go:59] [core] [Channel #1 SubChannel #2] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: authentication handshake failed: context canceled"

	W0701 12:24:54.289911       1 logging.go:59] [core] [Channel #3 SubChannel #4] grpc: addrConn.createTransport failed to connect to {Addr: "127.0.0.1:2379", ServerName: "127.0.0.1:2379", }. Err: connection error: desc = "transport: authentication handshake failed: context canceled"

	F0701 12:24:54.328399       1 instance.go:292] Error creating leases: error creating storage factory: context deadline exceeded

	==> kube-controller-manager [67dc946c8c45] <==

	I0701 12:25:24.689462       1 shared_informer.go:320] Caches are synced for deployment

	I0701 12:25:24.698997       1 shared_informer.go:320] Caches are synced for ReplicaSet

	I0701 12:25:24.699584       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="194.691µs"

	I0701 12:25:24.699894       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="568.701µs"

	I0701 12:25:24.704343       1 shared_informer.go:320] Caches are synced for resource quota

	I0701 12:25:24.710493       1 shared_informer.go:320] Caches are synced for stateful set

	I0701 12:25:24.741914       1 shared_informer.go:320] Caches are synced for resource quota

	I0701 12:25:24.771129       1 shared_informer.go:320] Caches are synced for disruption

	I0701 12:25:24.825005       1 shared_informer.go:320] Caches are synced for persistent volume

	I0701 12:25:25.061636       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="39.968119ms"

	I0701 12:25:25.061928       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="47.671µs"

	I0701 12:25:25.231337       1 shared_informer.go:320] Caches are synced for garbage collector

	I0701 12:25:25.278015       1 shared_informer.go:320] Caches are synced for garbage collector

	I0701 12:25:25.278079       1 garbagecollector.go:157] "All resource monitors have synced. Proceeding to collect garbage" logger="garbage-collector-controller"

	I0701 12:25:53.073870       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-735960-m04"

	I0701 12:25:53.162214       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="20.543735ms"

	I0701 12:25:53.163381       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="162.337µs"

	I0701 12:25:59.557437       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="56.6658ms"

	I0701 12:25:59.558362       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="kube-system/coredns-7db6d8ff4d" duration="80.196µs"

	I0701 12:25:59.565576       1 endpointslice_controller.go:311] "Error syncing endpoint slices for service, retrying" logger="endpointslice-controller" key="kube-system/kube-dns" err="failed to update kube-dns-s49dr EndpointSlice for Service kube-system/kube-dns: Operation cannot be fulfilled on endpointslices.discovery.k8s.io \"kube-dns-s49dr\": the object has been modified; please apply your changes to the latest version and try again"

	I0701 12:25:59.566070       1 event.go:377] Event(v1.ObjectReference{Kind:"Service", Namespace:"kube-system", Name:"kube-dns", UID:"673ce502-ab01-47a0-ad3e-c33bd402b496", APIVersion:"v1", ResourceVersion:"234", FieldPath:""}): type: 'Warning' reason: 'FailedToUpdateEndpointSlices' Error updating Endpoint Slices for Service kube-system/kube-dns: failed to update kube-dns-s49dr EndpointSlice for Service kube-system/kube-dns: Operation cannot be fulfilled on endpointslices.discovery.k8s.io "kube-dns-s49dr": the object has been modified; please apply your changes to the latest version and try again

	I0701 12:26:43.750974       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="174.579µs"

	I0701 12:26:47.044231       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="10.968469ms"

	I0701 12:26:47.047107       1 replica_set.go:676] "Finished syncing" logger="replicaset-controller" kind="ReplicaSet" key="default/busybox-fc5497c4f" duration="77.336µs"

	I0701 12:27:30.083176       1 topologycache.go:237] "Can't get CPU or zone information for node" logger="endpointslice-controller" node="ha-735960-m04"

	==> kube-controller-manager [ec2c061093f1] <==

	I0701 12:24:33.938262       1 serving.go:380] Generated self-signed cert in-memory

	I0701 12:24:34.667463       1 controllermanager.go:189] "Starting" version="v1.30.2"

	I0701 12:24:34.667501       1 controllermanager.go:191] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0701 12:24:34.670076       1 dynamic_cafile_content.go:157] "Starting controller" name="request-header::/var/lib/minikube/certs/front-proxy-ca.crt"

	I0701 12:24:34.670322       1 dynamic_cafile_content.go:157] "Starting controller" name="client-ca-bundle::/var/lib/minikube/certs/ca.crt"

	I0701 12:24:34.670888       1 tlsconfig.go:240] "Starting DynamicServingCertificateController"

	I0701 12:24:34.671075       1 secure_serving.go:213] Serving securely on 127.0.0.1:10257

	E0701 12:24:55.336106       1 controllermanager.go:234] "Error building controller context" err="failed to wait for apiserver being healthy: timed out waiting for the condition: failed to get apiserver /healthz status: Get \"https://192.168.39.16:8443/healthz\": dial tcp 192.168.39.16:8443: connect: connection refused"

	==> kube-proxy [6116abe6039d] <==

	I0701 12:16:09.205590       1 server_linux.go:69] "Using iptables proxy"

	I0701 12:16:09.223098       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.16"]

	I0701 12:16:09.284088       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0701 12:16:09.284134       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0701 12:16:09.284152       1 server_linux.go:165] "Using iptables Proxier"

	I0701 12:16:09.286802       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0701 12:16:09.287240       1 server.go:872] "Version info" version="v1.30.2"

	I0701 12:16:09.287274       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0701 12:16:09.288803       1 config.go:192] "Starting service config controller"

	I0701 12:16:09.288830       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0701 12:16:09.289262       1 config.go:101] "Starting endpoint slice config controller"

	I0701 12:16:09.289283       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0701 12:16:09.290101       1 config.go:319] "Starting node config controller"

	I0701 12:16:09.290125       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0701 12:16:09.389941       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0701 12:16:09.390030       1 shared_informer.go:320] Caches are synced for service config

	I0701 12:16:09.390393       1 shared_informer.go:320] Caches are synced for node config

	==> kube-proxy [710f5c3a9f85] <==

	I0701 12:25:23.858069       1 server_linux.go:69] "Using iptables proxy"

	I0701 12:25:23.875125       1 server.go:1062] "Successfully retrieved node IP(s)" IPs=["192.168.39.16"]

	I0701 12:25:23.958416       1 server_linux.go:143] "No iptables support for family" ipFamily="IPv6"

	I0701 12:25:23.958505       1 server.go:661] "kube-proxy running in single-stack mode" ipFamily="IPv4"

	I0701 12:25:23.958526       1 server_linux.go:165] "Using iptables Proxier"

	I0701 12:25:23.963079       1 proxier.go:243] "Setting route_localnet=1 to allow node-ports on localhost; to change this either disable iptables.localhostNodePorts (--iptables-localhost-nodeports) or set nodePortAddresses (--nodeport-addresses) to filter loopback addresses"

	I0701 12:25:23.963683       1 server.go:872] "Version info" version="v1.30.2"

	I0701 12:25:23.963707       1 server.go:874] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""

	I0701 12:25:23.967807       1 config.go:192] "Starting service config controller"

	I0701 12:25:23.968544       1 shared_informer.go:313] Waiting for caches to sync for service config

	I0701 12:25:23.968625       1 config.go:101] "Starting endpoint slice config controller"

	I0701 12:25:23.968632       1 shared_informer.go:313] Waiting for caches to sync for endpoint slice config

	I0701 12:25:23.972994       1 config.go:319] "Starting node config controller"

	I0701 12:25:23.973007       1 shared_informer.go:313] Waiting for caches to sync for node config

	I0701 12:25:24.069380       1 shared_informer.go:320] Caches are synced for endpoint slice config

	I0701 12:25:24.069565       1 shared_informer.go:320] Caches are synced for service config

	I0701 12:25:24.073577       1 shared_informer.go:320] Caches are synced for node config

	==> kube-scheduler [2d71437c5f06] <==

	Trace[1766396451]: [10.001227292s] [10.001227292s] END

	E0701 12:23:38.923742       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/storageclasses?limit=500&resourceVersion=0": net/http: TLS handshake timeout

	W0701 12:23:40.712171       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.16:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:23:40.712228       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.16:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:23:40.847258       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: Get "https://192.168.39.16:8443/apis/apps/v1/replicasets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:35008->192.168.39.16:8443: read: connection reset by peer

	I0701 12:23:40.847402       1 trace.go:236] Trace[2065780204]: "Reflector ListAndWatch" name:k8s.io/client-go/informers/factory.go:160 (01-Jul-2024 12:23:30.463) (total time: 10384ms):

	Trace[2065780204]: ---"Objects listed" error:Get "https://192.168.39.16:8443/apis/apps/v1/replicasets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:35008->192.168.39.16:8443: read: connection reset by peer 10384ms (12:23:40.847)

	Trace[2065780204]: [10.384136255s] [10.384136255s] END

	E0701 12:23:40.847432       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: Get "https://192.168.39.16:8443/apis/apps/v1/replicasets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:35008->192.168.39.16:8443: read: connection reset by peer

	W0701 12:23:40.847437       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: Get "https://192.168.39.16:8443/api/v1/pods?fieldSelector=status.phase%3DSucceeded%!C(MISSING)status.phase%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:35050->192.168.39.16:8443: read: connection reset by peer

	W0701 12:23:40.847259       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StatefulSet: Get "https://192.168.39.16:8443/apis/apps/v1/statefulsets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:35028->192.168.39.16:8443: read: connection reset by peer

	E0701 12:23:40.847495       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: Get "https://192.168.39.16:8443/api/v1/pods?fieldSelector=status.phase%3DSucceeded%!C(MISSING)status.phase%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:35050->192.168.39.16:8443: read: connection reset by peer

	E0701 12:23:40.847499       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StatefulSet: failed to list *v1.StatefulSet: Get "https://192.168.39.16:8443/apis/apps/v1/statefulsets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:35028->192.168.39.16:8443: read: connection reset by peer

	W0701 12:23:40.847682       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: Get "https://192.168.39.16:8443/api/v1/replicationcontrollers?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:35066->192.168.39.16:8443: read: connection reset by peer

	E0701 12:23:40.847714       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: Get "https://192.168.39.16:8443/api/v1/replicationcontrollers?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:35066->192.168.39.16:8443: read: connection reset by peer

	W0701 12:23:40.848299       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: Get "https://192.168.39.16:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:35034->192.168.39.16:8443: read: connection reset by peer

	E0701 12:23:40.848357       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: Get "https://192.168.39.16:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused - error from a previous attempt: read tcp 192.168.39.16:35034->192.168.39.16:8443: read: connection reset by peer

	W0701 12:23:51.660283       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:23:51.660337       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:23:54.252191       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIStorageCapacity: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csistoragecapacities?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:23:54.252565       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIStorageCapacity: failed to list *v1.CSIStorageCapacity: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csistoragecapacities?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:23:55.679907       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:23:55.680228       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csidrivers?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:24:00.290141       1 server.go:214] "waiting for handlers to sync" err="context canceled"

	E0701 12:24:00.290379       1 run.go:74] "command failed" err="finished without leader elect"

	==> kube-scheduler [693eb0b8f5d7] <==

	W0701 12:25:03.325651       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: Get "https://192.168.39.16:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:25:03.325717       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: Get "https://192.168.39.16:8443/api/v1/services?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:25:03.469418       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.16:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:25:03.469554       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PodDisruptionBudget: failed to list *v1.PodDisruptionBudget: Get "https://192.168.39.16:8443/apis/policy/v1/poddisruptionbudgets?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:25:03.474242       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicationController: Get "https://192.168.39.16:8443/api/v1/replicationcontrollers?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:25:03.474348       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicationController: failed to list *v1.ReplicationController: Get "https://192.168.39.16:8443/api/v1/replicationcontrollers?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:25:03.575486       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSINode: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:25:03.575608       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSINode: failed to list *v1.CSINode: Get "https://192.168.39.16:8443/apis/storage.k8s.io/v1/csinodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:25:03.691679       1 reflector.go:547] runtime/asm_amd64.s:1695: failed to list *v1.ConfigMap: Get "https://192.168.39.16:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:25:03.691809       1 reflector.go:150] runtime/asm_amd64.s:1695: Failed to watch *v1.ConfigMap: failed to list *v1.ConfigMap: Get "https://192.168.39.16:8443/api/v1/namespaces/kube-system/configmaps?fieldSelector=metadata.name%!D(MISSING)extension-apiserver-authentication&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:25:05.461372       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: Get "https://192.168.39.16:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:25:05.461485       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: Get "https://192.168.39.16:8443/api/v1/nodes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:25:05.563752       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.PersistentVolume: Get "https://192.168.39.16:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:25:05.563793       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.PersistentVolume: failed to list *v1.PersistentVolume: Get "https://192.168.39.16:8443/api/v1/persistentvolumes?limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:25:05.636901       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Pod: Get "https://192.168.39.16:8443/api/v1/pods?fieldSelector=status.phase%3DSucceeded%!C(MISSING)status.phase%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	E0701 12:25:05.637119       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Pod: failed to list *v1.Pod: Get "https://192.168.39.16:8443/api/v1/pods?fieldSelector=status.phase%3DSucceeded%!C(MISSING)status.phase%3DFailed&limit=500&resourceVersion=0": dial tcp 192.168.39.16:8443: connect: connection refused

	W0701 12:25:11.653758       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	E0701 12:25:11.654470       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User "system:kube-scheduler" cannot list resource "services" in API group "" at the cluster scope

	W0701 12:25:11.654763       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	E0701 12:25:11.655634       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.ReplicaSet: failed to list *v1.ReplicaSet: replicasets.apps is forbidden: User "system:kube-scheduler" cannot list resource "replicasets" in API group "apps" at the cluster scope

	W0701 12:25:11.655894       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	E0701 12:25:11.655933       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Namespace: failed to list *v1.Namespace: namespaces is forbidden: User "system:kube-scheduler" cannot list resource "namespaces" in API group "" at the cluster scope

	W0701 12:25:11.659133       1 reflector.go:547] k8s.io/client-go/informers/factory.go:160: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	E0701 12:25:11.659348       1 reflector.go:150] k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.StorageClass: failed to list *v1.StorageClass: storageclasses.storage.k8s.io is forbidden: User "system:kube-scheduler" cannot list resource "storageclasses" in API group "storage.k8s.io" at the cluster scope

	I0701 12:25:13.850760       1 shared_informer.go:320] Caches are synced for client-ca::kube-system::extension-apiserver-authentication::client-ca-file

	==> kubelet <==

	Jul 01 12:25:13 ha-735960 kubelet[1550]: I0701 12:25:13.105581    1550 kuberuntime_manager.go:1523] "Updating runtime config through cri with podcidr" CIDR="10.244.0.0/24"

	Jul 01 12:25:13 ha-735960 kubelet[1550]: I0701 12:25:13.106791    1550 kubelet_network.go:61] "Updating Pod CIDR" originalPodCIDR="" newPodCIDR="10.244.0.0/24"

	Jul 01 12:25:23 ha-735960 kubelet[1550]: I0701 12:25:23.225133    1550 scope.go:117] "RemoveContainer" containerID="769b0b8751350714b3d616a4cb2d06e20a1b7a96e8ac3e8f21b0d653f581e5f0"

	Jul 01 12:25:23 ha-735960 kubelet[1550]: I0701 12:25:23.225251    1550 scope.go:117] "RemoveContainer" containerID="a9c30cd4b3455401ac572f5a7fb2b84cb27956207b4804f80b909a2ccb4c394f"

	Jul 01 12:25:23 ha-735960 kubelet[1550]: I0701 12:25:23.226499    1550 scope.go:117] "RemoveContainer" containerID="6116abe6039dc6c324dce464fa4d85597bcc3455523d4a06be4293c343a9f8f9"

	Jul 01 12:25:24 ha-735960 kubelet[1550]: I0701 12:25:24.225255    1550 scope.go:117] "RemoveContainer" containerID="1ef6d9da6a9c5d6e77ef8d42735bdba288502d231394d299243bc1b669822d1c"

	Jul 01 12:25:25 ha-735960 kubelet[1550]: I0701 12:25:25.225212    1550 scope.go:117] "RemoveContainer" containerID="f472aef5302fd01233da1bd769162654c0b238cb1a3b0c9b24deef221c4821a3"

	Jul 01 12:25:26 ha-735960 kubelet[1550]: I0701 12:25:26.229286    1550 scope.go:117] "RemoveContainer" containerID="97d58c94f3fdcc84b84c3c46e6b25f8e7da118d5c9cd53058ae127fe580a40a7"

	Jul 01 12:25:26 ha-735960 kubelet[1550]: E0701 12:25:26.319340    1550 iptables.go:577] "Could not set up iptables canary" err=<

	Jul 01 12:25:26 ha-735960 kubelet[1550]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Jul 01 12:25:26 ha-735960 kubelet[1550]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Jul 01 12:25:26 ha-735960 kubelet[1550]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Jul 01 12:25:26 ha-735960 kubelet[1550]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Jul 01 12:25:26 ha-735960 kubelet[1550]: I0701 12:25:26.443283    1550 scope.go:117] "RemoveContainer" containerID="14112a4d8f2cb5cfea8813c52de120eeef6fe681ebf589fd8708d1557c35b85f"

	Jul 01 12:25:26 ha-735960 kubelet[1550]: I0701 12:25:26.480472    1550 scope.go:117] "RemoveContainer" containerID="97d58c94f3fdcc84b84c3c46e6b25f8e7da118d5c9cd53058ae127fe580a40a7"

	Jul 01 12:26:26 ha-735960 kubelet[1550]: E0701 12:26:26.244909    1550 iptables.go:577] "Could not set up iptables canary" err=<

	Jul 01 12:26:26 ha-735960 kubelet[1550]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Jul 01 12:26:26 ha-735960 kubelet[1550]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Jul 01 12:26:26 ha-735960 kubelet[1550]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Jul 01 12:26:26 ha-735960 kubelet[1550]:  > table="nat" chain="KUBE-KUBELET-CANARY"

	Jul 01 12:27:26 ha-735960 kubelet[1550]: E0701 12:27:26.245316    1550 iptables.go:577] "Could not set up iptables canary" err=<

	Jul 01 12:27:26 ha-735960 kubelet[1550]:         error creating chain "KUBE-KUBELET-CANARY": exit status 3: Ignoring deprecated --wait-interval option.

	Jul 01 12:27:26 ha-735960 kubelet[1550]:         ip6tables v1.8.9 (legacy): can't initialize ip6tables table `nat': Table does not exist (do you need to insmod?)

	Jul 01 12:27:26 ha-735960 kubelet[1550]:         Perhaps ip6tables or your kernel needs to be upgraded.

	Jul 01 12:27:26 ha-735960 kubelet[1550]:  > table="nat" chain="KUBE-KUBELET-CANARY"

-- /stdout --

helpers_test.go:254: (dbg) Run:  out/minikube-linux-amd64 status --format={{.APIServer}} -p ha-735960 -n ha-735960

helpers_test.go:261: (dbg) Run:  kubectl --context ha-735960 get po -o=jsonpath={.items[*].metadata.name} -A --field-selector=status.phase!=Running

helpers_test.go:285: <<< TestMultiControlPlane/serial/RestartCluster FAILED: end of post-mortem logs <<<

helpers_test.go:286: ---------------------/post-mortem---------------------------------

--- FAIL: TestMultiControlPlane/serial/RestartCluster (217.51s)