Test Report: Hyperkit_macOS 18350

                    
                      b07500d1f25ef3b9b4cf5a8c10c74b3642cd60ca:2024-03-11:33512
                    
                

Test fail (155/280)

Order failed test Duration
31 TestOffline 12.64
54 TestCertOptions 14
55 TestCertExpiration 200.16
56 TestDockerFlags 14.49
57 TestForceSystemdFlag 11.92
58 TestForceSystemdEnv 17.27
64 TestErrorSpam/setup 11.13
73 TestFunctional/serial/StartWithProxy 11.62
75 TestFunctional/serial/SoftStart 5.86
76 TestFunctional/serial/KubeContext 0.11
77 TestFunctional/serial/KubectlGetPods 0.11
84 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.14
85 TestFunctional/serial/CacheCmd/cache/cache_reload 0.52
87 TestFunctional/serial/MinikubeKubectlCmd 0.57
88 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.78
89 TestFunctional/serial/ExtraConfig 5.84
90 TestFunctional/serial/ComponentHealth 0.11
91 TestFunctional/serial/LogsCmd 0.35
92 TestFunctional/serial/LogsFileCmd 0.37
93 TestFunctional/serial/InvalidService 0.04
96 TestFunctional/parallel/DashboardCmd 0.33
99 TestFunctional/parallel/StatusCmd 0.3
103 TestFunctional/parallel/ServiceCmdConnect 0.23
105 TestFunctional/parallel/PersistentVolumeClaim 0.08
107 TestFunctional/parallel/SSHCmd 0.39
108 TestFunctional/parallel/CpCmd 0.96
109 TestFunctional/parallel/MySQL 0.15
110 TestFunctional/parallel/FileSync 0.26
111 TestFunctional/parallel/CertSync 1.23
115 TestFunctional/parallel/NodeLabels 0.14
117 TestFunctional/parallel/NonActiveRuntimeDisabled 0.16
121 TestFunctional/parallel/Version/components 0.14
122 TestFunctional/parallel/ImageCommands/ImageListShort 0.1
123 TestFunctional/parallel/ImageCommands/ImageListTable 0.1
124 TestFunctional/parallel/ImageCommands/ImageListJson 0.1
125 TestFunctional/parallel/ImageCommands/ImageListYaml 0.12
126 TestFunctional/parallel/ImageCommands/ImageBuild 0.34
128 TestFunctional/parallel/DockerEnv/bash 0.18
129 TestFunctional/parallel/UpdateContextCmd/no_changes 0.14
130 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.14
131 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.14
132 TestFunctional/parallel/ServiceCmd/DeployApp 0.05
133 TestFunctional/parallel/ServiceCmd/List 0.2
134 TestFunctional/parallel/ServiceCmd/JSONOutput 0.19
135 TestFunctional/parallel/ServiceCmd/HTTPS 0.16
136 TestFunctional/parallel/ServiceCmd/Format 0.16
137 TestFunctional/parallel/ServiceCmd/URL 0.2
139 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.34
142 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 0
143 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 95.81
144 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 1.99
145 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 1.92
146 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 6.99
147 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.1
149 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.2
157 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig 15.04
159 TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS 34.97
167 TestMutliControlPlane/serial/StartCluster 11.18
168 TestMutliControlPlane/serial/DeployApp 117.3
169 TestMutliControlPlane/serial/PingHostFromPods 0.17
170 TestMutliControlPlane/serial/AddWorkerNode 0.22
171 TestMutliControlPlane/serial/NodeLabels 0.11
172 TestMutliControlPlane/serial/HAppyAfterClusterStart 0.22
173 TestMutliControlPlane/serial/CopyFile 0.15
174 TestMutliControlPlane/serial/StopSecondaryNode 0.31
175 TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop 0.22
176 TestMutliControlPlane/serial/RestartSecondaryNode 51.87
177 TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart 0.22
178 TestMutliControlPlane/serial/RestartClusterKeepsNodes 9.24
179 TestMutliControlPlane/serial/DeleteSecondaryNode 0.32
180 TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete 0.22
181 TestMutliControlPlane/serial/StopCluster 3.45
182 TestMutliControlPlane/serial/RestartCluster 5.91
183 TestMutliControlPlane/serial/DegradedAfterClusterRestart 0.22
184 TestMutliControlPlane/serial/AddSecondaryNode 0.21
185 TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd 0.22
188 TestImageBuild/serial/Setup 11.15
191 TestJSONOutput/start/Command 11.47
194 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
195 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
197 TestJSONOutput/pause/Command 0.15
203 TestJSONOutput/unpause/Command 0.16
220 TestMinikubeProfile 12.35
223 TestMountStart/serial/StartWithMountFirst 11.7
226 TestMultiNode/serial/FreshStart2Nodes 11.56
227 TestMultiNode/serial/DeployApp2Nodes 110.9
228 TestMultiNode/serial/PingHostFrom2Pods 0.18
229 TestMultiNode/serial/AddNode 0.22
230 TestMultiNode/serial/MultiNodeLabels 0.11
231 TestMultiNode/serial/ProfileList 0.22
232 TestMultiNode/serial/CopyFile 0.15
233 TestMultiNode/serial/StopNode 0.39
234 TestMultiNode/serial/StartAfterStop 56.7
235 TestMultiNode/serial/RestartKeepsNodes 9.08
236 TestMultiNode/serial/DeleteNode 0.31
237 TestMultiNode/serial/StopMultiNode 3.61
238 TestMultiNode/serial/RestartMultiNode 5.83
239 TestMultiNode/serial/ValidateNameConflict 22.97
243 TestPreload 11.54
245 TestScheduledStopUnix 11.45
246 TestSkaffold 17.87
249 TestRunningBinaryUpgrade 63.01
251 TestKubernetesUpgrade 21.13
267 TestStoppedBinaryUpgrade/Upgrade 25.5
268 TestStoppedBinaryUpgrade/MinikubeLogs 0.33
270 TestPause/serial/Start 11.3
280 TestNoKubernetes/serial/StartWithK8s 11.33
281 TestNoKubernetes/serial/StartWithStopK8s 6.23
282 TestNoKubernetes/serial/Start 6.23
286 TestNoKubernetes/serial/StartNoArgs 6.69
288 TestNetworkPlugins/group/auto/Start 11.34
289 TestNetworkPlugins/group/calico/Start 11.67
290 TestNetworkPlugins/group/custom-flannel/Start 11.53
291 TestNetworkPlugins/group/false/Start 11.75
292 TestNetworkPlugins/group/kindnet/Start 11.41
293 TestNetworkPlugins/group/flannel/Start 11.68
294 TestNetworkPlugins/group/enable-default-cni/Start 11.69
295 TestNetworkPlugins/group/bridge/Start 11.55
296 TestNetworkPlugins/group/kubenet/Start 11.69
298 TestStartStop/group/old-k8s-version/serial/FirstStart 11.93
300 TestStartStop/group/no-preload/serial/FirstStart 11.49
301 TestStartStop/group/old-k8s-version/serial/DeployApp 0.19
302 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 0.33
305 TestStartStop/group/old-k8s-version/serial/SecondStart 6.25
306 TestStartStop/group/no-preload/serial/DeployApp 0.19
307 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 0.32
310 TestStartStop/group/no-preload/serial/SecondStart 5.99
311 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 0.08
312 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 0.11
313 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.18
314 TestStartStop/group/old-k8s-version/serial/Pause 0.29
316 TestStartStop/group/embed-certs/serial/FirstStart 12.02
317 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 0.07
318 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 0.14
319 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.18
320 TestStartStop/group/no-preload/serial/Pause 0.29
322 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 11.45
323 TestStartStop/group/embed-certs/serial/DeployApp 0.19
324 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 0.32
327 TestStartStop/group/embed-certs/serial/SecondStart 6.01
328 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 0.2
329 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 0.32
332 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 5.98
333 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 0.08
334 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 0.11
335 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.18
336 TestStartStop/group/embed-certs/serial/Pause 0.29
338 TestStartStop/group/newest-cni/serial/FirstStart 11.42
339 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 0.07
340 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 0.11
341 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.18
342 TestStartStop/group/default-k8s-diff-port/serial/Pause 0.29
347 TestStartStop/group/newest-cni/serial/SecondStart 5.83
350 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.18
351 TestStartStop/group/newest-cni/serial/Pause 0.29
x
+
TestOffline (12.64s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-amd64 start -p offline-docker-295000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit 
aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p offline-docker-295000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit : exit status 60 (12.295312842s)

                                                
                                                
-- stdout --
	* [offline-docker-295000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "offline-docker-295000" primary control-plane node in "offline-docker-295000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "offline-docker-295000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:05:26.848861   38775 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:05:26.849476   38775 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:05:26.849484   38775 out.go:304] Setting ErrFile to fd 2...
	I0311 04:05:26.849490   38775 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:05:26.850049   38775 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:05:26.851589   38775 out.go:298] Setting JSON to false
	I0311 04:05:26.875525   38775 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11096,"bootTime":1710144030,"procs":465,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:05:26.875623   38775 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:05:26.882279   38775 out.go:177] * [offline-docker-295000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:05:26.924666   38775 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:05:26.924720   38775 notify.go:220] Checking for updates...
	I0311 04:05:26.967550   38775 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:05:26.988653   38775 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:05:27.009494   38775 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:05:27.030650   38775 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:05:27.051620   38775 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:05:27.072946   38775 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:05:27.073046   38775 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:05:27.101635   38775 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:05:27.143413   38775 start.go:297] selected driver: hyperkit
	I0311 04:05:27.143430   38775 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:05:27.143445   38775 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:05:27.146307   38775 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:05:27.146414   38775 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:05:27.154318   38775 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:05:27.158251   38775 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:05:27.158274   38775 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0311 04:05:27.158306   38775 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:05:27.158519   38775 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:05:27.158591   38775 cni.go:84] Creating CNI manager for ""
	I0311 04:05:27.158605   38775 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:05:27.158611   38775 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0311 04:05:27.158694   38775 start.go:340] cluster config:
	{Name:offline-docker-295000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-295000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loca
l ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:05:27.158778   38775 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:05:27.179643   38775 out.go:177] * Starting "offline-docker-295000" primary control-plane node in "offline-docker-295000" cluster
	I0311 04:05:27.200644   38775 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:05:27.200688   38775 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:05:27.200706   38775 cache.go:56] Caching tarball of preloaded images
	I0311 04:05:27.200825   38775 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:05:27.200834   38775 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:05:27.200933   38775 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/offline-docker-295000/config.json ...
	I0311 04:05:27.200951   38775 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/offline-docker-295000/config.json: {Name:mk66679272a7700fdaa23e57f5d6a50663a3b5aa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:05:27.201283   38775 start.go:360] acquireMachinesLock for offline-docker-295000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:05:27.201337   38775 start.go:364] duration metric: took 39.254µs to acquireMachinesLock for "offline-docker-295000"
	I0311 04:05:27.201362   38775 start.go:93] Provisioning new machine with config: &{Name:offline-docker-295000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-295000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:05:27.201412   38775 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:05:27.222439   38775 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0311 04:05:27.222572   38775 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:05:27.222609   38775 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:05:27.230256   38775 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62799
	I0311 04:05:27.230641   38775 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:05:27.231074   38775 main.go:141] libmachine: Using API Version  1
	I0311 04:05:27.231083   38775 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:05:27.231276   38775 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:05:27.231382   38775 main.go:141] libmachine: (offline-docker-295000) Calling .GetMachineName
	I0311 04:05:27.231472   38775 main.go:141] libmachine: (offline-docker-295000) Calling .DriverName
	I0311 04:05:27.231575   38775 start.go:159] libmachine.API.Create for "offline-docker-295000" (driver="hyperkit")
	I0311 04:05:27.231597   38775 client.go:168] LocalClient.Create starting
	I0311 04:05:27.231635   38775 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:05:27.231684   38775 main.go:141] libmachine: Decoding PEM data...
	I0311 04:05:27.231698   38775 main.go:141] libmachine: Parsing certificate...
	I0311 04:05:27.231774   38775 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:05:27.231810   38775 main.go:141] libmachine: Decoding PEM data...
	I0311 04:05:27.231821   38775 main.go:141] libmachine: Parsing certificate...
	I0311 04:05:27.231840   38775 main.go:141] libmachine: Running pre-create checks...
	I0311 04:05:27.231849   38775 main.go:141] libmachine: (offline-docker-295000) Calling .PreCreateCheck
	I0311 04:05:27.231969   38775 main.go:141] libmachine: (offline-docker-295000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:05:27.232154   38775 main.go:141] libmachine: (offline-docker-295000) Calling .GetConfigRaw
	I0311 04:05:27.244236   38775 main.go:141] libmachine: Creating machine...
	I0311 04:05:27.244259   38775 main.go:141] libmachine: (offline-docker-295000) Calling .Create
	I0311 04:05:27.244512   38775 main.go:141] libmachine: (offline-docker-295000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:05:27.244770   38775 main.go:141] libmachine: (offline-docker-295000) DBG | I0311 04:05:27.244474   38795 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:05:27.244989   38775 main.go:141] libmachine: (offline-docker-295000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:05:27.761914   38775 main.go:141] libmachine: (offline-docker-295000) DBG | I0311 04:05:27.761860   38795 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/offline-docker-295000/id_rsa...
	I0311 04:05:27.946737   38775 main.go:141] libmachine: (offline-docker-295000) DBG | I0311 04:05:27.946609   38795 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/offline-docker-295000/offline-docker-295000.rawdisk...
	I0311 04:05:27.946764   38775 main.go:141] libmachine: (offline-docker-295000) DBG | Writing magic tar header
	I0311 04:05:27.946787   38775 main.go:141] libmachine: (offline-docker-295000) DBG | Writing SSH key tar header
	I0311 04:05:27.968732   38775 main.go:141] libmachine: (offline-docker-295000) DBG | I0311 04:05:27.968627   38795 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/offline-docker-295000 ...
	I0311 04:05:28.352806   38775 main.go:141] libmachine: (offline-docker-295000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:05:28.352826   38775 main.go:141] libmachine: (offline-docker-295000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/offline-docker-295000/hyperkit.pid
	I0311 04:05:28.352856   38775 main.go:141] libmachine: (offline-docker-295000) DBG | Using UUID 7b3ab8ea-5efb-4345-a09a-a9d018ceed44
	I0311 04:05:28.518162   38775 main.go:141] libmachine: (offline-docker-295000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:05:28.518260   38775 client.go:171] duration metric: took 1.28663312s to LocalClient.Create
	I0311 04:05:30.518585   38775 start.go:128] duration metric: took 3.317106587s to createHost
	I0311 04:05:30.518615   38775 start.go:83] releasing machines lock for "offline-docker-295000", held for 3.317222003s
	W0311 04:05:30.518652   38775 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:05:30.519212   38775 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:05:30.519255   38775 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:05:30.528348   38775 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62801
	I0311 04:05:30.528696   38775 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:05:30.529037   38775 main.go:141] libmachine: Using API Version  1
	I0311 04:05:30.529057   38775 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:05:30.529288   38775 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:05:30.529645   38775 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:05:30.529669   38775 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:05:30.537426   38775 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62803
	I0311 04:05:30.537760   38775 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:05:30.538091   38775 main.go:141] libmachine: Using API Version  1
	I0311 04:05:30.538107   38775 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:05:30.538308   38775 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:05:30.538400   38775 main.go:141] libmachine: (offline-docker-295000) Calling .GetState
	I0311 04:05:30.538475   38775 main.go:141] libmachine: (offline-docker-295000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:05:30.538501   38775 main.go:141] libmachine: (offline-docker-295000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/offline-docker-295000/hyperkit.json: no such file or directory
	I0311 04:05:30.538508   38775 main.go:141] libmachine: (offline-docker-295000) DBG | hyperkit pid from json: 0
	I0311 04:05:30.538547   38775 main.go:141] libmachine: (offline-docker-295000) Calling .DriverName
	I0311 04:05:30.589335   38775 out.go:177] * Deleting "offline-docker-295000" in hyperkit ...
	I0311 04:05:30.610357   38775 main.go:141] libmachine: (offline-docker-295000) Calling .Remove
	I0311 04:05:30.610518   38775 main.go:141] libmachine: (offline-docker-295000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:05:30.610528   38775 main.go:141] libmachine: (offline-docker-295000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:05:30.610540   38775 main.go:141] libmachine: (offline-docker-295000) DBG | hyperkit pid from json: 0
	I0311 04:05:30.610576   38775 main.go:141] libmachine: (offline-docker-295000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/offline-docker-295000/hyperkit.json: no such file or directory
	W0311 04:05:30.704075   38775 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:05:30.704098   38775 start.go:728] Will try again in 5 seconds ...
	I0311 04:05:35.704704   38775 start.go:360] acquireMachinesLock for offline-docker-295000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:05:35.704882   38775 start.go:364] duration metric: took 138.151µs to acquireMachinesLock for "offline-docker-295000"
	I0311 04:05:35.704915   38775 start.go:93] Provisioning new machine with config: &{Name:offline-docker-295000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-295000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:05:35.705050   38775 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:05:35.764442   38775 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0311 04:05:35.764622   38775 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:05:35.764678   38775 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:05:35.775462   38775 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62806
	I0311 04:05:35.775872   38775 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:05:35.776211   38775 main.go:141] libmachine: Using API Version  1
	I0311 04:05:35.776228   38775 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:05:35.776429   38775 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:05:35.776530   38775 main.go:141] libmachine: (offline-docker-295000) Calling .GetMachineName
	I0311 04:05:35.776626   38775 main.go:141] libmachine: (offline-docker-295000) Calling .DriverName
	I0311 04:05:35.776755   38775 start.go:159] libmachine.API.Create for "offline-docker-295000" (driver="hyperkit")
	I0311 04:05:35.776794   38775 client.go:168] LocalClient.Create starting
	I0311 04:05:35.776826   38775 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:05:35.776879   38775 main.go:141] libmachine: Decoding PEM data...
	I0311 04:05:35.776893   38775 main.go:141] libmachine: Parsing certificate...
	I0311 04:05:35.776933   38775 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:05:35.776971   38775 main.go:141] libmachine: Decoding PEM data...
	I0311 04:05:35.776988   38775 main.go:141] libmachine: Parsing certificate...
	I0311 04:05:35.777005   38775 main.go:141] libmachine: Running pre-create checks...
	I0311 04:05:35.777010   38775 main.go:141] libmachine: (offline-docker-295000) Calling .PreCreateCheck
	I0311 04:05:35.777088   38775 main.go:141] libmachine: (offline-docker-295000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:05:35.777134   38775 main.go:141] libmachine: (offline-docker-295000) Calling .GetConfigRaw
	I0311 04:05:35.777607   38775 main.go:141] libmachine: Creating machine...
	I0311 04:05:35.777616   38775 main.go:141] libmachine: (offline-docker-295000) Calling .Create
	I0311 04:05:35.777681   38775 main.go:141] libmachine: (offline-docker-295000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:05:35.777802   38775 main.go:141] libmachine: (offline-docker-295000) DBG | I0311 04:05:35.777675   38905 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:05:35.777896   38775 main.go:141] libmachine: (offline-docker-295000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:05:36.275495   38775 main.go:141] libmachine: (offline-docker-295000) DBG | I0311 04:05:36.275413   38905 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/offline-docker-295000/id_rsa...
	I0311 04:05:36.364811   38775 main.go:141] libmachine: (offline-docker-295000) DBG | I0311 04:05:36.364700   38905 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/offline-docker-295000/offline-docker-295000.rawdisk...
	I0311 04:05:36.364833   38775 main.go:141] libmachine: (offline-docker-295000) DBG | Writing magic tar header
	I0311 04:05:36.364859   38775 main.go:141] libmachine: (offline-docker-295000) DBG | Writing SSH key tar header
	I0311 04:05:36.365444   38775 main.go:141] libmachine: (offline-docker-295000) DBG | I0311 04:05:36.365376   38905 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/offline-docker-295000 ...
	I0311 04:05:36.846048   38775 main.go:141] libmachine: (offline-docker-295000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:05:36.846066   38775 main.go:141] libmachine: (offline-docker-295000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/offline-docker-295000/hyperkit.pid
	I0311 04:05:36.846105   38775 main.go:141] libmachine: (offline-docker-295000) DBG | Using UUID 2b253e41-aaac-403f-a389-87bc347c085b
	I0311 04:05:36.923643   38775 main.go:141] libmachine: (offline-docker-295000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:05:36.923739   38775 client.go:171] duration metric: took 1.146920347s to LocalClient.Create
	I0311 04:05:38.924953   38775 start.go:128] duration metric: took 3.21982939s to createHost
	I0311 04:05:38.924973   38775 start.go:83] releasing machines lock for "offline-docker-295000", held for 3.220031294s
	W0311 04:05:38.925078   38775 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p offline-docker-295000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p offline-docker-295000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:05:38.968995   38775 out.go:177] 
	W0311 04:05:38.990782   38775 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:05:38.990848   38775 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:05:38.990866   38775 out.go:239] * Related issues:
	* Related issues:
	W0311 04:05:38.990906   38775 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:05:38.990939   38775 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:05:39.019088   38775 out.go:177] 

                                                
                                                
** /stderr **
aab_offline_test.go:58: out/minikube-darwin-amd64 start -p offline-docker-295000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit  failed: exit status 60
panic.go:626: *** TestOffline FAILED at 2024-03-11 04:05:39.083829 -0700 PDT m=+1165.355440713
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p offline-docker-295000 -n offline-docker-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p offline-docker-295000 -n offline-docker-295000: exit status 7 (73.553431ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "offline-docker-295000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "offline-docker-295000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p offline-docker-295000
--- FAIL: TestOffline (12.64s)

                                                
                                    
x
+
TestCertOptions (14s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-options-573000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit 
cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-options-573000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit : exit status 60 (13.338041787s)

                                                
                                                
-- stdout --
	* [cert-options-573000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "cert-options-573000" primary control-plane node in "cert-options-573000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "cert-options-573000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-options-573000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-amd64 start -p cert-options-573000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit " : exit status 60
cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-amd64 -p cert-options-573000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p cert-options-573000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 83 (141.117736ms)

                                                
                                                
-- stdout --
	* The control-plane node cert-options-573000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-573000"

                                                
                                                
-- /stdout --
cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-amd64 -p cert-options-573000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 83
cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.
cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.
cert_options_test.go:69: apiserver cert does not include localhost in SAN.
cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-573000 config view
cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 
'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"
cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-amd64 ssh -p cert-options-573000 -- "sudo cat /etc/kubernetes/admin.conf"
cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p cert-options-573000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 83 (139.662868ms)

                                                
                                                
-- stdout --
	* The control-plane node cert-options-573000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-573000"

                                                
                                                
-- /stdout --
cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-amd64 ssh -p cert-options-573000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 83
cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 
-- stdout --
	* The control-plane node cert-options-573000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-573000"

                                                
                                                
-- /stdout --
cert_options_test.go:109: *** TestCertOptions FAILED at 2024-03-11 04:06:27.191034 -0700 PDT m=+1213.461933614
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p cert-options-573000 -n cert-options-573000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p cert-options-573000 -n cert-options-573000: exit status 7 (75.528803ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-options-573000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-options-573000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-options-573000
--- FAIL: TestCertOptions (14.00s)

                                                
                                    
x
+
TestCertExpiration (200.16s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-991000 --memory=2048 --cert-expiration=3m --driver=hyperkit 
E0311 04:06:11.163887   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-expiration-991000 --memory=2048 --cert-expiration=3m --driver=hyperkit : exit status 60 (13.859943763s)

                                                
                                                
-- stdout --
	* [cert-expiration-991000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "cert-expiration-991000" primary control-plane node in "cert-expiration-991000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "cert-expiration-991000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-991000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-amd64 start -p cert-expiration-991000 --memory=2048 --cert-expiration=3m --driver=hyperkit " : exit status 60
cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-991000 --memory=2048 --cert-expiration=8760h --driver=hyperkit 
cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-expiration-991000 --memory=2048 --cert-expiration=8760h --driver=hyperkit : exit status 60 (5.860759004s)

                                                
                                                
-- stdout --
	* [cert-expiration-991000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "cert-expiration-991000" primary control-plane node in "cert-expiration-991000" cluster
	* Restarting existing hyperkit VM for "cert-expiration-991000" ...
	* Restarting existing hyperkit VM for "cert-expiration-991000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-991000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-amd64 start -p cert-expiration-991000 --memory=2048 --cert-expiration=8760h --driver=hyperkit " : exit status 60
cert_options_test.go:136: minikube start output did not warn about expired certs: 
-- stdout --
	* [cert-expiration-991000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "cert-expiration-991000" primary control-plane node in "cert-expiration-991000" cluster
	* Restarting existing hyperkit VM for "cert-expiration-991000" ...
	* Restarting existing hyperkit VM for "cert-expiration-991000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-991000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:138: *** TestCertExpiration FAILED at 2024-03-11 04:09:22.041563 -0700 PDT m=+1388.309875283
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p cert-expiration-991000 -n cert-expiration-991000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p cert-expiration-991000 -n cert-expiration-991000: exit status 7 (75.899056ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-expiration-991000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-expiration-991000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-expiration-991000
--- FAIL: TestCertExpiration (200.16s)

                                                
                                    
x
+
TestDockerFlags (14.49s)

                                                
                                                
=== RUN   TestDockerFlags
=== PAUSE TestDockerFlags

                                                
                                                

                                                
                                                
=== CONT  TestDockerFlags
docker_test.go:51: (dbg) Run:  out/minikube-darwin-amd64 start -p docker-flags-821000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p docker-flags-821000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (13.784517424s)

                                                
                                                
-- stdout --
	* [docker-flags-821000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "docker-flags-821000" primary control-plane node in "docker-flags-821000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "docker-flags-821000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:05:59.105408   38998 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:05:59.105675   38998 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:05:59.105681   38998 out.go:304] Setting ErrFile to fd 2...
	I0311 04:05:59.105685   38998 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:05:59.105868   38998 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:05:59.108315   38998 out.go:298] Setting JSON to false
	I0311 04:05:59.132398   38998 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11129,"bootTime":1710144030,"procs":470,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:05:59.132497   38998 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:05:59.156749   38998 out.go:177] * [docker-flags-821000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:05:59.220023   38998 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:05:59.198267   38998 notify.go:220] Checking for updates...
	I0311 04:05:59.262079   38998 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:05:59.283014   38998 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:05:59.304145   38998 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:05:59.325182   38998 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:05:59.369380   38998 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:05:59.386853   38998 config.go:182] Loaded profile config "force-systemd-flag-759000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:05:59.387095   38998 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:05:59.387265   38998 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:05:59.429552   38998 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:05:59.438948   38998 start.go:297] selected driver: hyperkit
	I0311 04:05:59.438979   38998 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:05:59.439000   38998 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:05:59.443471   38998 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:05:59.443585   38998 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:05:59.451932   38998 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:05:59.456231   38998 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:05:59.456269   38998 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:05:59.456308   38998 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:05:59.456527   38998 start_flags.go:942] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]
	I0311 04:05:59.456595   38998 cni.go:84] Creating CNI manager for ""
	I0311 04:05:59.456611   38998 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:05:59.456618   38998 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0311 04:05:59.456690   38998 start.go:340] cluster config:
	{Name:docker-flags-821000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-821000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:
[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientP
ath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:05:59.456775   38998 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:05:59.486727   38998 out.go:177] * Starting "docker-flags-821000" primary control-plane node in "docker-flags-821000" cluster
	I0311 04:05:59.495690   38998 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:05:59.495771   38998 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:05:59.495800   38998 cache.go:56] Caching tarball of preloaded images
	I0311 04:05:59.496019   38998 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:05:59.496042   38998 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:05:59.496200   38998 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/docker-flags-821000/config.json ...
	I0311 04:05:59.496242   38998 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/docker-flags-821000/config.json: {Name:mk4117ad08e5aacd40d21a73d31c7a8c72e9f377 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:05:59.496892   38998 start.go:360] acquireMachinesLock for docker-flags-821000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:06:01.548279   38998 start.go:364] duration metric: took 2.051321464s to acquireMachinesLock for "docker-flags-821000"
	I0311 04:06:01.548357   38998 start.go:93] Provisioning new machine with config: &{Name:docker-flags-821000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSH
Key: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-821000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountI
P: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:06:01.548452   38998 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:06:01.613041   38998 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0311 04:06:01.613362   38998 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:06:01.613440   38998 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:06:01.622810   38998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62884
	I0311 04:06:01.623174   38998 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:06:01.623590   38998 main.go:141] libmachine: Using API Version  1
	I0311 04:06:01.623601   38998 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:06:01.623859   38998 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:06:01.623951   38998 main.go:141] libmachine: (docker-flags-821000) Calling .GetMachineName
	I0311 04:06:01.624035   38998 main.go:141] libmachine: (docker-flags-821000) Calling .DriverName
	I0311 04:06:01.624138   38998 start.go:159] libmachine.API.Create for "docker-flags-821000" (driver="hyperkit")
	I0311 04:06:01.624160   38998 client.go:168] LocalClient.Create starting
	I0311 04:06:01.624195   38998 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:06:01.624243   38998 main.go:141] libmachine: Decoding PEM data...
	I0311 04:06:01.624258   38998 main.go:141] libmachine: Parsing certificate...
	I0311 04:06:01.624320   38998 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:06:01.624356   38998 main.go:141] libmachine: Decoding PEM data...
	I0311 04:06:01.624367   38998 main.go:141] libmachine: Parsing certificate...
	I0311 04:06:01.624387   38998 main.go:141] libmachine: Running pre-create checks...
	I0311 04:06:01.624396   38998 main.go:141] libmachine: (docker-flags-821000) Calling .PreCreateCheck
	I0311 04:06:01.624473   38998 main.go:141] libmachine: (docker-flags-821000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:06:01.624636   38998 main.go:141] libmachine: (docker-flags-821000) Calling .GetConfigRaw
	I0311 04:06:01.698758   38998 main.go:141] libmachine: Creating machine...
	I0311 04:06:01.698830   38998 main.go:141] libmachine: (docker-flags-821000) Calling .Create
	I0311 04:06:01.699112   38998 main.go:141] libmachine: (docker-flags-821000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:06:01.699360   38998 main.go:141] libmachine: (docker-flags-821000) DBG | I0311 04:06:01.699082   39007 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:06:01.699455   38998 main.go:141] libmachine: (docker-flags-821000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:06:02.063568   38998 main.go:141] libmachine: (docker-flags-821000) DBG | I0311 04:06:02.063478   39007 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/docker-flags-821000/id_rsa...
	I0311 04:06:02.222272   38998 main.go:141] libmachine: (docker-flags-821000) DBG | I0311 04:06:02.222177   39007 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/docker-flags-821000/docker-flags-821000.rawdisk...
	I0311 04:06:02.222299   38998 main.go:141] libmachine: (docker-flags-821000) DBG | Writing magic tar header
	I0311 04:06:02.222322   38998 main.go:141] libmachine: (docker-flags-821000) DBG | Writing SSH key tar header
	I0311 04:06:02.223373   38998 main.go:141] libmachine: (docker-flags-821000) DBG | I0311 04:06:02.223296   39007 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/docker-flags-821000 ...
	I0311 04:06:02.817151   38998 main.go:141] libmachine: (docker-flags-821000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:06:02.817192   38998 main.go:141] libmachine: (docker-flags-821000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/docker-flags-821000/hyperkit.pid
	I0311 04:06:02.817224   38998 main.go:141] libmachine: (docker-flags-821000) DBG | Using UUID 2d31de37-f2c0-4c54-ba25-9550937b597f
	I0311 04:06:02.833391   38998 main.go:141] libmachine: (docker-flags-821000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:06:02.833485   38998 client.go:171] duration metric: took 1.209298644s to LocalClient.Create
	I0311 04:06:04.834926   38998 start.go:128] duration metric: took 3.286406889s to createHost
	I0311 04:06:04.834955   38998 start.go:83] releasing machines lock for "docker-flags-821000", held for 3.286592031s
	W0311 04:06:04.834977   38998 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:06:04.835441   38998 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:06:04.835476   38998 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:06:04.844253   38998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62896
	I0311 04:06:04.844765   38998 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:06:04.845133   38998 main.go:141] libmachine: Using API Version  1
	I0311 04:06:04.845143   38998 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:06:04.845374   38998 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:06:04.845720   38998 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:06:04.845747   38998 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:06:04.853891   38998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62898
	I0311 04:06:04.854281   38998 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:06:04.854660   38998 main.go:141] libmachine: Using API Version  1
	I0311 04:06:04.854670   38998 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:06:04.854858   38998 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:06:04.854961   38998 main.go:141] libmachine: (docker-flags-821000) Calling .GetState
	I0311 04:06:04.855043   38998 main.go:141] libmachine: (docker-flags-821000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:06:04.855060   38998 main.go:141] libmachine: (docker-flags-821000) DBG | hyperkit pid from json: 0
	I0311 04:06:04.855072   38998 main.go:141] libmachine: (docker-flags-821000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/docker-flags-821000/hyperkit.json: no such file or directory
	I0311 04:06:04.855119   38998 main.go:141] libmachine: (docker-flags-821000) Calling .DriverName
	I0311 04:06:04.937669   38998 out.go:177] * Deleting "docker-flags-821000" in hyperkit ...
	I0311 04:06:04.959417   38998 main.go:141] libmachine: (docker-flags-821000) Calling .Remove
	I0311 04:06:04.959724   38998 main.go:141] libmachine: (docker-flags-821000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:06:04.959760   38998 main.go:141] libmachine: (docker-flags-821000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:06:04.959796   38998 main.go:141] libmachine: (docker-flags-821000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/docker-flags-821000/hyperkit.json: no such file or directory
	I0311 04:06:04.959831   38998 main.go:141] libmachine: (docker-flags-821000) DBG | hyperkit pid from json: 0
	W0311 04:06:04.981925   38998 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:06:04.981942   38998 start.go:728] Will try again in 5 seconds ...
	I0311 04:06:09.982096   38998 start.go:360] acquireMachinesLock for docker-flags-821000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:06:09.982203   38998 start.go:364] duration metric: took 88.773µs to acquireMachinesLock for "docker-flags-821000"
	I0311 04:06:09.982226   38998 start.go:93] Provisioning new machine with config: &{Name:docker-flags-821000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSH
Key: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-821000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountI
P: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:06:09.982300   38998 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:06:10.031758   38998 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0311 04:06:10.031895   38998 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:06:10.031932   38998 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:06:10.041556   38998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62906
	I0311 04:06:10.041909   38998 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:06:10.042257   38998 main.go:141] libmachine: Using API Version  1
	I0311 04:06:10.042267   38998 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:06:10.042482   38998 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:06:10.042594   38998 main.go:141] libmachine: (docker-flags-821000) Calling .GetMachineName
	I0311 04:06:10.042688   38998 main.go:141] libmachine: (docker-flags-821000) Calling .DriverName
	I0311 04:06:10.042789   38998 start.go:159] libmachine.API.Create for "docker-flags-821000" (driver="hyperkit")
	I0311 04:06:10.042806   38998 client.go:168] LocalClient.Create starting
	I0311 04:06:10.042833   38998 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:06:10.042880   38998 main.go:141] libmachine: Decoding PEM data...
	I0311 04:06:10.042891   38998 main.go:141] libmachine: Parsing certificate...
	I0311 04:06:10.042933   38998 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:06:10.042968   38998 main.go:141] libmachine: Decoding PEM data...
	I0311 04:06:10.042981   38998 main.go:141] libmachine: Parsing certificate...
	I0311 04:06:10.042994   38998 main.go:141] libmachine: Running pre-create checks...
	I0311 04:06:10.042999   38998 main.go:141] libmachine: (docker-flags-821000) Calling .PreCreateCheck
	I0311 04:06:10.043073   38998 main.go:141] libmachine: (docker-flags-821000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:06:10.043107   38998 main.go:141] libmachine: (docker-flags-821000) Calling .GetConfigRaw
	I0311 04:06:10.043531   38998 main.go:141] libmachine: Creating machine...
	I0311 04:06:10.043539   38998 main.go:141] libmachine: (docker-flags-821000) Calling .Create
	I0311 04:06:10.043606   38998 main.go:141] libmachine: (docker-flags-821000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:06:10.043734   38998 main.go:141] libmachine: (docker-flags-821000) DBG | I0311 04:06:10.043601   39035 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:06:10.043784   38998 main.go:141] libmachine: (docker-flags-821000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:06:10.219249   38998 main.go:141] libmachine: (docker-flags-821000) DBG | I0311 04:06:10.219155   39035 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/docker-flags-821000/id_rsa...
	I0311 04:06:10.253318   38998 main.go:141] libmachine: (docker-flags-821000) DBG | I0311 04:06:10.253221   39035 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/docker-flags-821000/docker-flags-821000.rawdisk...
	I0311 04:06:10.253354   38998 main.go:141] libmachine: (docker-flags-821000) DBG | Writing magic tar header
	I0311 04:06:10.253407   38998 main.go:141] libmachine: (docker-flags-821000) DBG | Writing SSH key tar header
	I0311 04:06:10.253798   38998 main.go:141] libmachine: (docker-flags-821000) DBG | I0311 04:06:10.253757   39035 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/docker-flags-821000 ...
	I0311 04:06:10.614345   38998 main.go:141] libmachine: (docker-flags-821000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:06:10.614370   38998 main.go:141] libmachine: (docker-flags-821000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/docker-flags-821000/hyperkit.pid
	I0311 04:06:10.614402   38998 main.go:141] libmachine: (docker-flags-821000) DBG | Using UUID 8cee59f7-c713-4563-b32d-85b46a6e5ba5
	I0311 04:06:10.631622   38998 main.go:141] libmachine: (docker-flags-821000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:06:10.631706   38998 client.go:171] duration metric: took 588.884236ms to LocalClient.Create
	I0311 04:06:12.633875   38998 start.go:128] duration metric: took 2.651521927s to createHost
	I0311 04:06:12.633907   38998 start.go:83] releasing machines lock for "docker-flags-821000", held for 2.651642449s
	W0311 04:06:12.633980   38998 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p docker-flags-821000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p docker-flags-821000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:06:12.677593   38998 out.go:177] 
	W0311 04:06:12.699530   38998 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:06:12.699603   38998 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:06:12.699624   38998 out.go:239] * Related issues:
	* Related issues:
	W0311 04:06:12.699703   38998 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:06:12.699742   38998 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:06:12.742507   38998 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-amd64 start -p docker-flags-821000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:56: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-821000 ssh "sudo systemctl show docker --property=Environment --no-pager"
docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p docker-flags-821000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 83 (178.686678ms)

                                                
                                                
-- stdout --
	* The control-plane node docker-flags-821000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p docker-flags-821000"

                                                
                                                
-- /stdout --
docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-amd64 -p docker-flags-821000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 83
docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-821000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-821000\"\n"*.
docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-821000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-821000\"\n"*.
docker_test.go:67: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-821000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"
docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p docker-flags-821000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 83 (172.97497ms)

                                                
                                                
-- stdout --
	* The control-plane node docker-flags-821000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p docker-flags-821000"

                                                
                                                
-- /stdout --
docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-amd64 -p docker-flags-821000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 83
docker_test.go:73: expected "out/minikube-darwin-amd64 -p docker-flags-821000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control-plane node docker-flags-821000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-821000\"\n"
panic.go:626: *** TestDockerFlags FAILED at 2024-03-11 04:06:13.181833 -0700 PDT m=+1199.452939768
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p docker-flags-821000 -n docker-flags-821000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p docker-flags-821000 -n docker-flags-821000: exit status 7 (74.603888ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "docker-flags-821000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "docker-flags-821000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p docker-flags-821000
--- FAIL: TestDockerFlags (14.49s)

                                                
                                    
x
+
TestForceSystemdFlag (11.92s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-flag-759000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-flag-759000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (11.38221808s)

                                                
                                                
-- stdout --
	* [force-systemd-flag-759000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "force-systemd-flag-759000" primary control-plane node in "force-systemd-flag-759000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "force-systemd-flag-759000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:05:50.450245   38971 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:05:50.450411   38971 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:05:50.450417   38971 out.go:304] Setting ErrFile to fd 2...
	I0311 04:05:50.450421   38971 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:05:50.451332   38971 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:05:50.453120   38971 out.go:298] Setting JSON to false
	I0311 04:05:50.475720   38971 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11120,"bootTime":1710144030,"procs":464,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:05:50.475815   38971 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:05:50.496460   38971 out.go:177] * [force-systemd-flag-759000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:05:50.541680   38971 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:05:50.541715   38971 notify.go:220] Checking for updates...
	I0311 04:05:50.584309   38971 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:05:50.605563   38971 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:05:50.626448   38971 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:05:50.647318   38971 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:05:50.668294   38971 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:05:50.690417   38971 config.go:182] Loaded profile config "force-systemd-env-161000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:05:50.690620   38971 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:05:50.690790   38971 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:05:50.720301   38971 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:05:50.762543   38971 start.go:297] selected driver: hyperkit
	I0311 04:05:50.762556   38971 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:05:50.762567   38971 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:05:50.765482   38971 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:05:50.765589   38971 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:05:50.773332   38971 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:05:50.777121   38971 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:05:50.777159   38971 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:05:50.777192   38971 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:05:50.777391   38971 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0311 04:05:50.777445   38971 cni.go:84] Creating CNI manager for ""
	I0311 04:05:50.777460   38971 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:05:50.777468   38971 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0311 04:05:50.777540   38971 start.go:340] cluster config:
	{Name:force-systemd-flag-759000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-759000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:05:50.777649   38971 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:05:50.819440   38971 out.go:177] * Starting "force-systemd-flag-759000" primary control-plane node in "force-systemd-flag-759000" cluster
	I0311 04:05:50.840515   38971 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:05:50.840578   38971 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:05:50.840611   38971 cache.go:56] Caching tarball of preloaded images
	I0311 04:05:50.840799   38971 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:05:50.840811   38971 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:05:50.840910   38971 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/force-systemd-flag-759000/config.json ...
	I0311 04:05:50.840933   38971 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/force-systemd-flag-759000/config.json: {Name:mk7e9d965c405b0108f326279914a9aa51af2505 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:05:50.841305   38971 start.go:360] acquireMachinesLock for force-systemd-flag-759000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:05:50.841378   38971 start.go:364] duration metric: took 55.953µs to acquireMachinesLock for "force-systemd-flag-759000"
	I0311 04:05:50.841441   38971 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-759000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-759000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disable
Optimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:05:50.841503   38971 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:05:50.862389   38971 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0311 04:05:50.862561   38971 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:05:50.862604   38971 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:05:50.870471   38971 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62864
	I0311 04:05:50.870872   38971 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:05:50.871301   38971 main.go:141] libmachine: Using API Version  1
	I0311 04:05:50.871322   38971 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:05:50.871551   38971 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:05:50.871657   38971 main.go:141] libmachine: (force-systemd-flag-759000) Calling .GetMachineName
	I0311 04:05:50.871736   38971 main.go:141] libmachine: (force-systemd-flag-759000) Calling .DriverName
	I0311 04:05:50.871845   38971 start.go:159] libmachine.API.Create for "force-systemd-flag-759000" (driver="hyperkit")
	I0311 04:05:50.871870   38971 client.go:168] LocalClient.Create starting
	I0311 04:05:50.871901   38971 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:05:50.871948   38971 main.go:141] libmachine: Decoding PEM data...
	I0311 04:05:50.871966   38971 main.go:141] libmachine: Parsing certificate...
	I0311 04:05:50.872027   38971 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:05:50.872065   38971 main.go:141] libmachine: Decoding PEM data...
	I0311 04:05:50.872076   38971 main.go:141] libmachine: Parsing certificate...
	I0311 04:05:50.872090   38971 main.go:141] libmachine: Running pre-create checks...
	I0311 04:05:50.872097   38971 main.go:141] libmachine: (force-systemd-flag-759000) Calling .PreCreateCheck
	I0311 04:05:50.872171   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:50.872388   38971 main.go:141] libmachine: (force-systemd-flag-759000) Calling .GetConfigRaw
	I0311 04:05:50.883652   38971 main.go:141] libmachine: Creating machine...
	I0311 04:05:50.883662   38971 main.go:141] libmachine: (force-systemd-flag-759000) Calling .Create
	I0311 04:05:50.883768   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:50.883881   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | I0311 04:05:50.883754   38979 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:05:50.883956   38971 main.go:141] libmachine: (force-systemd-flag-759000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:05:51.060821   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | I0311 04:05:51.060724   38979 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-flag-759000/id_rsa...
	I0311 04:05:51.132867   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | I0311 04:05:51.132813   38979 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-flag-759000/force-systemd-flag-759000.rawdisk...
	I0311 04:05:51.132881   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | Writing magic tar header
	I0311 04:05:51.132892   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | Writing SSH key tar header
	I0311 04:05:51.133705   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | I0311 04:05:51.133661   38979 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-flag-759000 ...
	I0311 04:05:51.497026   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:51.497046   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-flag-759000/hyperkit.pid
	I0311 04:05:51.497058   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | Using UUID 4962c702-a943-4844-8693-796e4e1e01ba
	I0311 04:05:51.514953   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:05:51.515074   38971 client.go:171] duration metric: took 643.181578ms to LocalClient.Create
	I0311 04:05:53.517065   38971 start.go:128] duration metric: took 2.675477283s to createHost
	I0311 04:05:53.517101   38971 start.go:83] releasing machines lock for "force-systemd-flag-759000", held for 2.67566877s
	W0311 04:05:53.517155   38971 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:05:53.517677   38971 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:05:53.517716   38971 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:05:53.527459   38971 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62866
	I0311 04:05:53.527909   38971 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:05:53.528240   38971 main.go:141] libmachine: Using API Version  1
	I0311 04:05:53.528250   38971 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:05:53.528474   38971 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:05:53.528818   38971 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:05:53.528841   38971 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:05:53.536859   38971 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62868
	I0311 04:05:53.537308   38971 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:05:53.537679   38971 main.go:141] libmachine: Using API Version  1
	I0311 04:05:53.537692   38971 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:05:53.537885   38971 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:05:53.537981   38971 main.go:141] libmachine: (force-systemd-flag-759000) Calling .GetState
	I0311 04:05:53.538064   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:53.538088   38971 main.go:141] libmachine: (force-systemd-flag-759000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-flag-759000/hyperkit.json: no such file or directory
	I0311 04:05:53.538098   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | hyperkit pid from json: 0
	I0311 04:05:53.538149   38971 main.go:141] libmachine: (force-systemd-flag-759000) Calling .DriverName
	I0311 04:05:53.560066   38971 out.go:177] * Deleting "force-systemd-flag-759000" in hyperkit ...
	I0311 04:05:53.581886   38971 main.go:141] libmachine: (force-systemd-flag-759000) Calling .Remove
	I0311 04:05:53.582214   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:53.582236   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:53.582256   38971 main.go:141] libmachine: (force-systemd-flag-759000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-flag-759000/hyperkit.json: no such file or directory
	I0311 04:05:53.582279   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | hyperkit pid from json: 0
	W0311 04:05:53.601619   38971 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:05:53.601632   38971 start.go:728] Will try again in 5 seconds ...
	I0311 04:05:58.601848   38971 start.go:360] acquireMachinesLock for force-systemd-flag-759000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:05:58.601929   38971 start.go:364] duration metric: took 62.593µs to acquireMachinesLock for "force-systemd-flag-759000"
	I0311 04:05:58.601953   38971 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-759000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-759000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disable
Optimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:05:58.602018   38971 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:05:58.665022   38971 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0311 04:05:58.665201   38971 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:05:58.665251   38971 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:05:58.674539   38971 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62874
	I0311 04:05:58.674898   38971 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:05:58.675301   38971 main.go:141] libmachine: Using API Version  1
	I0311 04:05:58.675317   38971 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:05:58.675542   38971 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:05:58.675642   38971 main.go:141] libmachine: (force-systemd-flag-759000) Calling .GetMachineName
	I0311 04:05:58.675740   38971 main.go:141] libmachine: (force-systemd-flag-759000) Calling .DriverName
	I0311 04:05:58.675874   38971 start.go:159] libmachine.API.Create for "force-systemd-flag-759000" (driver="hyperkit")
	I0311 04:05:58.675899   38971 client.go:168] LocalClient.Create starting
	I0311 04:05:58.675930   38971 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:05:58.675965   38971 main.go:141] libmachine: Decoding PEM data...
	I0311 04:05:58.675976   38971 main.go:141] libmachine: Parsing certificate...
	I0311 04:05:58.676015   38971 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:05:58.676040   38971 main.go:141] libmachine: Decoding PEM data...
	I0311 04:05:58.676057   38971 main.go:141] libmachine: Parsing certificate...
	I0311 04:05:58.676070   38971 main.go:141] libmachine: Running pre-create checks...
	I0311 04:05:58.676076   38971 main.go:141] libmachine: (force-systemd-flag-759000) Calling .PreCreateCheck
	I0311 04:05:58.676168   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:58.676183   38971 main.go:141] libmachine: (force-systemd-flag-759000) Calling .GetConfigRaw
	I0311 04:05:58.686855   38971 main.go:141] libmachine: Creating machine...
	I0311 04:05:58.686881   38971 main.go:141] libmachine: (force-systemd-flag-759000) Calling .Create
	I0311 04:05:58.687155   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:58.687410   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | I0311 04:05:58.687120   38988 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:05:58.687517   38971 main.go:141] libmachine: (force-systemd-flag-759000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:05:58.883112   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | I0311 04:05:58.883062   38988 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-flag-759000/id_rsa...
	I0311 04:05:59.072204   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | I0311 04:05:59.072122   38988 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-flag-759000/force-systemd-flag-759000.rawdisk...
	I0311 04:05:59.072217   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | Writing magic tar header
	I0311 04:05:59.072256   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | Writing SSH key tar header
	I0311 04:05:59.072610   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | I0311 04:05:59.072584   38988 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-flag-759000 ...
	I0311 04:05:59.531209   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:59.531229   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-flag-759000/hyperkit.pid
	I0311 04:05:59.531275   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | Using UUID a9b052ca-d440-49d8-9175-48d2f1e01d26
	I0311 04:05:59.546456   38971 main.go:141] libmachine: (force-systemd-flag-759000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:05:59.546539   38971 client.go:171] duration metric: took 870.618159ms to LocalClient.Create
	I0311 04:06:01.548212   38971 start.go:128] duration metric: took 2.946135138s to createHost
	I0311 04:06:01.548232   38971 start.go:83] releasing machines lock for "force-systemd-flag-759000", held for 2.9462523s
	W0311 04:06:01.548309   38971 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p force-systemd-flag-759000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p force-systemd-flag-759000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:06:01.568760   38971 out.go:177] 
	W0311 04:06:01.636799   38971 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:06:01.636865   38971 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:06:01.636891   38971 out.go:239] * Related issues:
	* Related issues:
	W0311 04:06:01.636949   38971 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:06:01.636982   38971 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:06:01.658691   38971 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-flag-759000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-flag-759000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p force-systemd-flag-759000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (178.979817ms)

                                                
                                                
-- stdout --
	* The control-plane node force-systemd-flag-759000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p force-systemd-flag-759000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-amd64 -p force-systemd-flag-759000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83
docker_test.go:106: *** TestForceSystemdFlag FAILED at 2024-03-11 04:06:01.955457 -0700 PDT m=+1188.226729552
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-flag-759000 -n force-systemd-flag-759000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-flag-759000 -n force-systemd-flag-759000: exit status 7 (77.023313ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-flag-759000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-flag-759000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-flag-759000
--- FAIL: TestForceSystemdFlag (11.92s)

                                                
                                    
x
+
TestForceSystemdEnv (17.27s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-env-161000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-env-161000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (16.728104057s)

                                                
                                                
-- stdout --
	* [force-systemd-env-161000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=true
	* Using the hyperkit driver based on user configuration
	* Downloading driver docker-machine-driver-hyperkit:
	* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:
	
	    $ sudo chown root:wheel /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit 
	    $ sudo chmod u+s /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit 
	
	
	* Starting "force-systemd-env-161000" primary control-plane node in "force-systemd-env-161000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "force-systemd-env-161000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:05:41.838438   38930 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:05:41.838702   38930 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:05:41.838708   38930 out.go:304] Setting ErrFile to fd 2...
	I0311 04:05:41.838711   38930 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:05:41.838890   38930 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:05:41.840369   38930 out.go:298] Setting JSON to false
	I0311 04:05:41.862788   38930 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11111,"bootTime":1710144030,"procs":465,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:05:41.862909   38930 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:05:41.887263   38930 out.go:177] * [force-systemd-env-161000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:05:41.930387   38930 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:05:41.930490   38930 notify.go:220] Checking for updates...
	I0311 04:05:41.976234   38930 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:05:41.997208   38930 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:05:42.018279   38930 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:05:42.040174   38930 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:05:42.061569   38930 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true
	I0311 04:05:42.082860   38930 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:05:42.082946   38930 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:05:42.111259   38930 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:05:42.153470   38930 start.go:297] selected driver: hyperkit
	I0311 04:05:42.153496   38930 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:05:42.153517   38930 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:05:42.157549   38930 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:05:44.588788   38930 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/testdata/hyperkit-driver-without-version:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	W0311 04:05:44.602760   38930 install.go:62] docker-machine-driver-hyperkit: exit status 1
	I0311 04:05:44.624481   38930 out.go:177] * Downloading driver docker-machine-driver-hyperkit:
	I0311 04:05:44.666347   38930 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64.sha256 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:05:45.053478   38930 driver.go:46] failed to download arch specific driver: getter: &{Ctx:context.Background Src:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64.sha256 Dst:/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit.download Pwd: Mode:2 Umask:---------- Detectors:[0x11057f40 0x11057f40 0x11057f40 0x11057f40 0x11057f40 0x11057f40 0x11057f40] Decompressors:map[bz2:0xc00081e030 gz:0xc00081e038 tar:0xc00012ffa0 tar.bz2:0xc00012ffc0 tar.gz:0xc00012ffe0 tar.xz:0xc00012fff0 tar.zst:0xc00081e010 tbz2:0xc00012ffc0 tgz:0xc00012ffe0 txz:0xc00012fff0 tzst:0xc00081e010 xz:0xc00081e060 zip:0xc00081e070 zst:0xc00081e068] Getters:map[file:0xc00081b360 http:0xc0000d3ea0 https:0xc0000d3ef0] Dir:false ProgressListener:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Erro
r downloading checksum file: bad response code: 404. trying to get the common version
	I0311 04:05:45.053513   38930 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit.sha256 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:05:47.052994   38930 install.go:79] stdout: 
	I0311 04:05:47.077390   38930 out.go:177] * The 'hyperkit' driver requires elevated permissions. The following commands will be executed:
	
	    $ sudo chown root:wheel /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit 
	    $ sudo chmod u+s /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit 
	
	
	I0311 04:05:47.096958   38930 install.go:99] testing: [sudo -n chown root:wheel /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit]
	I0311 04:05:47.112844   38930 install.go:106] running: [sudo chown root:wheel /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit]
	I0311 04:05:47.128085   38930 install.go:99] testing: [sudo -n chmod u+s /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit]
	I0311 04:05:47.142248   38930 install.go:106] running: [sudo chmod u+s /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit]
	I0311 04:05:47.156561   38930 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:05:47.156790   38930 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0311 04:05:47.156846   38930 cni.go:84] Creating CNI manager for ""
	I0311 04:05:47.156862   38930 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:05:47.156869   38930 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0311 04:05:47.156943   38930 start.go:340] cluster config:
	{Name:force-systemd-env-161000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-161000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluste
r.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:05:47.157029   38930 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:05:47.178844   38930 out.go:177] * Starting "force-systemd-env-161000" primary control-plane node in "force-systemd-env-161000" cluster
	I0311 04:05:47.221394   38930 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:05:47.221473   38930 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:05:47.221510   38930 cache.go:56] Caching tarball of preloaded images
	I0311 04:05:47.221639   38930 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:05:47.221648   38930 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:05:47.221796   38930 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/force-systemd-env-161000/config.json ...
	I0311 04:05:47.221814   38930 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/force-systemd-env-161000/config.json: {Name:mk9c1396bb8c28e75c5ea7dc70e448a48713f9be Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:05:47.222153   38930 start.go:360] acquireMachinesLock for force-systemd-env-161000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:05:47.222228   38930 start.go:364] duration metric: took 64.431µs to acquireMachinesLock for "force-systemd-env-161000"
	I0311 04:05:47.222291   38930 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-161000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-161000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOp
timizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:05:47.222333   38930 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:05:47.244691   38930 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0311 04:05:47.244991   38930 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:05:47.245038   38930 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:05:47.566993   38930 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62847
	I0311 04:05:47.567343   38930 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:05:47.567768   38930 main.go:141] libmachine: Using API Version  1
	I0311 04:05:47.567778   38930 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:05:47.568016   38930 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:05:47.568110   38930 main.go:141] libmachine: (force-systemd-env-161000) Calling .GetMachineName
	I0311 04:05:47.568204   38930 main.go:141] libmachine: (force-systemd-env-161000) Calling .DriverName
	I0311 04:05:47.568301   38930 start.go:159] libmachine.API.Create for "force-systemd-env-161000" (driver="hyperkit")
	I0311 04:05:47.568325   38930 client.go:168] LocalClient.Create starting
	I0311 04:05:47.568356   38930 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:05:47.568404   38930 main.go:141] libmachine: Decoding PEM data...
	I0311 04:05:47.568422   38930 main.go:141] libmachine: Parsing certificate...
	I0311 04:05:47.568474   38930 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:05:47.568516   38930 main.go:141] libmachine: Decoding PEM data...
	I0311 04:05:47.568526   38930 main.go:141] libmachine: Parsing certificate...
	I0311 04:05:47.568538   38930 main.go:141] libmachine: Running pre-create checks...
	I0311 04:05:47.568546   38930 main.go:141] libmachine: (force-systemd-env-161000) Calling .PreCreateCheck
	I0311 04:05:47.568616   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:47.568771   38930 main.go:141] libmachine: (force-systemd-env-161000) Calling .GetConfigRaw
	I0311 04:05:47.618465   38930 main.go:141] libmachine: Creating machine...
	I0311 04:05:47.618484   38930 main.go:141] libmachine: (force-systemd-env-161000) Calling .Create
	I0311 04:05:47.618664   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:47.618989   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | I0311 04:05:47.618638   38958 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:05:47.619040   38930 main.go:141] libmachine: (force-systemd-env-161000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:05:47.821186   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | I0311 04:05:47.821044   38958 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-env-161000/id_rsa...
	I0311 04:05:47.923389   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | I0311 04:05:47.923309   38958 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-env-161000/force-systemd-env-161000.rawdisk...
	I0311 04:05:47.923404   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | Writing magic tar header
	I0311 04:05:47.923433   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | Writing SSH key tar header
	I0311 04:05:47.923929   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | I0311 04:05:47.923896   38958 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-env-161000 ...
	I0311 04:05:48.283078   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:48.283096   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-env-161000/hyperkit.pid
	I0311 04:05:48.283127   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | Using UUID 33734534-9b5a-4231-bc1b-f2f7dd637f9a
	I0311 04:05:48.305354   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:05:48.305432   38930 client.go:171] duration metric: took 737.085506ms to LocalClient.Create
	I0311 04:05:50.305783   38930 start.go:128] duration metric: took 3.083393795s to createHost
	I0311 04:05:50.305799   38930 start.go:83] releasing machines lock for "force-systemd-env-161000", held for 3.083518725s
	W0311 04:05:50.305816   38930 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:05:50.306145   38930 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:05:50.306174   38930 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:05:50.314272   38930 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62859
	I0311 04:05:50.314591   38930 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:05:50.314924   38930 main.go:141] libmachine: Using API Version  1
	I0311 04:05:50.314935   38930 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:05:50.315154   38930 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:05:50.315492   38930 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:05:50.315532   38930 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:05:50.323814   38930 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62861
	I0311 04:05:50.324158   38930 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:05:50.324482   38930 main.go:141] libmachine: Using API Version  1
	I0311 04:05:50.324494   38930 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:05:50.324708   38930 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:05:50.324809   38930 main.go:141] libmachine: (force-systemd-env-161000) Calling .GetState
	I0311 04:05:50.324891   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:50.324915   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | hyperkit pid from json: 0
	I0311 04:05:50.324928   38930 main.go:141] libmachine: (force-systemd-env-161000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-env-161000/hyperkit.json: no such file or directory
	I0311 04:05:50.324988   38930 main.go:141] libmachine: (force-systemd-env-161000) Calling .DriverName
	I0311 04:05:50.367529   38930 out.go:177] * Deleting "force-systemd-env-161000" in hyperkit ...
	I0311 04:05:50.388561   38930 main.go:141] libmachine: (force-systemd-env-161000) Calling .Remove
	I0311 04:05:50.388751   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:50.388763   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:50.388774   38930 main.go:141] libmachine: (force-systemd-env-161000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-env-161000/hyperkit.json: no such file or directory
	I0311 04:05:50.388788   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | hyperkit pid from json: 0
	W0311 04:05:50.406128   38930 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:05:50.406145   38930 start.go:728] Will try again in 5 seconds ...
	I0311 04:05:55.407334   38930 start.go:360] acquireMachinesLock for force-systemd-env-161000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:05:55.407533   38930 start.go:364] duration metric: took 162.463µs to acquireMachinesLock for "force-systemd-env-161000"
	I0311 04:05:55.407579   38930 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-161000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-161000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOp
timizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:05:55.407678   38930 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:05:55.428534   38930 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0311 04:05:55.428629   38930 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:05:55.428657   38930 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:05:55.437071   38930 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62870
	I0311 04:05:55.437449   38930 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:05:55.437788   38930 main.go:141] libmachine: Using API Version  1
	I0311 04:05:55.437803   38930 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:05:55.438040   38930 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:05:55.438172   38930 main.go:141] libmachine: (force-systemd-env-161000) Calling .GetMachineName
	I0311 04:05:55.438269   38930 main.go:141] libmachine: (force-systemd-env-161000) Calling .DriverName
	I0311 04:05:55.438374   38930 start.go:159] libmachine.API.Create for "force-systemd-env-161000" (driver="hyperkit")
	I0311 04:05:55.438392   38930 client.go:168] LocalClient.Create starting
	I0311 04:05:55.438421   38930 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:05:55.438472   38930 main.go:141] libmachine: Decoding PEM data...
	I0311 04:05:55.438483   38930 main.go:141] libmachine: Parsing certificate...
	I0311 04:05:55.438524   38930 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:05:55.438560   38930 main.go:141] libmachine: Decoding PEM data...
	I0311 04:05:55.438572   38930 main.go:141] libmachine: Parsing certificate...
	I0311 04:05:55.438586   38930 main.go:141] libmachine: Running pre-create checks...
	I0311 04:05:55.438592   38930 main.go:141] libmachine: (force-systemd-env-161000) Calling .PreCreateCheck
	I0311 04:05:55.438674   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:55.438686   38930 main.go:141] libmachine: (force-systemd-env-161000) Calling .GetConfigRaw
	I0311 04:05:55.439175   38930 main.go:141] libmachine: Creating machine...
	I0311 04:05:55.439184   38930 main.go:141] libmachine: (force-systemd-env-161000) Calling .Create
	I0311 04:05:55.439258   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:55.439377   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | I0311 04:05:55.439248   38983 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:05:55.439430   38930 main.go:141] libmachine: (force-systemd-env-161000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:05:55.642971   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | I0311 04:05:55.642878   38983 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-env-161000/id_rsa...
	I0311 04:05:55.975749   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | I0311 04:05:55.975649   38983 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-env-161000/force-systemd-env-161000.rawdisk...
	I0311 04:05:55.975764   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | Writing magic tar header
	I0311 04:05:55.975776   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | Writing SSH key tar header
	I0311 04:05:55.976537   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | I0311 04:05:55.976449   38983 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-env-161000 ...
	I0311 04:05:56.336158   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:05:56.336177   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/force-systemd-env-161000/hyperkit.pid
	I0311 04:05:56.336202   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | Using UUID 46351297-02e7-4f1b-a64a-f990d5d7eaa4
	I0311 04:05:56.352195   38930 main.go:141] libmachine: (force-systemd-env-161000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:05:56.352284   38930 client.go:171] duration metric: took 913.871495ms to LocalClient.Create
	I0311 04:05:58.353298   38930 start.go:128] duration metric: took 2.945558754s to createHost
	I0311 04:05:58.353321   38930 start.go:83] releasing machines lock for "force-systemd-env-161000", held for 2.945728499s
	W0311 04:05:58.353409   38930 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p force-systemd-env-161000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p force-systemd-env-161000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:05:58.397870   38930 out.go:177] 
	W0311 04:05:58.420130   38930 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:05:58.420194   38930 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:05:58.420247   38930 out.go:239] * Related issues:
	* Related issues:
	W0311 04:05:58.420281   38930 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:05:58.420304   38930 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:05:58.441996   38930 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-env-161000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-env-161000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p force-systemd-env-161000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (182.111338ms)

                                                
                                                
-- stdout --
	* The control-plane node force-systemd-env-161000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p force-systemd-env-161000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-amd64 -p force-systemd-env-161000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83
docker_test.go:166: *** TestForceSystemdEnv FAILED at 2024-03-11 04:05:58.690049 -0700 PDT m=+1184.961370378
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-161000 -n force-systemd-env-161000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-161000 -n force-systemd-env-161000: exit status 7 (75.371447ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-env-161000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-env-161000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-env-161000
--- FAIL: TestForceSystemdEnv (17.27s)

                                                
                                    
x
+
TestErrorSpam/setup (11.13s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -p nospam-191000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 --driver=hyperkit 
error_spam_test.go:81: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p nospam-191000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 --driver=hyperkit : exit status 60 (11.133932129s)

                                                
                                                
-- stdout --
	* [nospam-191000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "nospam-191000" primary control-plane node in "nospam-191000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
	* Deleting "nospam-191000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p nospam-191000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
error_spam_test.go:83: "out/minikube-darwin-amd64 start -p nospam-191000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 --driver=hyperkit " failed: exit status 60
error_spam_test.go:96: unexpected stderr: "! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "* Failed to start hyperkit VM. Running \"minikube delete -p nospam-191000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "* Suggestion: "
error_spam_test.go:96: unexpected stderr: "    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing."
error_spam_test.go:96: unexpected stderr: "    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver."
error_spam_test.go:96: unexpected stderr: "* Related issues:"
error_spam_test.go:96: unexpected stderr: "  - https://github.com/kubernetes/minikube/issues/6028"
error_spam_test.go:96: unexpected stderr: "  - https://github.com/kubernetes/minikube/issues/5594"
error_spam_test.go:110: minikube stdout:
* [nospam-191000] minikube v1.32.0 on Darwin 14.3.1
- MINIKUBE_LOCATION=18350
- KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the hyperkit driver based on user configuration
* Starting "nospam-191000" primary control-plane node in "nospam-191000" cluster
* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
* Deleting "nospam-191000" in hyperkit ...
* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...

                                                
                                                

                                                
                                                
error_spam_test.go:111: minikube stderr:
! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Failed to start hyperkit VM. Running "minikube delete -p nospam-191000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
* Related issues:
- https://github.com/kubernetes/minikube/issues/6028
- https://github.com/kubernetes/minikube/issues/5594
error_spam_test.go:121: missing kubeadm init sub-step "Generating certificates and keys ..."
error_spam_test.go:121: missing kubeadm init sub-step "Booting up control plane ..."
error_spam_test.go:121: missing kubeadm init sub-step "Configuring RBAC rules ..."
--- FAIL: TestErrorSpam/setup (11.13s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (11.62s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-196000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit 
functional_test.go:2230: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-196000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit : exit status 60 (11.544563118s)

                                                
                                                
-- stdout --
	* [functional-196000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "functional-196000" primary control-plane node in "functional-196000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	* Deleting "functional-196000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Local proxy ignored: not passing HTTP_PROXY=localhost:61980 to docker env.
	! Local proxy ignored: not passing HTTP_PROXY=localhost:61980 to docker env.
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! Local proxy ignored: not passing HTTP_PROXY=localhost:61980 to docker env.
	* Failed to start hyperkit VM. Running "minikube delete -p functional-196000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
functional_test.go:2232: failed minikube start. args "out/minikube-darwin-amd64 start -p functional-196000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit ": exit status 60
functional_test.go:2237: start stdout=* [functional-196000] minikube v1.32.0 on Darwin 14.3.1
- MINIKUBE_LOCATION=18350
- KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the hyperkit driver based on user configuration
* Starting "functional-196000" primary control-plane node in "functional-196000" cluster
* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
* Deleting "functional-196000" in hyperkit ...
* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

                                                
                                                

                                                
                                                
, want: *Found network options:*
functional_test.go:2242: start stderr=! Local proxy ignored: not passing HTTP_PROXY=localhost:61980 to docker env.
! Local proxy ignored: not passing HTTP_PROXY=localhost:61980 to docker env.
! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
! Local proxy ignored: not passing HTTP_PROXY=localhost:61980 to docker env.
* Failed to start hyperkit VM. Running "minikube delete -p functional-196000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
* Related issues:
- https://github.com/kubernetes/minikube/issues/6028
- https://github.com/kubernetes/minikube/issues/5594
, want: *You appear to be using a proxy*
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (75.100457ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/StartWithProxy (11.62s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (5.86s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-196000 --alsologtostderr -v=8
functional_test.go:655: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-196000 --alsologtostderr -v=8: exit status 60 (5.787079596s)

                                                
                                                
-- stdout --
	* [functional-196000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "functional-196000" primary control-plane node in "functional-196000" cluster
	* Restarting existing hyperkit VM for "functional-196000" ...
	* Restarting existing hyperkit VM for "functional-196000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:53:45.106749   37271 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:53:45.106922   37271 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:53:45.106928   37271 out.go:304] Setting ErrFile to fd 2...
	I0311 03:53:45.106932   37271 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:53:45.107633   37271 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:53:45.109364   37271 out.go:298] Setting JSON to false
	I0311 03:53:45.131978   37271 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":10395,"bootTime":1710144030,"procs":473,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 03:53:45.132073   37271 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 03:53:45.153867   37271 out.go:177] * [functional-196000] minikube v1.32.0 on Darwin 14.3.1
	I0311 03:53:45.196553   37271 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 03:53:45.196647   37271 notify.go:220] Checking for updates...
	I0311 03:53:45.239413   37271 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 03:53:45.260607   37271 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 03:53:45.303394   37271 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 03:53:45.324492   37271 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 03:53:45.345560   37271 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 03:53:45.367037   37271 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:53:45.367244   37271 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 03:53:45.367821   37271 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:53:45.367884   37271 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:53:45.377006   37271 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61998
	I0311 03:53:45.377367   37271 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:53:45.377819   37271 main.go:141] libmachine: Using API Version  1
	I0311 03:53:45.377846   37271 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:53:45.378112   37271 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:53:45.378231   37271 main.go:141] libmachine: (functional-196000) Calling .DriverName
	I0311 03:53:45.406504   37271 out.go:177] * Using the hyperkit driver based on existing profile
	I0311 03:53:45.427503   37271 start.go:297] selected driver: hyperkit
	I0311 03:53:45.427539   37271 start.go:901] validating driver "hyperkit" against &{Name:functional-196000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-196000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 03:53:45.427725   37271 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 03:53:45.427930   37271 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 03:53:45.428118   37271 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 03:53:45.436971   37271 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0311 03:53:45.440822   37271 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:53:45.440856   37271 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0311 03:53:45.443544   37271 cni.go:84] Creating CNI manager for ""
	I0311 03:53:45.443569   37271 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 03:53:45.443655   37271 start.go:340] cluster config:
	{Name:functional-196000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-196000 Namespace:default APISe
rverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disa
bleMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 03:53:45.443764   37271 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 03:53:45.486560   37271 out.go:177] * Starting "functional-196000" primary control-plane node in "functional-196000" cluster
	I0311 03:53:45.507402   37271 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 03:53:45.507445   37271 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 03:53:45.507466   37271 cache.go:56] Caching tarball of preloaded images
	I0311 03:53:45.507616   37271 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 03:53:45.507628   37271 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 03:53:45.507726   37271 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/functional-196000/config.json ...
	I0311 03:53:45.508371   37271 start.go:360] acquireMachinesLock for functional-196000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 03:53:45.508439   37271 start.go:364] duration metric: took 49.367µs to acquireMachinesLock for "functional-196000"
	I0311 03:53:45.508465   37271 start.go:96] Skipping create...Using existing machine configuration
	I0311 03:53:45.508477   37271 fix.go:54] fixHost starting: 
	I0311 03:53:45.508776   37271 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:53:45.508795   37271 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:53:45.516747   37271 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62000
	I0311 03:53:45.517081   37271 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:53:45.517429   37271 main.go:141] libmachine: Using API Version  1
	I0311 03:53:45.517441   37271 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:53:45.517666   37271 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:53:45.517776   37271 main.go:141] libmachine: (functional-196000) Calling .DriverName
	I0311 03:53:45.517883   37271 main.go:141] libmachine: (functional-196000) Calling .GetState
	I0311 03:53:45.517974   37271 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:53:45.517987   37271 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
	I0311 03:53:45.518004   37271 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
	I0311 03:53:45.518037   37271 fix.go:112] recreateIfNeeded on functional-196000: state=Stopped err=<nil>
	I0311 03:53:45.518053   37271 main.go:141] libmachine: (functional-196000) Calling .DriverName
	W0311 03:53:45.518143   37271 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 03:53:45.539576   37271 out.go:177] * Restarting existing hyperkit VM for "functional-196000" ...
	I0311 03:53:45.581440   37271 main.go:141] libmachine: (functional-196000) Calling .Start
	I0311 03:53:45.581679   37271 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:53:45.581709   37271 main.go:141] libmachine: (functional-196000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.pid
	I0311 03:53:45.581758   37271 main.go:141] libmachine: (functional-196000) DBG | Using UUID 339ea83c-5a24-4eb3-9e6c-ee0a4b7b8e7f
	I0311 03:53:45.583553   37271 main.go:141] libmachine: (functional-196000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 03:53:45.583673   37271 fix.go:56] duration metric: took 75.195794ms for fixHost
	I0311 03:53:45.583699   37271 start.go:83] releasing machines lock for "functional-196000", held for 75.236922ms
	W0311 03:53:45.583714   37271 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0311 03:53:45.583764   37271 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 03:53:45.583770   37271 start.go:728] Will try again in 5 seconds ...
	I0311 03:53:50.584820   37271 start.go:360] acquireMachinesLock for functional-196000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 03:53:50.585097   37271 start.go:364] duration metric: took 119.046µs to acquireMachinesLock for "functional-196000"
	I0311 03:53:50.585133   37271 start.go:96] Skipping create...Using existing machine configuration
	I0311 03:53:50.585141   37271 fix.go:54] fixHost starting: 
	I0311 03:53:50.585603   37271 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:53:50.585650   37271 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:53:50.594831   37271 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62002
	I0311 03:53:50.595181   37271 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:53:50.595587   37271 main.go:141] libmachine: Using API Version  1
	I0311 03:53:50.595603   37271 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:53:50.595887   37271 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:53:50.596008   37271 main.go:141] libmachine: (functional-196000) Calling .DriverName
	I0311 03:53:50.596103   37271 main.go:141] libmachine: (functional-196000) Calling .GetState
	I0311 03:53:50.596192   37271 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:53:50.596213   37271 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
	I0311 03:53:50.596225   37271 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
	I0311 03:53:50.596238   37271 fix.go:112] recreateIfNeeded on functional-196000: state=Stopped err=<nil>
	I0311 03:53:50.596250   37271 main.go:141] libmachine: (functional-196000) Calling .DriverName
	W0311 03:53:50.596330   37271 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 03:53:50.618106   37271 out.go:177] * Restarting existing hyperkit VM for "functional-196000" ...
	I0311 03:53:50.660786   37271 main.go:141] libmachine: (functional-196000) Calling .Start
	I0311 03:53:50.661057   37271 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:53:50.661120   37271 main.go:141] libmachine: (functional-196000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.pid
	I0311 03:53:50.661193   37271 main.go:141] libmachine: (functional-196000) DBG | Using UUID 339ea83c-5a24-4eb3-9e6c-ee0a4b7b8e7f
	I0311 03:53:50.663344   37271 main.go:141] libmachine: (functional-196000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 03:53:50.663441   37271 fix.go:56] duration metric: took 78.297838ms for fixHost
	I0311 03:53:50.663451   37271 start.go:83] releasing machines lock for "functional-196000", held for 78.338402ms
	W0311 03:53:50.663533   37271 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-196000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p functional-196000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 03:53:50.705741   37271 out.go:177] 
	W0311 03:53:50.726981   37271 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 03:53:50.727062   37271 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 03:53:50.727091   37271 out.go:239] * Related issues:
	* Related issues:
	W0311 03:53:50.727135   37271 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 03:53:50.727157   37271 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 03:53:50.748616   37271 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:657: failed to soft start minikube. args "out/minikube-darwin-amd64 start -p functional-196000 --alsologtostderr -v=8": exit status 60
functional_test.go:659: soft start took 5.788815835s for "functional-196000" cluster.
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (74.884098ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/SoftStart (5.86s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
functional_test.go:677: (dbg) Non-zero exit: kubectl config current-context: exit status 1 (36.59503ms)

                                                
                                                
** stderr ** 
	error: current-context is not set

                                                
                                                
** /stderr **
functional_test.go:679: failed to get current-context. args "kubectl config current-context" : exit status 1
functional_test.go:683: expected current-context = "functional-196000", but got *""*
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (74.821757ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/KubeContext (0.11s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-196000 get po -A
functional_test.go:692: (dbg) Non-zero exit: kubectl --context functional-196000 get po -A: exit status 1 (36.897907ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-196000

                                                
                                                
** /stderr **
functional_test.go:694: failed to get kubectl pods: args "kubectl --context functional-196000 get po -A" : exit status 1
functional_test.go:698: expected stderr to be empty but got *"Error in configuration: context was not found for specified context: functional-196000\n"*: args "kubectl --context functional-196000 get po -A"
functional_test.go:701: expected stdout to include *kube-system* but got *""*. args: "kubectl --context functional-196000 get po -A"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (75.970659ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh sudo crictl images
functional_test.go:1120: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh sudo crictl images: exit status 83 (142.225706ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1122: failed to get images by "out/minikube-darwin-amd64 -p functional-196000 ssh sudo crictl images" ssh exit status 83
functional_test.go:1126: expected sha for pause:3.3 "0184c1613d929" to be in the output but got *
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --*
--- FAIL: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.14s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (0.52s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh sudo docker rmi registry.k8s.io/pause:latest
functional_test.go:1143: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh sudo docker rmi registry.k8s.io/pause:latest: exit status 83 (137.644239ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1146: failed to manually delete image "out/minikube-darwin-amd64 -p functional-196000 ssh sudo docker rmi registry.k8s.io/pause:latest" : exit status 83
functional_test.go:1149: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 83 (140.256052ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1154: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 cache reload
functional_test.go:1159: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 83 (140.730026ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1161: expected "out/minikube-darwin-amd64 -p functional-196000 ssh sudo crictl inspecti registry.k8s.io/pause:latest" to run successfully but got error: exit status 83
--- FAIL: TestFunctional/serial/CacheCmd/cache/cache_reload (0.52s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.57s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 kubectl -- --context functional-196000 get pods
functional_test.go:712: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 kubectl -- --context functional-196000 get pods: exit status 1 (498.845715ms)

                                                
                                                
** stderr ** 
	Error in configuration: 
	* context was not found for specified context: functional-196000
	* no server found for cluster "functional-196000"

                                                
                                                
** /stderr **
functional_test.go:715: failed to get pods. args "out/minikube-darwin-amd64 -p functional-196000 kubectl -- --context functional-196000 get pods": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (75.251039ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/MinikubeKubectlCmd (0.57s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.78s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-196000 get pods
functional_test.go:737: (dbg) Non-zero exit: out/kubectl --context functional-196000 get pods: exit status 1 (699.450061ms)

                                                
                                                
** stderr ** 
	Error in configuration: 
	* context was not found for specified context: functional-196000
	* no server found for cluster "functional-196000"

                                                
                                                
** /stderr **
functional_test.go:740: failed to run kubectl directly. args "out/kubectl --context functional-196000 get pods": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (76.043056ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.78s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (5.84s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-196000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:753: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-196000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: exit status 60 (5.766519148s)

                                                
                                                
-- stdout --
	* [functional-196000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "functional-196000" primary control-plane node in "functional-196000" cluster
	* Restarting existing hyperkit VM for "functional-196000" ...
	* Restarting existing hyperkit VM for "functional-196000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p functional-196000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
functional_test.go:755: failed to restart minikube. args "out/minikube-darwin-amd64 start -p functional-196000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all": exit status 60
functional_test.go:757: restart took 5.766847989s for "functional-196000" cluster.
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (74.589684ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/ExtraConfig (5.84s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-196000 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:806: (dbg) Non-zero exit: kubectl --context functional-196000 get po -l tier=control-plane -n kube-system -o=json: exit status 1 (36.75899ms)

                                                
                                                
** stderr ** 
	error: context "functional-196000" does not exist

                                                
                                                
** /stderr **
functional_test.go:808: failed to get components. args "kubectl --context functional-196000 get po -l tier=control-plane -n kube-system -o=json": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (75.341562ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (0.35s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 logs
functional_test.go:1232: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 logs: exit status 83 (344.641154ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| delete  | -p download-only-023000                                                                     | download-only-023000 | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT | 11 Mar 24 03:47 PDT |
	| start   | --download-only -p                                                                          | binary-mirror-399000 | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT |                     |
	|         | binary-mirror-399000                                                                        |                      |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |
	|         | --binary-mirror                                                                             |                      |         |         |                     |                     |
	|         | http://127.0.0.1:61560                                                                      |                      |         |         |                     |                     |
	|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
	| delete  | -p binary-mirror-399000                                                                     | binary-mirror-399000 | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT | 11 Mar 24 03:47 PDT |
	| addons  | enable dashboard -p                                                                         | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT |                     |
	|         | addons-725000                                                                               |                      |         |         |                     |                     |
	| addons  | disable dashboard -p                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT |                     |
	|         | addons-725000                                                                               |                      |         |         |                     |                     |
	| start   | -p addons-725000 --wait=true                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT | 11 Mar 24 03:51 PDT |
	|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |
	|         | --addons=registry                                                                           |                      |         |         |                     |                     |
	|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |
	|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |
	|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |
	|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |
	|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin                                                               |                      |         |         |                     |                     |
	|         | --addons=yakd --driver=hyperkit                                                             |                      |         |         |                     |                     |
	|         |  --addons=ingress                                                                           |                      |         |         |                     |                     |
	|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |
	|         | --addons=helm-tiller                                                                        |                      |         |         |                     |                     |
	| ip      | addons-725000 ip                                                                            | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:51 PDT |
	| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:51 PDT |
	|         | registry --alsologtostderr                                                                  |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:51 PDT |
	|         | helm-tiller --alsologtostderr                                                               |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| addons  | addons-725000 addons                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:51 PDT |
	|         | disable metrics-server                                                                      |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p                                                                 | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:52 PDT |
	|         | addons-725000                                                                               |                      |         |         |                     |                     |
	| addons  | addons-725000 addons                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
	|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| ssh     | addons-725000 ssh curl -s                                                                   | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
	|         | http://127.0.0.1/ -H 'Host:                                                                 |                      |         |         |                     |                     |
	|         | nginx.example.com'                                                                          |                      |         |         |                     |                     |
	| ip      | addons-725000 ip                                                                            | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
	| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
	|         | ingress-dns --alsologtostderr                                                               |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
	|         | ingress --alsologtostderr -v=1                                                              |                      |         |         |                     |                     |
	| addons  | addons-725000 addons                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
	|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| ssh     | addons-725000 ssh cat                                                                       | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
	|         | /opt/local-path-provisioner/pvc-1e753a32-583c-4106-8a48-b945667fce5e_default_test-pvc/file1 |                      |         |         |                     |                     |
	| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
	|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | enable headlamp                                                                             | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
	|         | -p addons-725000                                                                            |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | disable nvidia-device-plugin                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
	|         | -p addons-725000                                                                            |                      |         |         |                     |                     |
	| addons  | disable cloud-spanner -p                                                                    | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
	|         | addons-725000                                                                               |                      |         |         |                     |                     |
	| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:53 PDT |
	|         | gcp-auth --alsologtostderr                                                                  |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| stop    | -p addons-725000                                                                            | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	| addons  | enable dashboard -p                                                                         | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	|         | addons-725000                                                                               |                      |         |         |                     |                     |
	| addons  | disable dashboard -p                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	|         | addons-725000                                                                               |                      |         |         |                     |                     |
	| addons  | disable gvisor -p                                                                           | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	|         | addons-725000                                                                               |                      |         |         |                     |                     |
	| delete  | -p addons-725000                                                                            | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	| start   | -p nospam-191000 -n=1 --memory=2250 --wait=false                                            | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | --log_dir=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                    |                      |         |         |                     |                     |
	|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
	| start   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
	|         | start --dry-run                                                                             |                      |         |         |                     |                     |
	| start   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
	|         | start --dry-run                                                                             |                      |         |         |                     |                     |
	| start   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
	|         | start --dry-run                                                                             |                      |         |         |                     |                     |
	| pause   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
	|         | pause                                                                                       |                      |         |         |                     |                     |
	| pause   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
	|         | pause                                                                                       |                      |         |         |                     |                     |
	| pause   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
	|         | pause                                                                                       |                      |         |         |                     |                     |
	| unpause | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
	|         | unpause                                                                                     |                      |         |         |                     |                     |
	| unpause | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
	|         | unpause                                                                                     |                      |         |         |                     |                     |
	| unpause | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
	|         | unpause                                                                                     |                      |         |         |                     |                     |
	| stop    | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
	|         | stop                                                                                        |                      |         |         |                     |                     |
	| stop    | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
	|         | stop                                                                                        |                      |         |         |                     |                     |
	| stop    | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
	|         | stop                                                                                        |                      |         |         |                     |                     |
	| delete  | -p nospam-191000                                                                            | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	| start   | -p functional-196000                                                                        | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | --memory=4000                                                                               |                      |         |         |                     |                     |
	|         | --apiserver-port=8441                                                                       |                      |         |         |                     |                     |
	|         | --wait=all --driver=hyperkit                                                                |                      |         |         |                     |                     |
	| start   | -p functional-196000                                                                        | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | --alsologtostderr -v=8                                                                      |                      |         |         |                     |                     |
	| cache   | functional-196000 cache add                                                                 | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
	| cache   | functional-196000 cache add                                                                 | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
	| cache   | functional-196000 cache add                                                                 | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| cache   | functional-196000 cache add                                                                 | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	|         | minikube-local-cache-test:functional-196000                                                 |                      |         |         |                     |                     |
	| cache   | functional-196000 cache delete                                                              | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	|         | minikube-local-cache-test:functional-196000                                                 |                      |         |         |                     |                     |
	| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
	| cache   | list                                                                                        | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	| ssh     | functional-196000 ssh sudo                                                                  | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | crictl images                                                                               |                      |         |         |                     |                     |
	| ssh     | functional-196000                                                                           | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | ssh sudo docker rmi                                                                         |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| ssh     | functional-196000 ssh                                                                       | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| cache   | functional-196000 cache reload                                                              | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	| ssh     | functional-196000 ssh                                                                       | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
	| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| kubectl | functional-196000 kubectl --                                                                | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
	|         | --context functional-196000                                                                 |                      |         |         |                     |                     |
	|         | get pods                                                                                    |                      |         |         |                     |                     |
	| start   | -p functional-196000                                                                        | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:54 PDT |                     |
	|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision                    |                      |         |         |                     |                     |
	|         | --wait=all                                                                                  |                      |         |         |                     |                     |
	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/11 03:54:01
	Running on machine: MacOS-Agent-1
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0311 03:54:01.026056   37370 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:54:01.026308   37370 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:54:01.026311   37370 out.go:304] Setting ErrFile to fd 2...
	I0311 03:54:01.026313   37370 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:54:01.026492   37370 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:54:01.027917   37370 out.go:298] Setting JSON to false
	I0311 03:54:01.050139   37370 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":10411,"bootTime":1710144030,"procs":463,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 03:54:01.050222   37370 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 03:54:01.073401   37370 out.go:177] * [functional-196000] minikube v1.32.0 on Darwin 14.3.1
	I0311 03:54:01.137126   37370 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 03:54:01.115515   37370 notify.go:220] Checking for updates...
	I0311 03:54:01.179869   37370 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 03:54:01.201376   37370 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 03:54:01.223225   37370 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 03:54:01.244045   37370 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 03:54:01.265163   37370 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 03:54:01.286932   37370 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:54:01.287117   37370 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 03:54:01.287760   37370 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:54:01.287905   37370 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:54:01.296636   37370 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62052
	I0311 03:54:01.296976   37370 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:54:01.297393   37370 main.go:141] libmachine: Using API Version  1
	I0311 03:54:01.297407   37370 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:54:01.297652   37370 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:54:01.297757   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
	I0311 03:54:01.326166   37370 out.go:177] * Using the hyperkit driver based on existing profile
	I0311 03:54:01.348058   37370 start.go:297] selected driver: hyperkit
	I0311 03:54:01.348078   37370 start.go:901] validating driver "hyperkit" against &{Name:functional-196000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-196000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 03:54:01.348239   37370 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 03:54:01.348450   37370 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 03:54:01.348638   37370 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 03:54:01.357768   37370 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0311 03:54:01.361521   37370 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:54:01.361537   37370 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0311 03:54:01.364231   37370 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 03:54:01.364307   37370 cni.go:84] Creating CNI manager for ""
	I0311 03:54:01.364320   37370 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 03:54:01.364395   37370 start.go:340] cluster config:
	{Name:functional-196000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-196000 Namespace:default APISe
rverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 03:54:01.364479   37370 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 03:54:01.407107   37370 out.go:177] * Starting "functional-196000" primary control-plane node in "functional-196000" cluster
	I0311 03:54:01.428241   37370 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 03:54:01.428303   37370 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 03:54:01.428350   37370 cache.go:56] Caching tarball of preloaded images
	I0311 03:54:01.428509   37370 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 03:54:01.428519   37370 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 03:54:01.428615   37370 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/functional-196000/config.json ...
	I0311 03:54:01.429151   37370 start.go:360] acquireMachinesLock for functional-196000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 03:54:01.429246   37370 start.go:364] duration metric: took 79.471µs to acquireMachinesLock for "functional-196000"
	I0311 03:54:01.429278   37370 start.go:96] Skipping create...Using existing machine configuration
	I0311 03:54:01.429290   37370 fix.go:54] fixHost starting: 
	I0311 03:54:01.429710   37370 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:54:01.429736   37370 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:54:01.438401   37370 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62054
	I0311 03:54:01.438781   37370 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:54:01.439154   37370 main.go:141] libmachine: Using API Version  1
	I0311 03:54:01.439162   37370 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:54:01.439393   37370 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:54:01.439553   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
	I0311 03:54:01.439664   37370 main.go:141] libmachine: (functional-196000) Calling .GetState
	I0311 03:54:01.439741   37370 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:54:01.439759   37370 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
	I0311 03:54:01.439792   37370 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
	I0311 03:54:01.439801   37370 fix.go:112] recreateIfNeeded on functional-196000: state=Stopped err=<nil>
	I0311 03:54:01.439815   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
	W0311 03:54:01.439899   37370 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 03:54:01.460967   37370 out.go:177] * Restarting existing hyperkit VM for "functional-196000" ...
	I0311 03:54:01.503059   37370 main.go:141] libmachine: (functional-196000) Calling .Start
	I0311 03:54:01.503300   37370 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:54:01.503357   37370 main.go:141] libmachine: (functional-196000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.pid
	I0311 03:54:01.503446   37370 main.go:141] libmachine: (functional-196000) DBG | Using UUID 339ea83c-5a24-4eb3-9e6c-ee0a4b7b8e7f
	I0311 03:54:01.521881   37370 main.go:141] libmachine: (functional-196000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 03:54:01.521995   37370 fix.go:56] duration metric: took 92.704398ms for fixHost
	I0311 03:54:01.522001   37370 start.go:83] releasing machines lock for "functional-196000", held for 92.747476ms
	W0311 03:54:01.522015   37370 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0311 03:54:01.522066   37370 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 03:54:01.522074   37370 start.go:728] Will try again in 5 seconds ...
	I0311 03:54:06.522310   37370 start.go:360] acquireMachinesLock for functional-196000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 03:54:06.522456   37370 start.go:364] duration metric: took 126.332µs to acquireMachinesLock for "functional-196000"
	I0311 03:54:06.522503   37370 start.go:96] Skipping create...Using existing machine configuration
	I0311 03:54:06.522508   37370 fix.go:54] fixHost starting: 
	I0311 03:54:06.522943   37370 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:54:06.522980   37370 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:54:06.533315   37370 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62056
	I0311 03:54:06.533820   37370 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:54:06.534275   37370 main.go:141] libmachine: Using API Version  1
	I0311 03:54:06.534305   37370 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:54:06.534540   37370 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:54:06.534636   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
	I0311 03:54:06.534720   37370 main.go:141] libmachine: (functional-196000) Calling .GetState
	I0311 03:54:06.534799   37370 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:54:06.534821   37370 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
	I0311 03:54:06.534825   37370 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
	I0311 03:54:06.534850   37370 fix.go:112] recreateIfNeeded on functional-196000: state=Stopped err=<nil>
	I0311 03:54:06.534857   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
	W0311 03:54:06.534951   37370 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 03:54:06.556821   37370 out.go:177] * Restarting existing hyperkit VM for "functional-196000" ...
	I0311 03:54:06.578556   37370 main.go:141] libmachine: (functional-196000) Calling .Start
	I0311 03:54:06.578806   37370 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:54:06.578827   37370 main.go:141] libmachine: (functional-196000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.pid
	I0311 03:54:06.578871   37370 main.go:141] libmachine: (functional-196000) DBG | Using UUID 339ea83c-5a24-4eb3-9e6c-ee0a4b7b8e7f
	I0311 03:54:06.580507   37370 main.go:141] libmachine: (functional-196000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 03:54:06.580588   37370 fix.go:56] duration metric: took 58.078151ms for fixHost
	I0311 03:54:06.580595   37370 start.go:83] releasing machines lock for "functional-196000", held for 58.131609ms
	W0311 03:54:06.580685   37370 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-196000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 03:54:06.623771   37370 out.go:177] 
	W0311 03:54:06.645898   37370 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 03:54:06.645996   37370 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 03:54:06.646018   37370 out.go:239] * Related issues:
	W0311 03:54:06.646062   37370 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	W0311 03:54:06.646088   37370 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	I0311 03:54:06.667553   37370 out.go:177] 
	
	
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1234: out/minikube-darwin-amd64 -p functional-196000 logs failed: exit status 83
functional_test.go:1224: expected minikube logs to include word: -"Linux"- but got 
***
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| delete  | -p download-only-023000                                                                     | download-only-023000 | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT | 11 Mar 24 03:47 PDT |
| start   | --download-only -p                                                                          | binary-mirror-399000 | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT |                     |
|         | binary-mirror-399000                                                                        |                      |         |         |                     |                     |
|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |
|         | --binary-mirror                                                                             |                      |         |         |                     |                     |
|         | http://127.0.0.1:61560                                                                      |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| delete  | -p binary-mirror-399000                                                                     | binary-mirror-399000 | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT | 11 Mar 24 03:47 PDT |
| addons  | enable dashboard -p                                                                         | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT |                     |
|         | addons-725000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT |                     |
|         | addons-725000                                                                               |                      |         |         |                     |                     |
| start   | -p addons-725000 --wait=true                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT | 11 Mar 24 03:51 PDT |
|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |
|         | --addons=registry                                                                           |                      |         |         |                     |                     |
|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |
|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |
|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |
|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |
|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |
|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |
|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |
|         | --addons=nvidia-device-plugin                                                               |                      |         |         |                     |                     |
|         | --addons=yakd --driver=hyperkit                                                             |                      |         |         |                     |                     |
|         |  --addons=ingress                                                                           |                      |         |         |                     |                     |
|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |
|         | --addons=helm-tiller                                                                        |                      |         |         |                     |                     |
| ip      | addons-725000 ip                                                                            | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:51 PDT |
| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:51 PDT |
|         | registry --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:51 PDT |
|         | helm-tiller --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-725000 addons                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:51 PDT |
|         | disable metrics-server                                                                      |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable inspektor-gadget -p                                                                 | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:52 PDT |
|         | addons-725000                                                                               |                      |         |         |                     |                     |
| addons  | addons-725000 addons                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| ssh     | addons-725000 ssh curl -s                                                                   | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | http://127.0.0.1/ -H 'Host:                                                                 |                      |         |         |                     |                     |
|         | nginx.example.com'                                                                          |                      |         |         |                     |                     |
| ip      | addons-725000 ip                                                                            | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | ingress-dns --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | ingress --alsologtostderr -v=1                                                              |                      |         |         |                     |                     |
| addons  | addons-725000 addons                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| ssh     | addons-725000 ssh cat                                                                       | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | /opt/local-path-provisioner/pvc-1e753a32-583c-4106-8a48-b945667fce5e_default_test-pvc/file1 |                      |         |         |                     |                     |
| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | enable headlamp                                                                             | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | -p addons-725000                                                                            |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable nvidia-device-plugin                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | -p addons-725000                                                                            |                      |         |         |                     |                     |
| addons  | disable cloud-spanner -p                                                                    | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | addons-725000                                                                               |                      |         |         |                     |                     |
| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:53 PDT |
|         | gcp-auth --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| stop    | -p addons-725000                                                                            | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
| addons  | enable dashboard -p                                                                         | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | addons-725000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | addons-725000                                                                               |                      |         |         |                     |                     |
| addons  | disable gvisor -p                                                                           | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | addons-725000                                                                               |                      |         |         |                     |                     |
| delete  | -p addons-725000                                                                            | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
| start   | -p nospam-191000 -n=1 --memory=2250 --wait=false                                            | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | --log_dir=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                    |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| start   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| pause   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| unpause | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| stop    | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| delete  | -p nospam-191000                                                                            | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
| start   | -p functional-196000                                                                        | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | --memory=4000                                                                               |                      |         |         |                     |                     |
|         | --apiserver-port=8441                                                                       |                      |         |         |                     |                     |
|         | --wait=all --driver=hyperkit                                                                |                      |         |         |                     |                     |
| start   | -p functional-196000                                                                        | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | --alsologtostderr -v=8                                                                      |                      |         |         |                     |                     |
| cache   | functional-196000 cache add                                                                 | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | functional-196000 cache add                                                                 | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | functional-196000 cache add                                                                 | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-196000 cache add                                                                 | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | minikube-local-cache-test:functional-196000                                                 |                      |         |         |                     |                     |
| cache   | functional-196000 cache delete                                                              | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | minikube-local-cache-test:functional-196000                                                 |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | list                                                                                        | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
| ssh     | functional-196000 ssh sudo                                                                  | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | crictl images                                                                               |                      |         |         |                     |                     |
| ssh     | functional-196000                                                                           | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | ssh sudo docker rmi                                                                         |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| ssh     | functional-196000 ssh                                                                       | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-196000 cache reload                                                              | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
| ssh     | functional-196000 ssh                                                                       | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| kubectl | functional-196000 kubectl --                                                                | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | --context functional-196000                                                                 |                      |         |         |                     |                     |
|         | get pods                                                                                    |                      |         |         |                     |                     |
| start   | -p functional-196000                                                                        | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:54 PDT |                     |
|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision                    |                      |         |         |                     |                     |
|         | --wait=all                                                                                  |                      |         |         |                     |                     |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

                                                
                                                

                                                
                                                
==> Last Start <==
Log file created at: 2024/03/11 03:54:01
Running on machine: MacOS-Agent-1
Binary: Built with gc go1.22.0 for darwin/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0311 03:54:01.026056   37370 out.go:291] Setting OutFile to fd 1 ...
I0311 03:54:01.026308   37370 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:54:01.026311   37370 out.go:304] Setting ErrFile to fd 2...
I0311 03:54:01.026313   37370 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:54:01.026492   37370 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
I0311 03:54:01.027917   37370 out.go:298] Setting JSON to false
I0311 03:54:01.050139   37370 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":10411,"bootTime":1710144030,"procs":463,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
W0311 03:54:01.050222   37370 start.go:137] gopshost.Virtualization returned error: not implemented yet
I0311 03:54:01.073401   37370 out.go:177] * [functional-196000] minikube v1.32.0 on Darwin 14.3.1
I0311 03:54:01.137126   37370 out.go:177]   - MINIKUBE_LOCATION=18350
I0311 03:54:01.115515   37370 notify.go:220] Checking for updates...
I0311 03:54:01.179869   37370 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
I0311 03:54:01.201376   37370 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
I0311 03:54:01.223225   37370 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0311 03:54:01.244045   37370 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
I0311 03:54:01.265163   37370 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
I0311 03:54:01.286932   37370 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:54:01.287117   37370 driver.go:392] Setting default libvirt URI to qemu:///system
I0311 03:54:01.287760   37370 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:54:01.287905   37370 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0311 03:54:01.296636   37370 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62052
I0311 03:54:01.296976   37370 main.go:141] libmachine: () Calling .GetVersion
I0311 03:54:01.297393   37370 main.go:141] libmachine: Using API Version  1
I0311 03:54:01.297407   37370 main.go:141] libmachine: () Calling .SetConfigRaw
I0311 03:54:01.297652   37370 main.go:141] libmachine: () Calling .GetMachineName
I0311 03:54:01.297757   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
I0311 03:54:01.326166   37370 out.go:177] * Using the hyperkit driver based on existing profile
I0311 03:54:01.348058   37370 start.go:297] selected driver: hyperkit
I0311 03:54:01.348078   37370 start.go:901] validating driver "hyperkit" against &{Name:functional-196000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:functional-196000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0311 03:54:01.348239   37370 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0311 03:54:01.348450   37370 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0311 03:54:01.348638   37370 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I0311 03:54:01.357768   37370 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
I0311 03:54:01.361521   37370 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:54:01.361537   37370 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I0311 03:54:01.364231   37370 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0311 03:54:01.364307   37370 cni.go:84] Creating CNI manager for ""
I0311 03:54:01.364320   37370 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0311 03:54:01.364395   37370 start.go:340] cluster config:
{Name:functional-196000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-196000 Namespace:default APISer
verHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPor
t:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0311 03:54:01.364479   37370 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0311 03:54:01.407107   37370 out.go:177] * Starting "functional-196000" primary control-plane node in "functional-196000" cluster
I0311 03:54:01.428241   37370 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
I0311 03:54:01.428303   37370 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
I0311 03:54:01.428350   37370 cache.go:56] Caching tarball of preloaded images
I0311 03:54:01.428509   37370 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0311 03:54:01.428519   37370 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
I0311 03:54:01.428615   37370 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/functional-196000/config.json ...
I0311 03:54:01.429151   37370 start.go:360] acquireMachinesLock for functional-196000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0311 03:54:01.429246   37370 start.go:364] duration metric: took 79.471µs to acquireMachinesLock for "functional-196000"
I0311 03:54:01.429278   37370 start.go:96] Skipping create...Using existing machine configuration
I0311 03:54:01.429290   37370 fix.go:54] fixHost starting: 
I0311 03:54:01.429710   37370 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:54:01.429736   37370 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0311 03:54:01.438401   37370 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62054
I0311 03:54:01.438781   37370 main.go:141] libmachine: () Calling .GetVersion
I0311 03:54:01.439154   37370 main.go:141] libmachine: Using API Version  1
I0311 03:54:01.439162   37370 main.go:141] libmachine: () Calling .SetConfigRaw
I0311 03:54:01.439393   37370 main.go:141] libmachine: () Calling .GetMachineName
I0311 03:54:01.439553   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
I0311 03:54:01.439664   37370 main.go:141] libmachine: (functional-196000) Calling .GetState
I0311 03:54:01.439741   37370 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:54:01.439759   37370 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
I0311 03:54:01.439792   37370 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
I0311 03:54:01.439801   37370 fix.go:112] recreateIfNeeded on functional-196000: state=Stopped err=<nil>
I0311 03:54:01.439815   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
W0311 03:54:01.439899   37370 fix.go:138] unexpected machine state, will restart: <nil>
I0311 03:54:01.460967   37370 out.go:177] * Restarting existing hyperkit VM for "functional-196000" ...
I0311 03:54:01.503059   37370 main.go:141] libmachine: (functional-196000) Calling .Start
I0311 03:54:01.503300   37370 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:54:01.503357   37370 main.go:141] libmachine: (functional-196000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.pid
I0311 03:54:01.503446   37370 main.go:141] libmachine: (functional-196000) DBG | Using UUID 339ea83c-5a24-4eb3-9e6c-ee0a4b7b8e7f
I0311 03:54:01.521881   37370 main.go:141] libmachine: (functional-196000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0311 03:54:01.521995   37370 fix.go:56] duration metric: took 92.704398ms for fixHost
I0311 03:54:01.522001   37370 start.go:83] releasing machines lock for "functional-196000", held for 92.747476ms
W0311 03:54:01.522015   37370 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
W0311 03:54:01.522066   37370 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0311 03:54:01.522074   37370 start.go:728] Will try again in 5 seconds ...
I0311 03:54:06.522310   37370 start.go:360] acquireMachinesLock for functional-196000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0311 03:54:06.522456   37370 start.go:364] duration metric: took 126.332µs to acquireMachinesLock for "functional-196000"
I0311 03:54:06.522503   37370 start.go:96] Skipping create...Using existing machine configuration
I0311 03:54:06.522508   37370 fix.go:54] fixHost starting: 
I0311 03:54:06.522943   37370 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:54:06.522980   37370 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0311 03:54:06.533315   37370 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62056
I0311 03:54:06.533820   37370 main.go:141] libmachine: () Calling .GetVersion
I0311 03:54:06.534275   37370 main.go:141] libmachine: Using API Version  1
I0311 03:54:06.534305   37370 main.go:141] libmachine: () Calling .SetConfigRaw
I0311 03:54:06.534540   37370 main.go:141] libmachine: () Calling .GetMachineName
I0311 03:54:06.534636   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
I0311 03:54:06.534720   37370 main.go:141] libmachine: (functional-196000) Calling .GetState
I0311 03:54:06.534799   37370 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:54:06.534821   37370 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
I0311 03:54:06.534825   37370 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
I0311 03:54:06.534850   37370 fix.go:112] recreateIfNeeded on functional-196000: state=Stopped err=<nil>
I0311 03:54:06.534857   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
W0311 03:54:06.534951   37370 fix.go:138] unexpected machine state, will restart: <nil>
I0311 03:54:06.556821   37370 out.go:177] * Restarting existing hyperkit VM for "functional-196000" ...
I0311 03:54:06.578556   37370 main.go:141] libmachine: (functional-196000) Calling .Start
I0311 03:54:06.578806   37370 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:54:06.578827   37370 main.go:141] libmachine: (functional-196000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.pid
I0311 03:54:06.578871   37370 main.go:141] libmachine: (functional-196000) DBG | Using UUID 339ea83c-5a24-4eb3-9e6c-ee0a4b7b8e7f
I0311 03:54:06.580507   37370 main.go:141] libmachine: (functional-196000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0311 03:54:06.580588   37370 fix.go:56] duration metric: took 58.078151ms for fixHost
I0311 03:54:06.580595   37370 start.go:83] releasing machines lock for "functional-196000", held for 58.131609ms
W0311 03:54:06.580685   37370 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-196000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0311 03:54:06.623771   37370 out.go:177] 
W0311 03:54:06.645898   37370 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
W0311 03:54:06.645996   37370 out.go:239] * Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
W0311 03:54:06.646018   37370 out.go:239] * Related issues:
W0311 03:54:06.646062   37370 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
W0311 03:54:06.646088   37370 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
I0311 03:54:06.667553   37370 out.go:177] 

                                                
                                                

                                                
                                                
* The control-plane node functional-196000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-196000"
***
--- FAIL: TestFunctional/serial/LogsCmd (0.35s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (0.37s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 logs --file /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalserialLogsFileCmd1183455550/001/logs.txt
functional_test.go:1224: expected minikube logs to include word: -"Linux"- but got 
***
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| delete  | -p download-only-023000                                                                     | download-only-023000 | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT | 11 Mar 24 03:47 PDT |
| start   | --download-only -p                                                                          | binary-mirror-399000 | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT |                     |
|         | binary-mirror-399000                                                                        |                      |         |         |                     |                     |
|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |
|         | --binary-mirror                                                                             |                      |         |         |                     |                     |
|         | http://127.0.0.1:61560                                                                      |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| delete  | -p binary-mirror-399000                                                                     | binary-mirror-399000 | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT | 11 Mar 24 03:47 PDT |
| addons  | enable dashboard -p                                                                         | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT |                     |
|         | addons-725000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT |                     |
|         | addons-725000                                                                               |                      |         |         |                     |                     |
| start   | -p addons-725000 --wait=true                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT | 11 Mar 24 03:51 PDT |
|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |
|         | --addons=registry                                                                           |                      |         |         |                     |                     |
|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |
|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |
|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |
|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |
|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |
|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |
|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |
|         | --addons=nvidia-device-plugin                                                               |                      |         |         |                     |                     |
|         | --addons=yakd --driver=hyperkit                                                             |                      |         |         |                     |                     |
|         |  --addons=ingress                                                                           |                      |         |         |                     |                     |
|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |
|         | --addons=helm-tiller                                                                        |                      |         |         |                     |                     |
| ip      | addons-725000 ip                                                                            | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:51 PDT |
| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:51 PDT |
|         | registry --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:51 PDT |
|         | helm-tiller --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-725000 addons                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:51 PDT |
|         | disable metrics-server                                                                      |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable inspektor-gadget -p                                                                 | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:51 PDT | 11 Mar 24 03:52 PDT |
|         | addons-725000                                                                               |                      |         |         |                     |                     |
| addons  | addons-725000 addons                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| ssh     | addons-725000 ssh curl -s                                                                   | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | http://127.0.0.1/ -H 'Host:                                                                 |                      |         |         |                     |                     |
|         | nginx.example.com'                                                                          |                      |         |         |                     |                     |
| ip      | addons-725000 ip                                                                            | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | ingress-dns --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | ingress --alsologtostderr -v=1                                                              |                      |         |         |                     |                     |
| addons  | addons-725000 addons                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| ssh     | addons-725000 ssh cat                                                                       | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | /opt/local-path-provisioner/pvc-1e753a32-583c-4106-8a48-b945667fce5e_default_test-pvc/file1 |                      |         |         |                     |                     |
| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | enable headlamp                                                                             | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | -p addons-725000                                                                            |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable nvidia-device-plugin                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | -p addons-725000                                                                            |                      |         |         |                     |                     |
| addons  | disable cloud-spanner -p                                                                    | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:52 PDT |
|         | addons-725000                                                                               |                      |         |         |                     |                     |
| addons  | addons-725000 addons disable                                                                | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:52 PDT | 11 Mar 24 03:53 PDT |
|         | gcp-auth --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| stop    | -p addons-725000                                                                            | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
| addons  | enable dashboard -p                                                                         | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | addons-725000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | addons-725000                                                                               |                      |         |         |                     |                     |
| addons  | disable gvisor -p                                                                           | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | addons-725000                                                                               |                      |         |         |                     |                     |
| delete  | -p addons-725000                                                                            | addons-725000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
| start   | -p nospam-191000 -n=1 --memory=2250 --wait=false                                            | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | --log_dir=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                    |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| start   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| pause   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| unpause | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| stop    | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-191000 --log_dir                                                                     | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| delete  | -p nospam-191000                                                                            | nospam-191000        | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
| start   | -p functional-196000                                                                        | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | --memory=4000                                                                               |                      |         |         |                     |                     |
|         | --apiserver-port=8441                                                                       |                      |         |         |                     |                     |
|         | --wait=all --driver=hyperkit                                                                |                      |         |         |                     |                     |
| start   | -p functional-196000                                                                        | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | --alsologtostderr -v=8                                                                      |                      |         |         |                     |                     |
| cache   | functional-196000 cache add                                                                 | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | functional-196000 cache add                                                                 | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | functional-196000 cache add                                                                 | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-196000 cache add                                                                 | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | minikube-local-cache-test:functional-196000                                                 |                      |         |         |                     |                     |
| cache   | functional-196000 cache delete                                                              | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | minikube-local-cache-test:functional-196000                                                 |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | list                                                                                        | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
| ssh     | functional-196000 ssh sudo                                                                  | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | crictl images                                                                               |                      |         |         |                     |                     |
| ssh     | functional-196000                                                                           | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | ssh sudo docker rmi                                                                         |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| ssh     | functional-196000 ssh                                                                       | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-196000 cache reload                                                              | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
| ssh     | functional-196000 ssh                                                                       | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT | 11 Mar 24 03:53 PDT |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| kubectl | functional-196000 kubectl --                                                                | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:53 PDT |                     |
|         | --context functional-196000                                                                 |                      |         |         |                     |                     |
|         | get pods                                                                                    |                      |         |         |                     |                     |
| start   | -p functional-196000                                                                        | functional-196000    | jenkins | v1.32.0 | 11 Mar 24 03:54 PDT |                     |
|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision                    |                      |         |         |                     |                     |
|         | --wait=all                                                                                  |                      |         |         |                     |                     |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

                                                
                                                

                                                
                                                
==> Last Start <==
Log file created at: 2024/03/11 03:54:01
Running on machine: MacOS-Agent-1
Binary: Built with gc go1.22.0 for darwin/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0311 03:54:01.026056   37370 out.go:291] Setting OutFile to fd 1 ...
I0311 03:54:01.026308   37370 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:54:01.026311   37370 out.go:304] Setting ErrFile to fd 2...
I0311 03:54:01.026313   37370 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:54:01.026492   37370 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
I0311 03:54:01.027917   37370 out.go:298] Setting JSON to false
I0311 03:54:01.050139   37370 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":10411,"bootTime":1710144030,"procs":463,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
W0311 03:54:01.050222   37370 start.go:137] gopshost.Virtualization returned error: not implemented yet
I0311 03:54:01.073401   37370 out.go:177] * [functional-196000] minikube v1.32.0 on Darwin 14.3.1
I0311 03:54:01.137126   37370 out.go:177]   - MINIKUBE_LOCATION=18350
I0311 03:54:01.115515   37370 notify.go:220] Checking for updates...
I0311 03:54:01.179869   37370 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
I0311 03:54:01.201376   37370 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
I0311 03:54:01.223225   37370 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0311 03:54:01.244045   37370 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
I0311 03:54:01.265163   37370 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
I0311 03:54:01.286932   37370 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:54:01.287117   37370 driver.go:392] Setting default libvirt URI to qemu:///system
I0311 03:54:01.287760   37370 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:54:01.287905   37370 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0311 03:54:01.296636   37370 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62052
I0311 03:54:01.296976   37370 main.go:141] libmachine: () Calling .GetVersion
I0311 03:54:01.297393   37370 main.go:141] libmachine: Using API Version  1
I0311 03:54:01.297407   37370 main.go:141] libmachine: () Calling .SetConfigRaw
I0311 03:54:01.297652   37370 main.go:141] libmachine: () Calling .GetMachineName
I0311 03:54:01.297757   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
I0311 03:54:01.326166   37370 out.go:177] * Using the hyperkit driver based on existing profile
I0311 03:54:01.348058   37370 start.go:297] selected driver: hyperkit
I0311 03:54:01.348078   37370 start.go:901] validating driver "hyperkit" against &{Name:functional-196000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:functional-196000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0311 03:54:01.348239   37370 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0311 03:54:01.348450   37370 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0311 03:54:01.348638   37370 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I0311 03:54:01.357768   37370 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
I0311 03:54:01.361521   37370 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:54:01.361537   37370 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I0311 03:54:01.364231   37370 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0311 03:54:01.364307   37370 cni.go:84] Creating CNI manager for ""
I0311 03:54:01.364320   37370 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0311 03:54:01.364395   37370 start.go:340] cluster config:
{Name:functional-196000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-196000 Namespace:default APISer
verHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPor
t:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0311 03:54:01.364479   37370 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0311 03:54:01.407107   37370 out.go:177] * Starting "functional-196000" primary control-plane node in "functional-196000" cluster
I0311 03:54:01.428241   37370 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
I0311 03:54:01.428303   37370 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
I0311 03:54:01.428350   37370 cache.go:56] Caching tarball of preloaded images
I0311 03:54:01.428509   37370 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0311 03:54:01.428519   37370 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
I0311 03:54:01.428615   37370 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/functional-196000/config.json ...
I0311 03:54:01.429151   37370 start.go:360] acquireMachinesLock for functional-196000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0311 03:54:01.429246   37370 start.go:364] duration metric: took 79.471µs to acquireMachinesLock for "functional-196000"
I0311 03:54:01.429278   37370 start.go:96] Skipping create...Using existing machine configuration
I0311 03:54:01.429290   37370 fix.go:54] fixHost starting: 
I0311 03:54:01.429710   37370 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:54:01.429736   37370 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0311 03:54:01.438401   37370 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62054
I0311 03:54:01.438781   37370 main.go:141] libmachine: () Calling .GetVersion
I0311 03:54:01.439154   37370 main.go:141] libmachine: Using API Version  1
I0311 03:54:01.439162   37370 main.go:141] libmachine: () Calling .SetConfigRaw
I0311 03:54:01.439393   37370 main.go:141] libmachine: () Calling .GetMachineName
I0311 03:54:01.439553   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
I0311 03:54:01.439664   37370 main.go:141] libmachine: (functional-196000) Calling .GetState
I0311 03:54:01.439741   37370 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:54:01.439759   37370 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
I0311 03:54:01.439792   37370 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
I0311 03:54:01.439801   37370 fix.go:112] recreateIfNeeded on functional-196000: state=Stopped err=<nil>
I0311 03:54:01.439815   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
W0311 03:54:01.439899   37370 fix.go:138] unexpected machine state, will restart: <nil>
I0311 03:54:01.460967   37370 out.go:177] * Restarting existing hyperkit VM for "functional-196000" ...
I0311 03:54:01.503059   37370 main.go:141] libmachine: (functional-196000) Calling .Start
I0311 03:54:01.503300   37370 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:54:01.503357   37370 main.go:141] libmachine: (functional-196000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.pid
I0311 03:54:01.503446   37370 main.go:141] libmachine: (functional-196000) DBG | Using UUID 339ea83c-5a24-4eb3-9e6c-ee0a4b7b8e7f
I0311 03:54:01.521881   37370 main.go:141] libmachine: (functional-196000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0311 03:54:01.521995   37370 fix.go:56] duration metric: took 92.704398ms for fixHost
I0311 03:54:01.522001   37370 start.go:83] releasing machines lock for "functional-196000", held for 92.747476ms
W0311 03:54:01.522015   37370 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
W0311 03:54:01.522066   37370 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0311 03:54:01.522074   37370 start.go:728] Will try again in 5 seconds ...
I0311 03:54:06.522310   37370 start.go:360] acquireMachinesLock for functional-196000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0311 03:54:06.522456   37370 start.go:364] duration metric: took 126.332µs to acquireMachinesLock for "functional-196000"
I0311 03:54:06.522503   37370 start.go:96] Skipping create...Using existing machine configuration
I0311 03:54:06.522508   37370 fix.go:54] fixHost starting: 
I0311 03:54:06.522943   37370 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:54:06.522980   37370 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0311 03:54:06.533315   37370 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62056
I0311 03:54:06.533820   37370 main.go:141] libmachine: () Calling .GetVersion
I0311 03:54:06.534275   37370 main.go:141] libmachine: Using API Version  1
I0311 03:54:06.534305   37370 main.go:141] libmachine: () Calling .SetConfigRaw
I0311 03:54:06.534540   37370 main.go:141] libmachine: () Calling .GetMachineName
I0311 03:54:06.534636   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
I0311 03:54:06.534720   37370 main.go:141] libmachine: (functional-196000) Calling .GetState
I0311 03:54:06.534799   37370 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:54:06.534821   37370 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
I0311 03:54:06.534825   37370 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
I0311 03:54:06.534850   37370 fix.go:112] recreateIfNeeded on functional-196000: state=Stopped err=<nil>
I0311 03:54:06.534857   37370 main.go:141] libmachine: (functional-196000) Calling .DriverName
W0311 03:54:06.534951   37370 fix.go:138] unexpected machine state, will restart: <nil>
I0311 03:54:06.556821   37370 out.go:177] * Restarting existing hyperkit VM for "functional-196000" ...
I0311 03:54:06.578556   37370 main.go:141] libmachine: (functional-196000) Calling .Start
I0311 03:54:06.578806   37370 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:54:06.578827   37370 main.go:141] libmachine: (functional-196000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.pid
I0311 03:54:06.578871   37370 main.go:141] libmachine: (functional-196000) DBG | Using UUID 339ea83c-5a24-4eb3-9e6c-ee0a4b7b8e7f
I0311 03:54:06.580507   37370 main.go:141] libmachine: (functional-196000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0311 03:54:06.580588   37370 fix.go:56] duration metric: took 58.078151ms for fixHost
I0311 03:54:06.580595   37370 start.go:83] releasing machines lock for "functional-196000", held for 58.131609ms
W0311 03:54:06.580685   37370 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-196000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0311 03:54:06.623771   37370 out.go:177] 
W0311 03:54:06.645898   37370 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
W0311 03:54:06.645996   37370 out.go:239] * Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
W0311 03:54:06.646018   37370 out.go:239] * Related issues:
W0311 03:54:06.646062   37370 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
W0311 03:54:06.646088   37370 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
I0311 03:54:06.667553   37370 out.go:177] 

                                                
                                                

                                                
                                                
***
--- FAIL: TestFunctional/serial/LogsFileCmd (0.37s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-196000 apply -f testdata/invalidsvc.yaml
functional_test.go:2317: (dbg) Non-zero exit: kubectl --context functional-196000 apply -f testdata/invalidsvc.yaml: exit status 1 (37.399624ms)

                                                
                                                
** stderr ** 
	error: context "functional-196000" does not exist

                                                
                                                
** /stderr **
functional_test.go:2319: kubectl --context functional-196000 apply -f testdata/invalidsvc.yaml failed: exit status 1
--- FAIL: TestFunctional/serial/InvalidService (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (0.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-196000 --alsologtostderr -v=1]
functional_test.go:914: output didn't produce a URL
functional_test.go:906: (dbg) stopping [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-196000 --alsologtostderr -v=1] ...
functional_test.go:906: (dbg) [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-196000 --alsologtostderr -v=1] stdout:
functional_test.go:906: (dbg) [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-196000 --alsologtostderr -v=1] stderr:
I0311 03:55:06.374634   37799 out.go:291] Setting OutFile to fd 1 ...
I0311 03:55:06.374832   37799 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:55:06.374837   37799 out.go:304] Setting ErrFile to fd 2...
I0311 03:55:06.374841   37799 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:55:06.375026   37799 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
I0311 03:55:06.375428   37799 mustload.go:65] Loading cluster: functional-196000
I0311 03:55:06.375700   37799 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:55:06.376046   37799 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:55:06.376096   37799 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0311 03:55:06.383709   37799 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62285
I0311 03:55:06.384112   37799 main.go:141] libmachine: () Calling .GetVersion
I0311 03:55:06.384530   37799 main.go:141] libmachine: Using API Version  1
I0311 03:55:06.384560   37799 main.go:141] libmachine: () Calling .SetConfigRaw
I0311 03:55:06.384800   37799 main.go:141] libmachine: () Calling .GetMachineName
I0311 03:55:06.384913   37799 main.go:141] libmachine: (functional-196000) Calling .GetState
I0311 03:55:06.385000   37799 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:55:06.385028   37799 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
I0311 03:55:06.385034   37799 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
I0311 03:55:06.407000   37799 out.go:177] * The control-plane node functional-196000 host is not running: state=Stopped
I0311 03:55:06.428616   37799 out.go:177]   To start a cluster, run: "minikube start -p functional-196000"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (74.790257ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/DashboardCmd (0.33s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (0.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 status
functional_test.go:850: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 status: exit status 7 (75.902391ms)

                                                
                                                
-- stdout --
	functional-196000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
functional_test.go:852: failed to run minikube status. args "out/minikube-darwin-amd64 -p functional-196000 status" : exit status 7
functional_test.go:856: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:856: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}: exit status 7 (75.126928ms)

                                                
                                                
-- stdout --
	host:Stopped,kublet:Stopped,apiserver:Stopped,kubeconfig:Stopped

                                                
                                                
-- /stdout --
functional_test.go:858: failed to run minikube status with custom format: args "out/minikube-darwin-amd64 -p functional-196000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}": exit status 7
functional_test.go:868: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 status -o json
functional_test.go:868: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 status -o json: exit status 7 (75.796196ms)

                                                
                                                
-- stdout --
	{"Name":"functional-196000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
functional_test.go:870: failed to run minikube status with json output. args "out/minikube-darwin-amd64 -p functional-196000 status -o json" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (75.444422ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/StatusCmd (0.30s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1625: (dbg) Run:  kubectl --context functional-196000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8
functional_test.go:1625: (dbg) Non-zero exit: kubectl --context functional-196000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8: exit status 1 (37.606526ms)

                                                
                                                
** stderr ** 
	error: context "functional-196000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1629: failed to create hello-node deployment with this command "kubectl --context functional-196000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8": exit status 1.
functional_test.go:1594: service test failed - dumping debug information
functional_test.go:1595: -----------------------service failure post-mortem--------------------------------
functional_test.go:1598: (dbg) Run:  kubectl --context functional-196000 describe po hello-node-connect
functional_test.go:1598: (dbg) Non-zero exit: kubectl --context functional-196000 describe po hello-node-connect: exit status 1 (37.532154ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-196000

                                                
                                                
** /stderr **
functional_test.go:1600: "kubectl --context functional-196000 describe po hello-node-connect" failed: exit status 1
functional_test.go:1602: hello-node pod describe:
functional_test.go:1604: (dbg) Run:  kubectl --context functional-196000 logs -l app=hello-node-connect
functional_test.go:1604: (dbg) Non-zero exit: kubectl --context functional-196000 logs -l app=hello-node-connect: exit status 1 (36.960779ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-196000

                                                
                                                
** /stderr **
functional_test.go:1606: "kubectl --context functional-196000 logs -l app=hello-node-connect" failed: exit status 1
functional_test.go:1608: hello-node logs:
functional_test.go:1610: (dbg) Run:  kubectl --context functional-196000 describe svc hello-node-connect
functional_test.go:1610: (dbg) Non-zero exit: kubectl --context functional-196000 describe svc hello-node-connect: exit status 1 (37.218265ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-196000

                                                
                                                
** /stderr **
functional_test.go:1612: "kubectl --context functional-196000 describe svc hello-node-connect" failed: exit status 1
functional_test.go:1614: hello-node svc describe:
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (75.448432ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/ServiceCmdConnect (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:45: failed waiting for storage-provisioner: client config: context "functional-196000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (76.706332ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/PersistentVolumeClaim (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1721: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "echo hello"
functional_test.go:1721: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "echo hello": exit status 83 (165.009353ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1726: failed to run an ssh command. args "out/minikube-darwin-amd64 -p functional-196000 ssh \"echo hello\"" : exit status 83
functional_test.go:1730: expected minikube ssh command output to be -"hello"- but got *"* The control-plane node functional-196000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-196000\"\n"*. args "out/minikube-darwin-amd64 -p functional-196000 ssh \"echo hello\""
functional_test.go:1738: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "cat /etc/hostname"
functional_test.go:1738: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "cat /etc/hostname": exit status 83 (144.293519ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1744: failed to run an ssh command. args "out/minikube-darwin-amd64 -p functional-196000 ssh \"cat /etc/hostname\"" : exit status 83
functional_test.go:1748: expected minikube ssh command output to be -"functional-196000"- but got *"* The control-plane node functional-196000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-196000\"\n"*. args "out/minikube-darwin-amd64 -p functional-196000 ssh \"cat /etc/hostname\""
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (81.516324ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/SSHCmd (0.39s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (0.96s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 cp testdata/cp-test.txt /home/docker/cp-test.txt: exit status 83 (156.1731ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-196000 cp testdata/cp-test.txt /home/docker/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh -n functional-196000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh -n functional-196000 "sudo cat /home/docker/cp-test.txt": exit status 83 (155.519107ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-196000 ssh -n functional-196000 \"sudo cat /home/docker/cp-test.txt\"" : exit status 83
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
strings.Join({
+ 	"* ",
	"T",
- 	"est file for checking file cp process",
+ 	"he control-plane node functional-196000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-196000\"\n",
}, "")
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 cp functional-196000:/home/docker/cp-test.txt /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelCpCmd3295981612/001/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 cp functional-196000:/home/docker/cp-test.txt /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelCpCmd3295981612/001/cp-test.txt: exit status 83 (160.963865ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-196000 cp functional-196000:/home/docker/cp-test.txt /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelCpCmd3295981612/001/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh -n functional-196000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh -n functional-196000 "sudo cat /home/docker/cp-test.txt": exit status 83 (164.052243ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-196000 ssh -n functional-196000 \"sudo cat /home/docker/cp-test.txt\"" : exit status 83
helpers_test.go:528: failed to read test file 'testdata/cp-test.txt' : open /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelCpCmd3295981612/001/cp-test.txt: no such file or directory
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
string(
- 	"* The control-plane node functional-196000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-196000\"\n",
+ 	"",
)
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt: exit status 83 (141.257586ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-196000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh -n functional-196000 "sudo cat /tmp/does/not/exist/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh -n functional-196000 "sudo cat /tmp/does/not/exist/cp-test.txt": exit status 83 (161.262694ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-196000 ssh -n functional-196000 \"sudo cat /tmp/does/not/exist/cp-test.txt\"" : exit status 83
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
strings.Join({
+ 	"* ",
	"T",
- 	"est file for checking file cp process",
+ 	"he control-plane node functional-196000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-196000\"\n",
}, "")
--- FAIL: TestFunctional/parallel/CpCmd (0.96s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1789: (dbg) Run:  kubectl --context functional-196000 replace --force -f testdata/mysql.yaml
functional_test.go:1789: (dbg) Non-zero exit: kubectl --context functional-196000 replace --force -f testdata/mysql.yaml: exit status 1 (44.424326ms)

                                                
                                                
** stderr ** 
	error: context "functional-196000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1791: failed to kubectl replace mysql: args "kubectl --context functional-196000 replace --force -f testdata/mysql.yaml" failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (107.009538ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/MySQL (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/36663/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /etc/test/nested/copy/36663/hosts"
functional_test.go:1927: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /etc/test/nested/copy/36663/hosts": exit status 83 (166.838318ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1929: out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /etc/test/nested/copy/36663/hosts" failed: exit status 83
functional_test.go:1932: file sync test content: * The control-plane node functional-196000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-196000"
functional_test.go:1942: /etc/sync.test content mismatch (-want +got):
strings.Join({
+ 	"* ",
	"T",
- 	"est file for checking file sync process",
+ 	"he control-plane node functional-196000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-196000\"\n",
}, "")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (95.272326ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/FileSync (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (1.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/36663.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /etc/ssl/certs/36663.pem"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /etc/ssl/certs/36663.pem": exit status 83 (147.619297ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/etc/ssl/certs/36663.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-196000 ssh \"sudo cat /etc/ssl/certs/36663.pem\"": exit status 83
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /etc/ssl/certs/36663.pem mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-196000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-196000"
	"""
)
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/36663.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /usr/share/ca-certificates/36663.pem"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /usr/share/ca-certificates/36663.pem": exit status 83 (170.48896ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/usr/share/ca-certificates/36663.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-196000 ssh \"sudo cat /usr/share/ca-certificates/36663.pem\"": exit status 83
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /usr/share/ca-certificates/36663.pem mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-196000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-196000"
	"""
)
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /etc/ssl/certs/51391683.0": exit status 83 (259.152137ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/etc/ssl/certs/51391683.0" inside minikube. args "out/minikube-darwin-amd64 -p functional-196000 ssh \"sudo cat /etc/ssl/certs/51391683.0\"": exit status 83
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /etc/ssl/certs/51391683.0 mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-196000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-196000"
	"""
)
functional_test.go:1995: Checking for existence of /etc/ssl/certs/366632.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /etc/ssl/certs/366632.pem"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /etc/ssl/certs/366632.pem": exit status 83 (211.609266ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/etc/ssl/certs/366632.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-196000 ssh \"sudo cat /etc/ssl/certs/366632.pem\"": exit status 83
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /etc/ssl/certs/366632.pem mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-196000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-196000"
	"""
)
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/366632.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /usr/share/ca-certificates/366632.pem"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /usr/share/ca-certificates/366632.pem": exit status 83 (168.15616ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/usr/share/ca-certificates/366632.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-196000 ssh \"sudo cat /usr/share/ca-certificates/366632.pem\"": exit status 83
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /usr/share/ca-certificates/366632.pem mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-196000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-196000"
	"""
)
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0": exit status 83 (177.84973ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/etc/ssl/certs/3ec20f2e.0" inside minikube. args "out/minikube-darwin-amd64 -p functional-196000 ssh \"sudo cat /etc/ssl/certs/3ec20f2e.0\"": exit status 83
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /etc/ssl/certs/3ec20f2e.0 mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-196000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-196000"
	"""
)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (95.478014ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/CertSync (1.23s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-196000 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
functional_test.go:218: (dbg) Non-zero exit: kubectl --context functional-196000 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'": exit status 1 (48.79104ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-196000

                                                
                                                
** /stderr **
functional_test.go:220: failed to 'kubectl get nodes' with args "kubectl --context functional-196000 get nodes --output=go-template \"--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'\"": exit status 1
functional_test.go:226: expected to have label "minikube.k8s.io/commit" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-196000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/version" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-196000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/updated_at" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-196000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/name" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-196000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/primary" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-196000

                                                
                                                
** /stderr **
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-196000 -n functional-196000: exit status 7 (94.370429ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-196000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/NodeLabels (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "sudo systemctl is-active crio": exit status 83 (161.706046ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:2026: output of 
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --: exit status 83
functional_test.go:2029: For runtime "docker": expected "crio" to be inactive but got "* The control-plane node functional-196000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-196000\"\n" 
--- FAIL: TestFunctional/parallel/NonActiveRuntimeDisabled (0.16s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 version -o=json --components
functional_test.go:2266: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 version -o=json --components: exit status 83 (140.331957ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:2268: error version: exit status 83
functional_test.go:2273: expected to see "buildctl" in the minikube version --components but got:
* The control-plane node functional-196000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-196000"
functional_test.go:2273: expected to see "commit" in the minikube version --components but got:
* The control-plane node functional-196000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-196000"
functional_test.go:2273: expected to see "containerd" in the minikube version --components but got:
* The control-plane node functional-196000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-196000"
functional_test.go:2273: expected to see "crictl" in the minikube version --components but got:
* The control-plane node functional-196000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-196000"
functional_test.go:2273: expected to see "crio" in the minikube version --components but got:
* The control-plane node functional-196000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-196000"
functional_test.go:2273: expected to see "ctr" in the minikube version --components but got:
* The control-plane node functional-196000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-196000"
functional_test.go:2273: expected to see "docker" in the minikube version --components but got:
* The control-plane node functional-196000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-196000"
functional_test.go:2273: expected to see "minikubeVersion" in the minikube version --components but got:
* The control-plane node functional-196000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-196000"
functional_test.go:2273: expected to see "podman" in the minikube version --components but got:
* The control-plane node functional-196000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-196000"
functional_test.go:2273: expected to see "crun" in the minikube version --components but got:
* The control-plane node functional-196000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-196000"
--- FAIL: TestFunctional/parallel/Version/components (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-196000 image ls --format short --alsologtostderr:

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-196000 image ls --format short --alsologtostderr:
I0311 03:55:07.377652   37820 out.go:291] Setting OutFile to fd 1 ...
I0311 03:55:07.377843   37820 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:55:07.377848   37820 out.go:304] Setting ErrFile to fd 2...
I0311 03:55:07.377852   37820 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:55:07.378044   37820 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
I0311 03:55:07.378656   37820 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:55:07.378755   37820 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:55:07.379089   37820 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:55:07.379146   37820 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0311 03:55:07.386695   37820 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62298
I0311 03:55:07.387099   37820 main.go:141] libmachine: () Calling .GetVersion
I0311 03:55:07.387513   37820 main.go:141] libmachine: Using API Version  1
I0311 03:55:07.387541   37820 main.go:141] libmachine: () Calling .SetConfigRaw
I0311 03:55:07.387740   37820 main.go:141] libmachine: () Calling .GetMachineName
I0311 03:55:07.387842   37820 main.go:141] libmachine: (functional-196000) Calling .GetState
I0311 03:55:07.387935   37820 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:55:07.387949   37820 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
I0311 03:55:07.387968   37820 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
I0311 03:55:07.388021   37820 main.go:141] libmachine: Making call to close driver server
I0311 03:55:07.388036   37820 main.go:141] libmachine: (functional-196000) Calling .Close
I0311 03:55:07.388123   37820 main.go:141] libmachine: (functional-196000) DBG | Closing plugin on server side
I0311 03:55:07.388155   37820 main.go:141] libmachine: Successfully made call to close driver server
I0311 03:55:07.388179   37820 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListShort (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-196000 image ls --format table --alsologtostderr:
|-------|-----|----------|------|
| Image | Tag | Image ID | Size |
|-------|-----|----------|------|
|-------|-----|----------|------|
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-196000 image ls --format table --alsologtostderr:
I0311 03:55:08.033601   37838 out.go:291] Setting OutFile to fd 1 ...
I0311 03:55:08.033777   37838 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:55:08.033783   37838 out.go:304] Setting ErrFile to fd 2...
I0311 03:55:08.033787   37838 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:55:08.033968   37838 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
I0311 03:55:08.034534   37838 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:55:08.034627   37838 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:55:08.035025   37838 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:55:08.035073   37838 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0311 03:55:08.042728   37838 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62310
I0311 03:55:08.043159   37838 main.go:141] libmachine: () Calling .GetVersion
I0311 03:55:08.043579   37838 main.go:141] libmachine: Using API Version  1
I0311 03:55:08.043589   37838 main.go:141] libmachine: () Calling .SetConfigRaw
I0311 03:55:08.043826   37838 main.go:141] libmachine: () Calling .GetMachineName
I0311 03:55:08.043937   37838 main.go:141] libmachine: (functional-196000) Calling .GetState
I0311 03:55:08.044024   37838 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:55:08.044041   37838 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
I0311 03:55:08.044054   37838 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
I0311 03:55:08.044228   37838 main.go:141] libmachine: Making call to close driver server
I0311 03:55:08.044244   37838 main.go:141] libmachine: (functional-196000) Calling .Close
I0311 03:55:08.044340   37838 main.go:141] libmachine: Successfully made call to close driver server
I0311 03:55:08.044361   37838 main.go:141] libmachine: (functional-196000) DBG | Closing plugin on server side
I0311 03:55:08.044366   37838 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected | registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListTable (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-196000 image ls --format json --alsologtostderr:
[]
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-196000 image ls --format json --alsologtostderr:
I0311 03:55:07.933749   37835 out.go:291] Setting OutFile to fd 1 ...
I0311 03:55:07.933940   37835 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:55:07.933945   37835 out.go:304] Setting ErrFile to fd 2...
I0311 03:55:07.933949   37835 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:55:07.934124   37835 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
I0311 03:55:07.934792   37835 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:55:07.934884   37835 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:55:07.935258   37835 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:55:07.935299   37835 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0311 03:55:07.942951   37835 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62308
I0311 03:55:07.943394   37835 main.go:141] libmachine: () Calling .GetVersion
I0311 03:55:07.943809   37835 main.go:141] libmachine: Using API Version  1
I0311 03:55:07.943820   37835 main.go:141] libmachine: () Calling .SetConfigRaw
I0311 03:55:07.944055   37835 main.go:141] libmachine: () Calling .GetMachineName
I0311 03:55:07.944169   37835 main.go:141] libmachine: (functional-196000) Calling .GetState
I0311 03:55:07.944252   37835 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:55:07.944273   37835 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
I0311 03:55:07.944289   37835 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
I0311 03:55:07.944408   37835 main.go:141] libmachine: Making call to close driver server
I0311 03:55:07.944418   37835 main.go:141] libmachine: (functional-196000) Calling .Close
I0311 03:55:07.944505   37835 main.go:141] libmachine: (functional-196000) DBG | Closing plugin on server side
I0311 03:55:07.944558   37835 main.go:141] libmachine: Successfully made call to close driver server
I0311 03:55:07.944584   37835 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected ["registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListJson (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-196000 image ls --format yaml --alsologtostderr:
[]

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-196000 image ls --format yaml --alsologtostderr:
I0311 03:55:07.478127   37823 out.go:291] Setting OutFile to fd 1 ...
I0311 03:55:07.478285   37823 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:55:07.478290   37823 out.go:304] Setting ErrFile to fd 2...
I0311 03:55:07.478294   37823 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:55:07.478475   37823 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
I0311 03:55:07.479086   37823 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:55:07.479192   37823 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:55:07.479534   37823 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:55:07.479587   37823 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0311 03:55:07.487381   37823 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62300
I0311 03:55:07.487784   37823 main.go:141] libmachine: () Calling .GetVersion
I0311 03:55:07.488208   37823 main.go:141] libmachine: Using API Version  1
I0311 03:55:07.488229   37823 main.go:141] libmachine: () Calling .SetConfigRaw
I0311 03:55:07.488464   37823 main.go:141] libmachine: () Calling .GetMachineName
I0311 03:55:07.488562   37823 main.go:141] libmachine: (functional-196000) Calling .GetState
I0311 03:55:07.488638   37823 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:55:07.488658   37823 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
I0311 03:55:07.488664   37823 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
I0311 03:55:07.488746   37823 main.go:141] libmachine: Making call to close driver server
I0311 03:55:07.488764   37823 main.go:141] libmachine: (functional-196000) Calling .Close
I0311 03:55:07.488839   37823 main.go:141] libmachine: (functional-196000) DBG | Closing plugin on server side
I0311 03:55:07.488885   37823 main.go:141] libmachine: Successfully made call to close driver server
I0311 03:55:07.488910   37823 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected - registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListYaml (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh pgrep buildkitd: exit status 83 (139.548125ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:314: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image build -t localhost/my-image:functional-196000 testdata/build --alsologtostderr
functional_test.go:322: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-196000 image build -t localhost/my-image:functional-196000 testdata/build --alsologtostderr:
I0311 03:55:07.733324   37829 out.go:291] Setting OutFile to fd 1 ...
I0311 03:55:07.733607   37829 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:55:07.733612   37829 out.go:304] Setting ErrFile to fd 2...
I0311 03:55:07.733616   37829 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:55:07.733822   37829 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
I0311 03:55:07.734411   37829 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:55:07.735030   37829 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:55:07.735391   37829 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:55:07.735430   37829 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0311 03:55:07.743098   37829 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62304
I0311 03:55:07.743513   37829 main.go:141] libmachine: () Calling .GetVersion
I0311 03:55:07.743926   37829 main.go:141] libmachine: Using API Version  1
I0311 03:55:07.743955   37829 main.go:141] libmachine: () Calling .SetConfigRaw
I0311 03:55:07.744212   37829 main.go:141] libmachine: () Calling .GetMachineName
I0311 03:55:07.744335   37829 main.go:141] libmachine: (functional-196000) Calling .GetState
I0311 03:55:07.744421   37829 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:55:07.744483   37829 build_images.go:123] succeeded building to: 
I0311 03:55:07.744489   37829 build_images.go:124] failed building to: 
I0311 03:55:07.744479   37829 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
I0311 03:55:07.744498   37829 main.go:141] libmachine: Making call to close driver server
I0311 03:55:07.744508   37829 main.go:141] libmachine: (functional-196000) Calling .Close
I0311 03:55:07.744509   37829 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
I0311 03:55:07.744598   37829 main.go:141] libmachine: Successfully made call to close driver server
I0311 03:55:07.744599   37829 main.go:141] libmachine: (functional-196000) DBG | Closing plugin on server side
I0311 03:55:07.744605   37829 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image ls
functional_test.go:442: expected "localhost/my-image:functional-196000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageBuild (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv/bash (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv/bash
functional_test.go:495: (dbg) Run:  /bin/bash -c "eval $(out/minikube-darwin-amd64 -p functional-196000 docker-env) && out/minikube-darwin-amd64 status -p functional-196000"
functional_test.go:495: (dbg) Non-zero exit: /bin/bash -c "eval $(out/minikube-darwin-amd64 -p functional-196000 docker-env) && out/minikube-darwin-amd64 status -p functional-196000": exit status 1 (176.284772ms)
functional_test.go:501: failed to do status after eval-ing docker-env. error: exit status 1
--- FAIL: TestFunctional/parallel/DockerEnv/bash (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 update-context --alsologtostderr -v=2: exit status 83 (139.548232ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:55:06.955684   37811 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:55:06.955973   37811 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:55:06.955979   37811 out.go:304] Setting ErrFile to fd 2...
	I0311 03:55:06.955983   37811 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:55:06.956166   37811 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:55:06.956461   37811 mustload.go:65] Loading cluster: functional-196000
	I0311 03:55:06.956728   37811 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:55:06.957070   37811 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:55:06.957118   37811 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:55:06.964784   37811 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62292
	I0311 03:55:06.965215   37811 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:55:06.965630   37811 main.go:141] libmachine: Using API Version  1
	I0311 03:55:06.965638   37811 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:55:06.965839   37811 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:55:06.965941   37811 main.go:141] libmachine: (functional-196000) Calling .GetState
	I0311 03:55:06.966029   37811 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:55:06.966086   37811 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
	I0311 03:55:06.966110   37811 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
	I0311 03:55:06.988184   37811 out.go:177] * The control-plane node functional-196000 host is not running: state=Stopped
	I0311 03:55:07.009881   37811 out.go:177]   To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-196000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2122: update-context: got="* The control-plane node functional-196000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-196000\"\n", want=*"No changes"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_changes (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 update-context --alsologtostderr -v=2: exit status 83 (139.771947ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:55:07.236987   37817 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:55:07.237689   37817 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:55:07.237698   37817 out.go:304] Setting ErrFile to fd 2...
	I0311 03:55:07.237705   37817 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:55:07.238269   37817 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:55:07.238592   37817 mustload.go:65] Loading cluster: functional-196000
	I0311 03:55:07.238888   37817 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:55:07.239252   37817 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:55:07.239285   37817 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:55:07.247238   37817 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62296
	I0311 03:55:07.247672   37817 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:55:07.248097   37817 main.go:141] libmachine: Using API Version  1
	I0311 03:55:07.248107   37817 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:55:07.248334   37817 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:55:07.248471   37817 main.go:141] libmachine: (functional-196000) Calling .GetState
	I0311 03:55:07.248576   37817 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:55:07.248590   37817 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
	I0311 03:55:07.248620   37817 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
	I0311 03:55:07.270326   37817 out.go:177] * The control-plane node functional-196000 host is not running: state=Stopped
	I0311 03:55:07.291966   37817 out.go:177]   To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-196000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2122: update-context: got="* The control-plane node functional-196000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-196000\"\n", want=*"context has been updated"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 update-context --alsologtostderr -v=2: exit status 83 (141.166752ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:55:07.095205   37814 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:55:07.095374   37814 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:55:07.095379   37814 out.go:304] Setting ErrFile to fd 2...
	I0311 03:55:07.095383   37814 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:55:07.095587   37814 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:55:07.095895   37814 mustload.go:65] Loading cluster: functional-196000
	I0311 03:55:07.096215   37814 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:55:07.096550   37814 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:55:07.096602   37814 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:55:07.104751   37814 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62294
	I0311 03:55:07.105462   37814 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:55:07.105895   37814 main.go:141] libmachine: Using API Version  1
	I0311 03:55:07.105906   37814 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:55:07.106112   37814 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:55:07.106226   37814 main.go:141] libmachine: (functional-196000) Calling .GetState
	I0311 03:55:07.106305   37814 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:55:07.106331   37814 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
	I0311 03:55:07.106348   37814 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
	I0311 03:55:07.128757   37814 out.go:177] * The control-plane node functional-196000 host is not running: state=Stopped
	I0311 03:55:07.150306   37814 out.go:177]   To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-196000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2122: update-context: got="* The control-plane node functional-196000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-196000\"\n", want=*"context has been updated"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1435: (dbg) Run:  kubectl --context functional-196000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8
functional_test.go:1435: (dbg) Non-zero exit: kubectl --context functional-196000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8: exit status 1 (52.318407ms)

                                                
                                                
** stderr ** 
	error: context "functional-196000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1439: failed to create hello-node deployment with this command "kubectl --context functional-196000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8": exit status 1.
--- FAIL: TestFunctional/parallel/ServiceCmd/DeployApp (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1455: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 service list
functional_test.go:1455: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 service list: exit status 83 (195.745404ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1457: failed to do service list. args "out/minikube-darwin-amd64 -p functional-196000 service list" : exit status 83
functional_test.go:1460: expected 'service list' to contain *hello-node* but got -"* The control-plane node functional-196000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-196000\"\n"-
--- FAIL: TestFunctional/parallel/ServiceCmd/List (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1485: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 service list -o json
functional_test.go:1485: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 service list -o json: exit status 83 (194.2814ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1487: failed to list services with json format. args "out/minikube-darwin-amd64 -p functional-196000 service list -o json": exit status 83
--- FAIL: TestFunctional/parallel/ServiceCmd/JSONOutput (0.19s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1505: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 service --namespace=default --https --url hello-node
functional_test.go:1505: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 service --namespace=default --https --url hello-node: exit status 83 (161.524792ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1507: failed to get service url. args "out/minikube-darwin-amd64 -p functional-196000 service --namespace=default --https --url hello-node" : exit status 83
--- FAIL: TestFunctional/parallel/ServiceCmd/HTTPS (0.16s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1536: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 service hello-node --url --format={{.IP}}
functional_test.go:1536: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 service hello-node --url --format={{.IP}}: exit status 83 (160.893256ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1538: failed to get service url with custom format. args "out/minikube-darwin-amd64 -p functional-196000 service hello-node --url --format={{.IP}}": exit status 83
functional_test.go:1544: "* The control-plane node functional-196000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-196000\"" is not a valid IP
--- FAIL: TestFunctional/parallel/ServiceCmd/Format (0.16s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1555: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 service hello-node --url
functional_test.go:1555: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 service hello-node --url: exit status 83 (197.62142ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test.go:1557: failed to get service url. args: "out/minikube-darwin-amd64 -p functional-196000 service hello-node --url": exit status 83
functional_test.go:1561: found endpoint for hello-node: * The control-plane node functional-196000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-196000"
functional_test.go:1565: failed to parse "* The control-plane node functional-196000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-196000\"": parse "* The control-plane node functional-196000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-196000\"": net/url: invalid control character in URL
--- FAIL: TestFunctional/parallel/ServiceCmd/URL (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-196000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-196000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:190: tunnel command failed with unexpected error: exit code 83. stderr: I0311 03:54:13.458913   37562 out.go:291] Setting OutFile to fd 1 ...
I0311 03:54:13.459194   37562 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:54:13.459201   37562 out.go:304] Setting ErrFile to fd 2...
I0311 03:54:13.459205   37562 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:54:13.459405   37562 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
I0311 03:54:13.459742   37562 mustload.go:65] Loading cluster: functional-196000
I0311 03:54:13.460127   37562 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:54:13.460488   37562 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0311 03:54:13.460537   37562 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0311 03:54:13.470022   37562 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62146
I0311 03:54:13.470569   37562 main.go:141] libmachine: () Calling .GetVersion
I0311 03:54:13.471044   37562 main.go:141] libmachine: Using API Version  1
I0311 03:54:13.471078   37562 main.go:141] libmachine: () Calling .SetConfigRaw
I0311 03:54:13.471401   37562 main.go:141] libmachine: () Calling .GetMachineName
I0311 03:54:13.471549   37562 main.go:141] libmachine: (functional-196000) Calling .GetState
I0311 03:54:13.471708   37562 main.go:141] libmachine: (functional-196000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0311 03:54:13.471749   37562 main.go:141] libmachine: (functional-196000) DBG | hyperkit pid from json: 0
I0311 03:54:13.471769   37562 main.go:141] libmachine: (functional-196000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/functional-196000/hyperkit.json: no such file or directory
I0311 03:54:13.493350   37562 out.go:177] * The control-plane node functional-196000 host is not running: state=Stopped
I0311 03:54:13.555918   37562 out.go:177]   To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
stdout: * The control-plane node functional-196000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-196000"
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-amd64 -p functional-196000 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 37567: os: process already finished
helpers_test.go:502: unable to terminate pid 37563: os: process already finished
functional_test_tunnel_test.go:194: read stdout failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-196000 tunnel --alsologtostderr] stdout:
functional_test_tunnel_test.go:194: read stderr failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-196000 tunnel --alsologtostderr] stderr:
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-amd64 -p functional-196000 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: read stdout failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-196000 tunnel --alsologtostderr] stdout:
functional_test_tunnel_test.go:194: read stderr failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-196000 tunnel --alsologtostderr] stderr:
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:208: failed to get Kubernetes client for "functional-196000": client config: context "functional-196000" does not exist
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (95.81s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:288: failed to hit nginx at "http://": Temporary Error: Get "http:": http: no Host in request URL
functional_test_tunnel_test.go:290: (dbg) Run:  kubectl --context functional-196000 get svc nginx-svc
functional_test_tunnel_test.go:290: (dbg) Non-zero exit: kubectl --context functional-196000 get svc nginx-svc: exit status 1 (41.286717ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-196000

                                                
                                                
** /stderr **
functional_test_tunnel_test.go:292: kubectl --context functional-196000 get svc nginx-svc failed: exit status 1
functional_test_tunnel_test.go:294: failed to kubectl get svc nginx-svc:
functional_test_tunnel_test.go:301: expected body to contain "Welcome to nginx!", but got *""*
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (95.81s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.99s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image load --daemon gcr.io/google-containers/addon-resizer:functional-196000 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-darwin-amd64 -p functional-196000 image load --daemon gcr.io/google-containers/addon-resizer:functional-196000 --alsologtostderr: (1.893866086s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-196000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.99s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.92s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image load --daemon gcr.io/google-containers/addon-resizer:functional-196000 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-darwin-amd64 -p functional-196000 image load --daemon gcr.io/google-containers/addon-resizer:functional-196000 --alsologtostderr: (1.82619667s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-196000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.92s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (6.99s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (5.090504278s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-196000
functional_test.go:244: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image load --daemon gcr.io/google-containers/addon-resizer:functional-196000 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-darwin-amd64 -p functional-196000 image load --daemon gcr.io/google-containers/addon-resizer:functional-196000 --alsologtostderr: (1.741128577s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-196000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (6.99s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image save gcr.io/google-containers/addon-resizer:functional-196000 /Users/jenkins/workspace/addon-resizer-save.tar --alsologtostderr
functional_test.go:385: expected "/Users/jenkins/workspace/addon-resizer-save.tar" to exist after `image save`, but doesn't exist
--- FAIL: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image load /Users/jenkins/workspace/addon-resizer-save.tar --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-196000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (15.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:319: (dbg) Run:  dig +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A
functional_test_tunnel_test.go:319: (dbg) Non-zero exit: dig +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A: exit status 9 (15.016018287s)

                                                
                                                
-- stdout --
	
	; <<>> DiG 9.10.6 <<>> +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A
	; (1 server found)
	;; global options: +cmd
	;; connection timed out; no servers could be reached

                                                
                                                
-- /stdout --
functional_test_tunnel_test.go:322: failed to resolve DNS name: exit status 9
functional_test_tunnel_test.go:329: expected body to contain "ANSWER: 1", but got *"\n; <<>> DiG 9.10.6 <<>> +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A\n; (1 server found)\n;; global options: +cmd\n;; connection timed out; no servers could be reached\n"*
functional_test_tunnel_test.go:332: (dbg) Run:  scutil --dns
functional_test_tunnel_test.go:336: debug for DNS configuration:
DNS configuration

                                                
                                                
resolver #1
nameserver[0] : 207.254.72.253
nameserver[1] : 207.254.72.254
nameserver[2] : 8.8.8.8
flags    : Request A records
reach    : 0x00000002 (Reachable)

                                                
                                                
resolver #2
domain   : local
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300000

                                                
                                                
resolver #3
domain   : 254.169.in-addr.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300200

                                                
                                                
resolver #4
domain   : 8.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300400

                                                
                                                
resolver #5
domain   : 9.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300600

                                                
                                                
resolver #6
domain   : a.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300800

                                                
                                                
resolver #7
domain   : b.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 301000

                                                
                                                
resolver #8
domain   : cluster.local
nameserver[0] : 10.96.0.10
flags    : Request A records
reach    : 0x00000002 (Reachable)
order    : 1

                                                
                                                
DNS configuration (for scoped queries)

                                                
                                                
resolver #1
nameserver[0] : 207.254.72.253
nameserver[1] : 207.254.72.254
nameserver[2] : 8.8.8.8
if_index : 4 (en0)
flags    : Scoped, Request A records
reach    : 0x00000002 (Reachable)
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (15.04s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (34.97s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
E0311 03:56:16.278178   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
E0311 03:56:21.398746   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
E0311 03:56:31.640220   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
functional_test_tunnel_test.go:419: failed to hit nginx with DNS forwarded "http://nginx-svc.default.svc.cluster.local.": Temporary Error: Get "http://nginx-svc.default.svc.cluster.local.": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
functional_test_tunnel_test.go:426: expected body to contain "Welcome to nginx!", but got *""*
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (34.97s)

                                                
                                    
x
+
TestMutliControlPlane/serial/StartCluster (11.18s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run:  out/minikube-darwin-amd64 start -p ha-783000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=hyperkit 
E0311 03:56:52.122921   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
ha_test.go:101: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ha-783000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=hyperkit : exit status 60 (11.103072489s)

                                                
                                                
-- stdout --
	* [ha-783000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "ha-783000" primary control-plane node in "ha-783000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "ha-783000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:56:50.283709   37881 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:56:50.283879   37881 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:56:50.283884   37881 out.go:304] Setting ErrFile to fd 2...
	I0311 03:56:50.283888   37881 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:56:50.284073   37881 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:56:50.285545   37881 out.go:298] Setting JSON to false
	I0311 03:56:50.307685   37881 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":10580,"bootTime":1710144030,"procs":462,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 03:56:50.307771   37881 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 03:56:50.330188   37881 out.go:177] * [ha-783000] minikube v1.32.0 on Darwin 14.3.1
	I0311 03:56:50.372701   37881 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 03:56:50.372752   37881 notify.go:220] Checking for updates...
	I0311 03:56:50.416401   37881 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 03:56:50.458697   37881 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 03:56:50.479693   37881 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 03:56:50.521745   37881 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 03:56:50.543613   37881 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 03:56:50.565175   37881 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 03:56:50.594922   37881 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 03:56:50.637829   37881 start.go:297] selected driver: hyperkit
	I0311 03:56:50.637854   37881 start.go:901] validating driver "hyperkit" against <nil>
	I0311 03:56:50.637876   37881 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 03:56:50.642247   37881 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 03:56:50.642360   37881 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 03:56:50.650149   37881 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0311 03:56:50.653845   37881 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:56:50.653878   37881 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0311 03:56:50.653911   37881 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 03:56:50.654114   37881 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 03:56:50.654171   37881 cni.go:84] Creating CNI manager for ""
	I0311 03:56:50.654180   37881 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I0311 03:56:50.654186   37881 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0311 03:56:50.654260   37881 start.go:340] cluster config:
	{Name:ha-783000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-783000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docke
r CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0
GPUs: AutoPauseInterval:1m0s}
	I0311 03:56:50.654340   37881 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 03:56:50.675865   37881 out.go:177] * Starting "ha-783000" primary control-plane node in "ha-783000" cluster
	I0311 03:56:50.697544   37881 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 03:56:50.697632   37881 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 03:56:50.697659   37881 cache.go:56] Caching tarball of preloaded images
	I0311 03:56:50.697883   37881 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 03:56:50.697900   37881 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 03:56:50.698357   37881 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/ha-783000/config.json ...
	I0311 03:56:50.698392   37881 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/ha-783000/config.json: {Name:mk235bd0e35905f7c7daa4dcca3f1234df726217 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 03:56:50.699008   37881 start.go:360] acquireMachinesLock for ha-783000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 03:56:50.699126   37881 start.go:364] duration metric: took 94.757µs to acquireMachinesLock for "ha-783000"
	I0311 03:56:50.699172   37881 start.go:93] Provisioning new machine with config: &{Name:ha-783000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-783000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 03:56:50.699278   37881 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 03:56:50.741756   37881 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 03:56:50.742049   37881 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:56:50.742108   37881 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:56:50.751748   37881 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62317
	I0311 03:56:50.752290   37881 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:56:50.752724   37881 main.go:141] libmachine: Using API Version  1
	I0311 03:56:50.752739   37881 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:56:50.752959   37881 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:56:50.753069   37881 main.go:141] libmachine: (ha-783000) Calling .GetMachineName
	I0311 03:56:50.753158   37881 main.go:141] libmachine: (ha-783000) Calling .DriverName
	I0311 03:56:50.753272   37881 start.go:159] libmachine.API.Create for "ha-783000" (driver="hyperkit")
	I0311 03:56:50.753293   37881 client.go:168] LocalClient.Create starting
	I0311 03:56:50.753332   37881 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 03:56:50.753379   37881 main.go:141] libmachine: Decoding PEM data...
	I0311 03:56:50.753396   37881 main.go:141] libmachine: Parsing certificate...
	I0311 03:56:50.753445   37881 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 03:56:50.753480   37881 main.go:141] libmachine: Decoding PEM data...
	I0311 03:56:50.753492   37881 main.go:141] libmachine: Parsing certificate...
	I0311 03:56:50.753504   37881 main.go:141] libmachine: Running pre-create checks...
	I0311 03:56:50.753517   37881 main.go:141] libmachine: (ha-783000) Calling .PreCreateCheck
	I0311 03:56:50.753606   37881 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:56:50.753821   37881 main.go:141] libmachine: (ha-783000) Calling .GetConfigRaw
	I0311 03:56:50.754269   37881 main.go:141] libmachine: Creating machine...
	I0311 03:56:50.754278   37881 main.go:141] libmachine: (ha-783000) Calling .Create
	I0311 03:56:50.754348   37881 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:56:50.754463   37881 main.go:141] libmachine: (ha-783000) DBG | I0311 03:56:50.754338   37889 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 03:56:50.754555   37881 main.go:141] libmachine: (ha-783000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 03:56:50.930844   37881 main.go:141] libmachine: (ha-783000) DBG | I0311 03:56:50.930743   37889 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/id_rsa...
	I0311 03:56:50.985314   37881 main.go:141] libmachine: (ha-783000) DBG | I0311 03:56:50.985245   37889 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/ha-783000.rawdisk...
	I0311 03:56:50.985324   37881 main.go:141] libmachine: (ha-783000) DBG | Writing magic tar header
	I0311 03:56:50.985331   37881 main.go:141] libmachine: (ha-783000) DBG | Writing SSH key tar header
	I0311 03:56:50.986518   37881 main.go:141] libmachine: (ha-783000) DBG | I0311 03:56:50.986422   37889 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000 ...
	I0311 03:56:51.349830   37881 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:56:51.349844   37881 main.go:141] libmachine: (ha-783000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.pid
	I0311 03:56:51.349882   37881 main.go:141] libmachine: (ha-783000) DBG | Using UUID 8ce01946-90cc-463e-9492-153fae4521f4
	I0311 03:56:51.364810   37881 main.go:141] libmachine: (ha-783000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 03:56:51.364913   37881 client.go:171] duration metric: took 611.598461ms to LocalClient.Create
	I0311 03:56:53.365233   37881 start.go:128] duration metric: took 2.665875072s to createHost
	I0311 03:56:53.365253   37881 start.go:83] releasing machines lock for "ha-783000", held for 2.666066782s
	W0311 03:56:53.365275   37881 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 03:56:53.365652   37881 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:56:53.365684   37881 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:56:53.374562   37881 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62319
	I0311 03:56:53.374974   37881 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:56:53.375370   37881 main.go:141] libmachine: Using API Version  1
	I0311 03:56:53.375380   37881 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:56:53.375645   37881 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:56:53.375995   37881 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:56:53.376020   37881 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:56:53.383803   37881 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62321
	I0311 03:56:53.384126   37881 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:56:53.384487   37881 main.go:141] libmachine: Using API Version  1
	I0311 03:56:53.384500   37881 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:56:53.384686   37881 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:56:53.384796   37881 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 03:56:53.384877   37881 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:56:53.384911   37881 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:56:53.384925   37881 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 03:56:53.384975   37881 main.go:141] libmachine: (ha-783000) Calling .DriverName
	I0311 03:56:53.428460   37881 out.go:177] * Deleting "ha-783000" in hyperkit ...
	I0311 03:56:53.449743   37881 main.go:141] libmachine: (ha-783000) Calling .Remove
	I0311 03:56:53.450037   37881 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:56:53.450065   37881 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:56:53.450086   37881 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:56:53.450123   37881 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	W0311 03:56:53.469680   37881 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 03:56:53.469694   37881 start.go:728] Will try again in 5 seconds ...
	I0311 03:56:58.470767   37881 start.go:360] acquireMachinesLock for ha-783000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 03:56:58.470974   37881 start.go:364] duration metric: took 138.318µs to acquireMachinesLock for "ha-783000"
	I0311 03:56:58.471005   37881 start.go:93] Provisioning new machine with config: &{Name:ha-783000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-783000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 03:56:58.471159   37881 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 03:56:58.515908   37881 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 03:56:58.516076   37881 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:56:58.516123   37881 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:56:58.525799   37881 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62323
	I0311 03:56:58.526186   37881 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:56:58.526552   37881 main.go:141] libmachine: Using API Version  1
	I0311 03:56:58.526566   37881 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:56:58.526783   37881 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:56:58.526890   37881 main.go:141] libmachine: (ha-783000) Calling .GetMachineName
	I0311 03:56:58.526974   37881 main.go:141] libmachine: (ha-783000) Calling .DriverName
	I0311 03:56:58.527091   37881 start.go:159] libmachine.API.Create for "ha-783000" (driver="hyperkit")
	I0311 03:56:58.527108   37881 client.go:168] LocalClient.Create starting
	I0311 03:56:58.527134   37881 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 03:56:58.527188   37881 main.go:141] libmachine: Decoding PEM data...
	I0311 03:56:58.527198   37881 main.go:141] libmachine: Parsing certificate...
	I0311 03:56:58.527238   37881 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 03:56:58.527290   37881 main.go:141] libmachine: Decoding PEM data...
	I0311 03:56:58.527309   37881 main.go:141] libmachine: Parsing certificate...
	I0311 03:56:58.527321   37881 main.go:141] libmachine: Running pre-create checks...
	I0311 03:56:58.527326   37881 main.go:141] libmachine: (ha-783000) Calling .PreCreateCheck
	I0311 03:56:58.527405   37881 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:56:58.527441   37881 main.go:141] libmachine: (ha-783000) Calling .GetConfigRaw
	I0311 03:56:58.527880   37881 main.go:141] libmachine: Creating machine...
	I0311 03:56:58.527888   37881 main.go:141] libmachine: (ha-783000) Calling .Create
	I0311 03:56:58.527972   37881 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:56:58.528082   37881 main.go:141] libmachine: (ha-783000) DBG | I0311 03:56:58.527962   37896 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 03:56:58.528137   37881 main.go:141] libmachine: (ha-783000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 03:56:58.708149   37881 main.go:141] libmachine: (ha-783000) DBG | I0311 03:56:58.708054   37896 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/id_rsa...
	I0311 03:56:58.811071   37881 main.go:141] libmachine: (ha-783000) DBG | I0311 03:56:58.811003   37896 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/ha-783000.rawdisk...
	I0311 03:56:58.811111   37881 main.go:141] libmachine: (ha-783000) DBG | Writing magic tar header
	I0311 03:56:58.811119   37881 main.go:141] libmachine: (ha-783000) DBG | Writing SSH key tar header
	I0311 03:56:58.811716   37881 main.go:141] libmachine: (ha-783000) DBG | I0311 03:56:58.811679   37896 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000 ...
	I0311 03:56:59.172509   37881 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:56:59.172529   37881 main.go:141] libmachine: (ha-783000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.pid
	I0311 03:56:59.172541   37881 main.go:141] libmachine: (ha-783000) DBG | Using UUID 0a4b99f2-d66f-491b-9616-c70c5a6ea955
	I0311 03:56:59.190494   37881 main.go:141] libmachine: (ha-783000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 03:56:59.190558   37881 client.go:171] duration metric: took 663.431234ms to LocalClient.Create
	I0311 03:57:01.192001   37881 start.go:128] duration metric: took 2.720758443s to createHost
	I0311 03:57:01.192027   37881 start.go:83] releasing machines lock for "ha-783000", held for 2.720987629s
	W0311 03:57:01.192147   37881 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p ha-783000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p ha-783000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 03:57:01.213935   37881 out.go:177] 
	W0311 03:57:01.235723   37881 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 03:57:01.235780   37881 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 03:57:01.235821   37881 out.go:239] * Related issues:
	* Related issues:
	W0311 03:57:01.235853   37881 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 03:57:01.235950   37881 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 03:57:01.260989   37881 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:103: failed to fresh-start ha (multi-control plane) cluster. args "out/minikube-darwin-amd64 start -p ha-783000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (73.822715ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/StartCluster (11.18s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DeployApp (117.3s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:128: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml: exit status 1 (100.379176ms)

                                                
                                                
** stderr ** 
	error: cluster "ha-783000" does not exist

                                                
                                                
** /stderr **
ha_test.go:130: failed to create busybox deployment to ha (multi-control plane) cluster
ha_test.go:133: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- rollout status deployment/busybox
ha_test.go:133: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- rollout status deployment/busybox: exit status 1 (101.600163ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:135: failed to deploy busybox to ha (multi-control plane) cluster
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.924355ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.881421ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.851939ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.473236ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.735596ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.624182ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.38579ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.917732ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
E0311 03:57:33.084908   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.69682ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (105.025686ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
E0311 03:58:55.008343   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.393479ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:159: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:163: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:163: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (99.803303ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:165: failed get Pod names
ha_test.go:171: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- exec  -- nslookup kubernetes.io
ha_test.go:171: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- exec  -- nslookup kubernetes.io: exit status 1 (101.175813ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:173: Pod  could not resolve 'kubernetes.io': exit status 1
ha_test.go:181: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- exec  -- nslookup kubernetes.default
ha_test.go:181: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- exec  -- nslookup kubernetes.default: exit status 1 (101.988648ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:183: Pod  could not resolve 'kubernetes.default': exit status 1
ha_test.go:189: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- exec  -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (100.221248ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:191: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (75.050352ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DeployApp (117.30s)

                                                
                                    
x
+
TestMutliControlPlane/serial/PingHostFromPods (0.17s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:199: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-783000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (99.381706ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-783000"

                                                
                                                
** /stderr **
ha_test.go:201: failed to get Pod names: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (74.114748ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/PingHostFromPods (0.17s)

                                                
                                    
x
+
TestMutliControlPlane/serial/AddWorkerNode (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 node add -p ha-783000 -v=7 --alsologtostderr
ha_test.go:228: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p ha-783000 -v=7 --alsologtostderr: exit status 83 (141.111217ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-783000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-783000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:58:58.933186   37972 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:58:58.934116   37972 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:58:58.934123   37972 out.go:304] Setting ErrFile to fd 2...
	I0311 03:58:58.934127   37972 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:58:58.934306   37972 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:58:58.934634   37972 mustload.go:65] Loading cluster: ha-783000
	I0311 03:58:58.934910   37972 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:58:58.936258   37972 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:58:58.936294   37972 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:58:58.944067   37972 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62334
	I0311 03:58:58.944465   37972 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:58:58.944892   37972 main.go:141] libmachine: Using API Version  1
	I0311 03:58:58.944900   37972 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:58:58.945107   37972 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:58:58.945206   37972 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 03:58:58.945281   37972 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:58:58.945351   37972 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 03:58:58.945383   37972 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:58:58.967188   37972 out.go:177] * The control-plane node ha-783000 host is not running: state=Stopped
	I0311 03:58:58.988896   37972 out.go:177]   To start a cluster, run: "minikube start -p ha-783000"

                                                
                                                
** /stderr **
ha_test.go:230: failed to add worker node to current ha (multi-control plane) cluster. args "out/minikube-darwin-amd64 node add -p ha-783000 -v=7 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (74.124916ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/AddWorkerNode (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/NodeLabels (0.11s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run:  kubectl --context ha-783000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
ha_test.go:255: (dbg) Non-zero exit: kubectl --context ha-783000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (36.870923ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: ha-783000

                                                
                                                
** /stderr **
ha_test.go:257: failed to 'kubectl get nodes' with args "kubectl --context ha-783000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1
ha_test.go:264: failed to decode json from label list: args "kubectl --context ha-783000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (74.628176ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/NodeLabels (0.11s)

                                                
                                    
x
+
TestMutliControlPlane/serial/HAppyAfterClusterStart (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:304: expected profile "ha-783000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-783000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-783000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServe
rPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-783000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4\",\"Containe
rRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\"
:false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
ha_test.go:307: expected profile "ha-783000" in json of 'profile list' to have "HAppy" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-783000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-783000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-783000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4
\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000000
0},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (74.531147ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/HAppyAfterClusterStart (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/CopyFile (0.15s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/CopyFile
ha_test.go:326: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 status --output json -v=7 --alsologtostderr
ha_test.go:326: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 status --output json -v=7 --alsologtostderr: exit status 7 (74.657051ms)

                                                
                                                
-- stdout --
	{"Name":"ha-783000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:58:59.483309   37990 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:58:59.483565   37990 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:58:59.483570   37990 out.go:304] Setting ErrFile to fd 2...
	I0311 03:58:59.483574   37990 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:58:59.483736   37990 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:58:59.483928   37990 out.go:298] Setting JSON to true
	I0311 03:58:59.483952   37990 mustload.go:65] Loading cluster: ha-783000
	I0311 03:58:59.483991   37990 notify.go:220] Checking for updates...
	I0311 03:58:59.484205   37990 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:58:59.484224   37990 status.go:255] checking status of ha-783000 ...
	I0311 03:58:59.484567   37990 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:58:59.484619   37990 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:58:59.492813   37990 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62349
	I0311 03:58:59.493157   37990 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:58:59.493586   37990 main.go:141] libmachine: Using API Version  1
	I0311 03:58:59.493596   37990 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:58:59.493787   37990 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:58:59.493882   37990 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 03:58:59.493976   37990 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:58:59.494003   37990 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:58:59.494015   37990 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 03:58:59.494060   37990 status.go:330] ha-783000 host status = "Stopped" (err=<nil>)
	I0311 03:58:59.494075   37990 status.go:343] host is not running, skipping remaining checks
	I0311 03:58:59.494081   37990 status.go:257] ha-783000 status: &{Name:ha-783000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:333: failed to decode json from status: args "out/minikube-darwin-amd64 -p ha-783000 status --output json -v=7 --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (74.440921ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/CopyFile (0.15s)

                                                
                                    
x
+
TestMutliControlPlane/serial/StopSecondaryNode (0.31s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/StopSecondaryNode
ha_test.go:363: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 node stop m02 -v=7 --alsologtostderr
ha_test.go:363: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 node stop m02 -v=7 --alsologtostderr: exit status 85 (161.765991ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:58:59.633941   37996 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:58:59.634790   37996 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:58:59.634796   37996 out.go:304] Setting ErrFile to fd 2...
	I0311 03:58:59.634800   37996 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:58:59.634969   37996 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:58:59.635307   37996 mustload.go:65] Loading cluster: ha-783000
	I0311 03:58:59.635605   37996 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:58:59.657840   37996 out.go:177] 
	W0311 03:58:59.680888   37996 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	W0311 03:58:59.680912   37996 out.go:239] * 
	* 
	W0311 03:58:59.686517   37996 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_8ce24bb09be8aab84076d51946735f62cbf80299_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_8ce24bb09be8aab84076d51946735f62cbf80299_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I0311 03:58:59.708668   37996 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:365: secondary control-plane node stop returned an error. args "out/minikube-darwin-amd64 -p ha-783000 node stop m02 -v=7 --alsologtostderr": exit status 85
ha_test.go:369: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr
ha_test.go:369: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr: exit status 7 (74.033975ms)

                                                
                                                
-- stdout --
	ha-783000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:58:59.794928   37998 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:58:59.795197   37998 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:58:59.795203   37998 out.go:304] Setting ErrFile to fd 2...
	I0311 03:58:59.795207   37998 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:58:59.795384   37998 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:58:59.795554   37998 out.go:298] Setting JSON to false
	I0311 03:58:59.795577   37998 mustload.go:65] Loading cluster: ha-783000
	I0311 03:58:59.795639   37998 notify.go:220] Checking for updates...
	I0311 03:58:59.795852   37998 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:58:59.795871   37998 status.go:255] checking status of ha-783000 ...
	I0311 03:58:59.796218   37998 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:58:59.796261   37998 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:58:59.804284   37998 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62355
	I0311 03:58:59.804604   37998 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:58:59.805011   37998 main.go:141] libmachine: Using API Version  1
	I0311 03:58:59.805022   37998 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:58:59.805214   37998 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:58:59.805299   37998 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 03:58:59.805383   37998 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:58:59.805401   37998 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 03:58:59.805407   37998 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:58:59.805465   37998 status.go:330] ha-783000 host status = "Stopped" (err=<nil>)
	I0311 03:58:59.805479   37998 status.go:343] host is not running, skipping remaining checks
	I0311 03:58:59.805486   37998 status.go:257] ha-783000 status: &{Name:ha-783000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:375: status says not all three control-plane nodes are present: args "out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr": ha-783000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:378: status says not three hosts are running: args "out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr": ha-783000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:381: status says not three kubelets are running: args "out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr": ha-783000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:384: status says not two apiservers are running: args "out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr": ha-783000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (74.793259ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/StopSecondaryNode (0.31s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:390: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:413: expected profile "ha-783000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-783000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-783000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACoun
t\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-783000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.2
8.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000
0000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (75.848721ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/RestartSecondaryNode (51.87s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/RestartSecondaryNode
ha_test.go:420: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 node start m02 -v=7 --alsologtostderr
ha_test.go:420: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 node start m02 -v=7 --alsologtostderr: exit status 85 (163.773457ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:59:00.166677   38015 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:59:00.167534   38015 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:00.167541   38015 out.go:304] Setting ErrFile to fd 2...
	I0311 03:59:00.167544   38015 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:00.168184   38015 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:59:00.168958   38015 mustload.go:65] Loading cluster: ha-783000
	I0311 03:59:00.169268   38015 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:59:00.190413   38015 out.go:177] 
	W0311 03:59:00.212440   38015 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	W0311 03:59:00.212466   38015 out.go:239] * 
	* 
	W0311 03:59:00.217820   38015 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I0311 03:59:00.245665   38015 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:422: I0311 03:59:00.166677   38015 out.go:291] Setting OutFile to fd 1 ...
I0311 03:59:00.167534   38015 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:59:00.167541   38015 out.go:304] Setting ErrFile to fd 2...
I0311 03:59:00.167544   38015 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 03:59:00.168184   38015 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
I0311 03:59:00.168958   38015 mustload.go:65] Loading cluster: ha-783000
I0311 03:59:00.169268   38015 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 03:59:00.190413   38015 out.go:177] 
W0311 03:59:00.212440   38015 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
W0311 03:59:00.212466   38015 out.go:239] * 
* 
W0311 03:59:00.217820   38015 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I0311 03:59:00.245665   38015 out.go:177] 
ha_test.go:423: secondary control-plane node start returned an error. args "out/minikube-darwin-amd64 -p ha-783000 node start m02 -v=7 --alsologtostderr": exit status 85
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr: exit status 7 (75.916438ms)

                                                
                                                
-- stdout --
	ha-783000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:59:00.332878   38017 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:59:00.333151   38017 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:00.333157   38017 out.go:304] Setting ErrFile to fd 2...
	I0311 03:59:00.333160   38017 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:00.333373   38017 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:59:00.333555   38017 out.go:298] Setting JSON to false
	I0311 03:59:00.333579   38017 mustload.go:65] Loading cluster: ha-783000
	I0311 03:59:00.333614   38017 notify.go:220] Checking for updates...
	I0311 03:59:00.333863   38017 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:59:00.333880   38017 status.go:255] checking status of ha-783000 ...
	I0311 03:59:00.334288   38017 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:59:00.334331   38017 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:59:00.342582   38017 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62367
	I0311 03:59:00.342903   38017 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:59:00.343331   38017 main.go:141] libmachine: Using API Version  1
	I0311 03:59:00.343343   38017 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:59:00.343585   38017 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:59:00.343707   38017 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 03:59:00.343792   38017 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:59:00.343813   38017 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:59:00.343838   38017 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 03:59:00.343847   38017 status.go:330] ha-783000 host status = "Stopped" (err=<nil>)
	I0311 03:59:00.343862   38017 status.go:343] host is not running, skipping remaining checks
	I0311 03:59:00.343868   38017 status.go:257] ha-783000 status: &{Name:ha-783000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr: exit status 7 (76.944049ms)

                                                
                                                
-- stdout --
	ha-783000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:59:01.397549   38020 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:59:01.397737   38020 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:01.397743   38020 out.go:304] Setting ErrFile to fd 2...
	I0311 03:59:01.397746   38020 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:01.397926   38020 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:59:01.398103   38020 out.go:298] Setting JSON to false
	I0311 03:59:01.398128   38020 mustload.go:65] Loading cluster: ha-783000
	I0311 03:59:01.398166   38020 notify.go:220] Checking for updates...
	I0311 03:59:01.398392   38020 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:59:01.398410   38020 status.go:255] checking status of ha-783000 ...
	I0311 03:59:01.398762   38020 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:59:01.398805   38020 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:59:01.406832   38020 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62370
	I0311 03:59:01.407170   38020 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:59:01.407595   38020 main.go:141] libmachine: Using API Version  1
	I0311 03:59:01.407606   38020 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:59:01.407887   38020 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:59:01.408026   38020 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 03:59:01.408116   38020 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:59:01.408132   38020 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:59:01.408148   38020 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 03:59:01.408199   38020 status.go:330] ha-783000 host status = "Stopped" (err=<nil>)
	I0311 03:59:01.408212   38020 status.go:343] host is not running, skipping remaining checks
	I0311 03:59:01.408218   38020 status.go:257] ha-783000 status: &{Name:ha-783000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr: exit status 7 (75.49329ms)

                                                
                                                
-- stdout --
	ha-783000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:59:03.654117   38023 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:59:03.654390   38023 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:03.654396   38023 out.go:304] Setting ErrFile to fd 2...
	I0311 03:59:03.654400   38023 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:03.654583   38023 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:59:03.654755   38023 out.go:298] Setting JSON to false
	I0311 03:59:03.654792   38023 mustload.go:65] Loading cluster: ha-783000
	I0311 03:59:03.654818   38023 notify.go:220] Checking for updates...
	I0311 03:59:03.655075   38023 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:59:03.655093   38023 status.go:255] checking status of ha-783000 ...
	I0311 03:59:03.655527   38023 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:59:03.655569   38023 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:59:03.663968   38023 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62373
	I0311 03:59:03.664360   38023 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:59:03.664815   38023 main.go:141] libmachine: Using API Version  1
	I0311 03:59:03.664825   38023 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:59:03.665013   38023 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:59:03.665113   38023 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 03:59:03.665203   38023 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:59:03.665218   38023 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 03:59:03.665226   38023 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:59:03.665255   38023 status.go:330] ha-783000 host status = "Stopped" (err=<nil>)
	I0311 03:59:03.665266   38023 status.go:343] host is not running, skipping remaining checks
	I0311 03:59:03.665273   38023 status.go:257] ha-783000 status: &{Name:ha-783000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr: exit status 7 (78.703253ms)

                                                
                                                
-- stdout --
	ha-783000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:59:06.199513   38026 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:59:06.199782   38026 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:06.199788   38026 out.go:304] Setting ErrFile to fd 2...
	I0311 03:59:06.199791   38026 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:06.199990   38026 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:59:06.200170   38026 out.go:298] Setting JSON to false
	I0311 03:59:06.200194   38026 mustload.go:65] Loading cluster: ha-783000
	I0311 03:59:06.200230   38026 notify.go:220] Checking for updates...
	I0311 03:59:06.200473   38026 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:59:06.200491   38026 status.go:255] checking status of ha-783000 ...
	I0311 03:59:06.200916   38026 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:59:06.200959   38026 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:59:06.209276   38026 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62376
	I0311 03:59:06.209687   38026 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:59:06.210090   38026 main.go:141] libmachine: Using API Version  1
	I0311 03:59:06.210098   38026 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:59:06.210291   38026 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:59:06.210395   38026 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 03:59:06.210483   38026 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:59:06.210498   38026 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:59:06.210513   38026 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 03:59:06.210529   38026 status.go:330] ha-783000 host status = "Stopped" (err=<nil>)
	I0311 03:59:06.210542   38026 status.go:343] host is not running, skipping remaining checks
	I0311 03:59:06.210549   38026 status.go:257] ha-783000 status: &{Name:ha-783000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr: exit status 7 (75.571106ms)

                                                
                                                
-- stdout --
	ha-783000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:59:11.047952   38029 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:59:11.048658   38029 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:11.048665   38029 out.go:304] Setting ErrFile to fd 2...
	I0311 03:59:11.048670   38029 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:11.049071   38029 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:59:11.049492   38029 out.go:298] Setting JSON to false
	I0311 03:59:11.049518   38029 mustload.go:65] Loading cluster: ha-783000
	I0311 03:59:11.049588   38029 notify.go:220] Checking for updates...
	I0311 03:59:11.049790   38029 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:59:11.049808   38029 status.go:255] checking status of ha-783000 ...
	I0311 03:59:11.050131   38029 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:59:11.050185   38029 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:59:11.058467   38029 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62379
	I0311 03:59:11.058797   38029 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:59:11.059198   38029 main.go:141] libmachine: Using API Version  1
	I0311 03:59:11.059208   38029 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:59:11.059426   38029 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:59:11.059522   38029 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 03:59:11.059602   38029 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:59:11.059631   38029 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:59:11.059648   38029 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 03:59:11.059699   38029 status.go:330] ha-783000 host status = "Stopped" (err=<nil>)
	I0311 03:59:11.059711   38029 status.go:343] host is not running, skipping remaining checks
	I0311 03:59:11.059737   38029 status.go:257] ha-783000 status: &{Name:ha-783000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr: exit status 7 (78.326295ms)

                                                
                                                
-- stdout --
	ha-783000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:59:13.958241   38032 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:59:13.958507   38032 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:13.958513   38032 out.go:304] Setting ErrFile to fd 2...
	I0311 03:59:13.958517   38032 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:13.958693   38032 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:59:13.958866   38032 out.go:298] Setting JSON to false
	I0311 03:59:13.958890   38032 mustload.go:65] Loading cluster: ha-783000
	I0311 03:59:13.958922   38032 notify.go:220] Checking for updates...
	I0311 03:59:13.959170   38032 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:59:13.959187   38032 status.go:255] checking status of ha-783000 ...
	I0311 03:59:13.959533   38032 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:59:13.959577   38032 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:59:13.968272   38032 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62382
	I0311 03:59:13.968683   38032 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:59:13.969078   38032 main.go:141] libmachine: Using API Version  1
	I0311 03:59:13.969086   38032 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:59:13.969291   38032 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:59:13.969391   38032 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 03:59:13.969470   38032 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:59:13.969483   38032 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:59:13.969499   38032 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 03:59:13.969516   38032 status.go:330] ha-783000 host status = "Stopped" (err=<nil>)
	I0311 03:59:13.969525   38032 status.go:343] host is not running, skipping remaining checks
	I0311 03:59:13.969532   38032 status.go:257] ha-783000 status: &{Name:ha-783000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr: exit status 7 (75.090173ms)

                                                
                                                
-- stdout --
	ha-783000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:59:19.947172   38037 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:59:19.947438   38037 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:19.947444   38037 out.go:304] Setting ErrFile to fd 2...
	I0311 03:59:19.947448   38037 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:19.948186   38037 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:59:19.948644   38037 out.go:298] Setting JSON to false
	I0311 03:59:19.948673   38037 mustload.go:65] Loading cluster: ha-783000
	I0311 03:59:19.948715   38037 notify.go:220] Checking for updates...
	I0311 03:59:19.948947   38037 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:59:19.948964   38037 status.go:255] checking status of ha-783000 ...
	I0311 03:59:19.949344   38037 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:59:19.949380   38037 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:59:19.957480   38037 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62385
	I0311 03:59:19.957851   38037 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:59:19.958278   38037 main.go:141] libmachine: Using API Version  1
	I0311 03:59:19.958286   38037 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:59:19.958537   38037 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:59:19.958640   38037 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 03:59:19.958727   38037 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:59:19.958739   38037 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:59:19.958752   38037 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 03:59:19.958787   38037 status.go:330] ha-783000 host status = "Stopped" (err=<nil>)
	I0311 03:59:19.958798   38037 status.go:343] host is not running, skipping remaining checks
	I0311 03:59:19.958804   38037 status.go:257] ha-783000 status: &{Name:ha-783000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr: exit status 7 (76.361492ms)

                                                
                                                
-- stdout --
	ha-783000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:59:33.748784   38040 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:59:33.749054   38040 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:33.749059   38040 out.go:304] Setting ErrFile to fd 2...
	I0311 03:59:33.749062   38040 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:33.749256   38040 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:59:33.749451   38040 out.go:298] Setting JSON to false
	I0311 03:59:33.749475   38040 mustload.go:65] Loading cluster: ha-783000
	I0311 03:59:33.749518   38040 notify.go:220] Checking for updates...
	I0311 03:59:33.749749   38040 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:59:33.749766   38040 status.go:255] checking status of ha-783000 ...
	I0311 03:59:33.750106   38040 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:59:33.750168   38040 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:59:33.758697   38040 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62388
	I0311 03:59:33.759060   38040 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:59:33.759473   38040 main.go:141] libmachine: Using API Version  1
	I0311 03:59:33.759491   38040 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:59:33.759741   38040 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:59:33.759859   38040 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 03:59:33.759946   38040 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:59:33.759964   38040 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:59:33.759975   38040 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 03:59:33.760030   38040 status.go:330] ha-783000 host status = "Stopped" (err=<nil>)
	I0311 03:59:33.760043   38040 status.go:343] host is not running, skipping remaining checks
	I0311 03:59:33.760049   38040 status.go:257] ha-783000 status: &{Name:ha-783000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr: exit status 7 (76.412226ms)

                                                
                                                
-- stdout --
	ha-783000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:59:51.885726   38045 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:59:51.885926   38045 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:51.885932   38045 out.go:304] Setting ErrFile to fd 2...
	I0311 03:59:51.885936   38045 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:51.886118   38045 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:59:51.886297   38045 out.go:298] Setting JSON to false
	I0311 03:59:51.886321   38045 mustload.go:65] Loading cluster: ha-783000
	I0311 03:59:51.886368   38045 notify.go:220] Checking for updates...
	I0311 03:59:51.887605   38045 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:59:51.887630   38045 status.go:255] checking status of ha-783000 ...
	I0311 03:59:51.887998   38045 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:59:51.888049   38045 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:59:51.896329   38045 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62391
	I0311 03:59:51.896681   38045 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:59:51.897095   38045 main.go:141] libmachine: Using API Version  1
	I0311 03:59:51.897104   38045 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:59:51.897304   38045 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:59:51.897408   38045 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 03:59:51.897485   38045 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:59:51.897498   38045 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:59:51.897511   38045 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 03:59:51.897548   38045 status.go:330] ha-783000 host status = "Stopped" (err=<nil>)
	I0311 03:59:51.897561   38045 status.go:343] host is not running, skipping remaining checks
	I0311 03:59:51.897567   38045 status.go:257] ha-783000 status: &{Name:ha-783000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:432: failed to run minikube status. args "out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (75.4278ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/RestartSecondaryNode (51.87s)

                                                
                                    
x
+
TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:304: expected profile "ha-783000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-783000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-783000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServe
rPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-783000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4\",\"Containe
rRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\"
:false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
ha_test.go:307: expected profile "ha-783000" in json of 'profile list' to have "HAppy" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-783000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-783000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-783000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4
\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000000
0},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (75.278793ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/RestartClusterKeepsNodes (9.24s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:456: (dbg) Run:  out/minikube-darwin-amd64 node list -p ha-783000 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Run:  out/minikube-darwin-amd64 stop -p ha-783000 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Done: out/minikube-darwin-amd64 stop -p ha-783000 -v=7 --alsologtostderr: (3.277453178s)
ha_test.go:467: (dbg) Run:  out/minikube-darwin-amd64 start -p ha-783000 --wait=true -v=7 --alsologtostderr
ha_test.go:467: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ha-783000 --wait=true -v=7 --alsologtostderr: exit status 60 (5.756308968s)

                                                
                                                
-- stdout --
	* [ha-783000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "ha-783000" primary control-plane node in "ha-783000" cluster
	* Restarting existing hyperkit VM for "ha-783000" ...
	* Restarting existing hyperkit VM for "ha-783000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:59:55.599746   38080 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:59:55.600026   38080 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:55.600031   38080 out.go:304] Setting ErrFile to fd 2...
	I0311 03:59:55.600035   38080 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:59:55.600206   38080 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:59:55.601626   38080 out.go:298] Setting JSON to false
	I0311 03:59:55.624093   38080 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":10765,"bootTime":1710144030,"procs":465,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 03:59:55.624208   38080 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 03:59:55.645964   38080 out.go:177] * [ha-783000] minikube v1.32.0 on Darwin 14.3.1
	I0311 03:59:55.687830   38080 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 03:59:55.687859   38080 notify.go:220] Checking for updates...
	I0311 03:59:55.709819   38080 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 03:59:55.730732   38080 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 03:59:55.751865   38080 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 03:59:55.772974   38080 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 03:59:55.793850   38080 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 03:59:55.815123   38080 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:59:55.815285   38080 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 03:59:55.815802   38080 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:59:55.815865   38080 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:59:55.824463   38080 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62413
	I0311 03:59:55.824820   38080 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:59:55.825251   38080 main.go:141] libmachine: Using API Version  1
	I0311 03:59:55.825260   38080 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:59:55.825491   38080 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:59:55.825604   38080 main.go:141] libmachine: (ha-783000) Calling .DriverName
	I0311 03:59:55.853827   38080 out.go:177] * Using the hyperkit driver based on existing profile
	I0311 03:59:55.895698   38080 start.go:297] selected driver: hyperkit
	I0311 03:59:55.895728   38080 start.go:901] validating driver "hyperkit" against &{Name:ha-783000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-783000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 03:59:55.895942   38080 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 03:59:55.896137   38080 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 03:59:55.896338   38080 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 03:59:55.905396   38080 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0311 03:59:55.909201   38080 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:59:55.909230   38080 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0311 03:59:55.911859   38080 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 03:59:55.911934   38080 cni.go:84] Creating CNI manager for ""
	I0311 03:59:55.911943   38080 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0311 03:59:55.912023   38080 start.go:340] cluster config:
	{Name:ha-783000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-783000 Namespace:default APIServerHAVIP: APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 03:59:55.912100   38080 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 03:59:55.954777   38080 out.go:177] * Starting "ha-783000" primary control-plane node in "ha-783000" cluster
	I0311 03:59:55.975588   38080 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 03:59:55.975720   38080 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 03:59:55.975754   38080 cache.go:56] Caching tarball of preloaded images
	I0311 03:59:55.976036   38080 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 03:59:55.976074   38080 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 03:59:55.976182   38080 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/ha-783000/config.json ...
	I0311 03:59:55.976810   38080 start.go:360] acquireMachinesLock for ha-783000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 03:59:55.976910   38080 start.go:364] duration metric: took 81.609µs to acquireMachinesLock for "ha-783000"
	I0311 03:59:55.976938   38080 start.go:96] Skipping create...Using existing machine configuration
	I0311 03:59:55.976951   38080 fix.go:54] fixHost starting: 
	I0311 03:59:55.977278   38080 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:59:55.977309   38080 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:59:55.985687   38080 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62415
	I0311 03:59:55.986031   38080 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:59:55.986428   38080 main.go:141] libmachine: Using API Version  1
	I0311 03:59:55.986446   38080 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:59:55.986694   38080 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:59:55.986819   38080 main.go:141] libmachine: (ha-783000) Calling .DriverName
	I0311 03:59:55.986922   38080 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 03:59:55.987006   38080 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:59:55.987020   38080 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 03:59:55.987027   38080 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 03:59:55.987084   38080 fix.go:112] recreateIfNeeded on ha-783000: state=Stopped err=<nil>
	I0311 03:59:55.987110   38080 main.go:141] libmachine: (ha-783000) Calling .DriverName
	W0311 03:59:55.987190   38080 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 03:59:56.008969   38080 out.go:177] * Restarting existing hyperkit VM for "ha-783000" ...
	I0311 03:59:56.050602   38080 main.go:141] libmachine: (ha-783000) Calling .Start
	I0311 03:59:56.050819   38080 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 03:59:56.050844   38080 main.go:141] libmachine: (ha-783000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.pid
	I0311 03:59:56.050925   38080 main.go:141] libmachine: (ha-783000) DBG | Using UUID 0a4b99f2-d66f-491b-9616-c70c5a6ea955
	I0311 03:59:56.067287   38080 main.go:141] libmachine: (ha-783000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 03:59:56.067378   38080 fix.go:56] duration metric: took 90.426216ms for fixHost
	I0311 03:59:56.067389   38080 start.go:83] releasing machines lock for "ha-783000", held for 90.468629ms
	W0311 03:59:56.067405   38080 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0311 03:59:56.067468   38080 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 03:59:56.067484   38080 start.go:728] Will try again in 5 seconds ...
	I0311 04:00:01.067934   38080 start.go:360] acquireMachinesLock for ha-783000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:00:01.068126   38080 start.go:364] duration metric: took 152.569µs to acquireMachinesLock for "ha-783000"
	I0311 04:00:01.068162   38080 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:00:01.068170   38080 fix.go:54] fixHost starting: 
	I0311 04:00:01.068708   38080 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:00:01.068756   38080 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:00:01.077786   38080 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62417
	I0311 04:00:01.078146   38080 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:00:01.078483   38080 main.go:141] libmachine: Using API Version  1
	I0311 04:00:01.078493   38080 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:00:01.078734   38080 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:00:01.078860   38080 main.go:141] libmachine: (ha-783000) Calling .DriverName
	I0311 04:00:01.078948   38080 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 04:00:01.079044   38080 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:00:01.079075   38080 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 04:00:01.079085   38080 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 04:00:01.079084   38080 fix.go:112] recreateIfNeeded on ha-783000: state=Stopped err=<nil>
	I0311 04:00:01.079097   38080 main.go:141] libmachine: (ha-783000) Calling .DriverName
	W0311 04:00:01.079180   38080 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:00:01.099744   38080 out.go:177] * Restarting existing hyperkit VM for "ha-783000" ...
	I0311 04:00:01.143606   38080 main.go:141] libmachine: (ha-783000) Calling .Start
	I0311 04:00:01.143871   38080 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:00:01.143915   38080 main.go:141] libmachine: (ha-783000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.pid
	I0311 04:00:01.144027   38080 main.go:141] libmachine: (ha-783000) DBG | Using UUID 0a4b99f2-d66f-491b-9616-c70c5a6ea955
	I0311 04:00:01.146085   38080 main.go:141] libmachine: (ha-783000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:00:01.146167   38080 fix.go:56] duration metric: took 77.995501ms for fixHost
	I0311 04:00:01.146179   38080 start.go:83] releasing machines lock for "ha-783000", held for 78.037125ms
	W0311 04:00:01.146251   38080 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p ha-783000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p ha-783000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:00:01.188558   38080 out.go:177] 
	W0311 04:00:01.209720   38080 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:00:01.209827   38080 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:00:01.209851   38080 out.go:239] * Related issues:
	* Related issues:
	W0311 04:00:01.209903   38080 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:00:01.209976   38080 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:00:01.231388   38080 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:469: failed to run minikube start. args "out/minikube-darwin-amd64 node list -p ha-783000 -v=7 --alsologtostderr" : exit status 60
ha_test.go:472: (dbg) Run:  out/minikube-darwin-amd64 node list -p ha-783000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (74.671864ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/RestartClusterKeepsNodes (9.24s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DeleteSecondaryNode (0.32s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DeleteSecondaryNode
ha_test.go:487: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 node delete m03 -v=7 --alsologtostderr
ha_test.go:487: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 node delete m03 -v=7 --alsologtostderr: exit status 83 (165.03188ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-783000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-783000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:00:01.497393   38112 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:00:01.498338   38112 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:00:01.498346   38112 out.go:304] Setting ErrFile to fd 2...
	I0311 04:00:01.498350   38112 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:00:01.498538   38112 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:00:01.498859   38112 mustload.go:65] Loading cluster: ha-783000
	I0311 04:00:01.499162   38112 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:00:01.499514   38112 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:00:01.499558   38112 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:00:01.507204   38112 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62422
	I0311 04:00:01.507607   38112 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:00:01.508037   38112 main.go:141] libmachine: Using API Version  1
	I0311 04:00:01.508046   38112 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:00:01.508281   38112 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:00:01.508396   38112 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 04:00:01.508479   38112 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:00:01.508501   38112 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 04:00:01.508513   38112 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 04:00:01.530174   38112 out.go:177] * The control-plane node ha-783000 host is not running: state=Stopped
	I0311 04:00:01.575011   38112 out.go:177]   To start a cluster, run: "minikube start -p ha-783000"

                                                
                                                
** /stderr **
ha_test.go:489: node delete returned an error. args "out/minikube-darwin-amd64 -p ha-783000 node delete m03 -v=7 --alsologtostderr": exit status 83
ha_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr
ha_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr: exit status 7 (75.367704ms)

                                                
                                                
-- stdout --
	ha-783000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:00:01.663111   38115 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:00:01.663302   38115 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:00:01.663307   38115 out.go:304] Setting ErrFile to fd 2...
	I0311 04:00:01.663311   38115 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:00:01.663486   38115 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:00:01.663667   38115 out.go:298] Setting JSON to false
	I0311 04:00:01.663691   38115 mustload.go:65] Loading cluster: ha-783000
	I0311 04:00:01.663724   38115 notify.go:220] Checking for updates...
	I0311 04:00:01.663979   38115 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:00:01.663997   38115 status.go:255] checking status of ha-783000 ...
	I0311 04:00:01.664362   38115 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:00:01.664425   38115 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:00:01.672471   38115 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62425
	I0311 04:00:01.672803   38115 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:00:01.673256   38115 main.go:141] libmachine: Using API Version  1
	I0311 04:00:01.673267   38115 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:00:01.673465   38115 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:00:01.673567   38115 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 04:00:01.673645   38115 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:00:01.673683   38115 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 04:00:01.673701   38115 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 04:00:01.673742   38115 status.go:330] ha-783000 host status = "Stopped" (err=<nil>)
	I0311 04:00:01.673756   38115 status.go:343] host is not running, skipping remaining checks
	I0311 04:00:01.673763   38115 status.go:257] ha-783000 status: &{Name:ha-783000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:495: failed to run minikube status. args "out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (74.903379ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DeleteSecondaryNode (0.32s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:390: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:413: expected profile "ha-783000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-783000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-783000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACoun
t\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-783000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.2
8.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000
0000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (74.361036ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/StopCluster (3.45s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/StopCluster
ha_test.go:531: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 stop -v=7 --alsologtostderr
ha_test.go:531: (dbg) Done: out/minikube-darwin-amd64 -p ha-783000 stop -v=7 --alsologtostderr: (3.295585878s)
ha_test.go:537: (dbg) Run:  out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr
ha_test.go:537: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr: exit status 7 (75.603615ms)

                                                
                                                
-- stdout --
	ha-783000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:00:05.328414   38148 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:00:05.328579   38148 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:00:05.328584   38148 out.go:304] Setting ErrFile to fd 2...
	I0311 04:00:05.328587   38148 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:00:05.328780   38148 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:00:05.328965   38148 out.go:298] Setting JSON to false
	I0311 04:00:05.328990   38148 mustload.go:65] Loading cluster: ha-783000
	I0311 04:00:05.329025   38148 notify.go:220] Checking for updates...
	I0311 04:00:05.330161   38148 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:00:05.330270   38148 status.go:255] checking status of ha-783000 ...
	I0311 04:00:05.330640   38148 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:00:05.330688   38148 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:00:05.339128   38148 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62447
	I0311 04:00:05.339480   38148 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:00:05.339888   38148 main.go:141] libmachine: Using API Version  1
	I0311 04:00:05.339897   38148 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:00:05.340083   38148 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:00:05.340181   38148 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 04:00:05.340260   38148 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:00:05.340295   38148 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 04:00:05.340305   38148 status.go:330] ha-783000 host status = "Stopped" (err=<nil>)
	I0311 04:00:05.340312   38148 status.go:343] host is not running, skipping remaining checks
	I0311 04:00:05.340313   38148 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 04:00:05.340318   38148 status.go:257] ha-783000 status: &{Name:ha-783000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:543: status says not two control-plane nodes are present: args "out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr": ha-783000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:549: status says not three kubelets are stopped: args "out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr": ha-783000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:552: status says not two apiservers are stopped: args "out/minikube-darwin-amd64 -p ha-783000 status -v=7 --alsologtostderr": ha-783000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (74.850355ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/StopCluster (3.45s)

                                                
                                    
x
+
TestMutliControlPlane/serial/RestartCluster (5.91s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/RestartCluster
ha_test.go:560: (dbg) Run:  out/minikube-darwin-amd64 start -p ha-783000 --wait=true -v=7 --alsologtostderr --driver=hyperkit 
ha_test.go:560: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ha-783000 --wait=true -v=7 --alsologtostderr --driver=hyperkit : exit status 60 (5.837896772s)

                                                
                                                
-- stdout --
	* [ha-783000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "ha-783000" primary control-plane node in "ha-783000" cluster
	* Restarting existing hyperkit VM for "ha-783000" ...
	* Restarting existing hyperkit VM for "ha-783000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:00:05.477644   38154 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:00:05.478461   38154 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:00:05.478471   38154 out.go:304] Setting ErrFile to fd 2...
	I0311 04:00:05.478478   38154 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:00:05.478992   38154 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:00:05.480442   38154 out.go:298] Setting JSON to false
	I0311 04:00:05.502981   38154 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":10775,"bootTime":1710144030,"procs":476,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:00:05.503077   38154 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:00:05.525035   38154 out.go:177] * [ha-783000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:00:05.566884   38154 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:00:05.566906   38154 notify.go:220] Checking for updates...
	I0311 04:00:05.610620   38154 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:00:05.632742   38154 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:00:05.653665   38154 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:00:05.674572   38154 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:00:05.695754   38154 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:00:05.717392   38154 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:00:05.717868   38154 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:00:05.717930   38154 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:00:05.726527   38154 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62453
	I0311 04:00:05.726885   38154 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:00:05.727320   38154 main.go:141] libmachine: Using API Version  1
	I0311 04:00:05.727330   38154 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:00:05.727548   38154 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:00:05.727650   38154 main.go:141] libmachine: (ha-783000) Calling .DriverName
	I0311 04:00:05.727841   38154 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:00:05.728083   38154 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:00:05.728106   38154 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:00:05.735848   38154 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62455
	I0311 04:00:05.736200   38154 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:00:05.736569   38154 main.go:141] libmachine: Using API Version  1
	I0311 04:00:05.736589   38154 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:00:05.736782   38154 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:00:05.736874   38154 main.go:141] libmachine: (ha-783000) Calling .DriverName
	I0311 04:00:05.765476   38154 out.go:177] * Using the hyperkit driver based on existing profile
	I0311 04:00:05.807854   38154 start.go:297] selected driver: hyperkit
	I0311 04:00:05.807886   38154 start.go:901] validating driver "hyperkit" against &{Name:ha-783000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-783000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:00:05.808070   38154 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:00:05.808281   38154 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:00:05.808456   38154 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:00:05.817682   38154 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:00:05.821526   38154 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:00:05.821564   38154 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0311 04:00:05.824377   38154 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:00:05.824455   38154 cni.go:84] Creating CNI manager for ""
	I0311 04:00:05.824464   38154 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0311 04:00:05.824542   38154 start.go:340] cluster config:
	{Name:ha-783000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-783000 Namespace:default APIServerHAVIP: APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:00:05.824642   38154 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:00:05.866637   38154 out.go:177] * Starting "ha-783000" primary control-plane node in "ha-783000" cluster
	I0311 04:00:05.887722   38154 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:00:05.887771   38154 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:00:05.887792   38154 cache.go:56] Caching tarball of preloaded images
	I0311 04:00:05.887935   38154 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:00:05.887948   38154 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:00:05.888050   38154 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/ha-783000/config.json ...
	I0311 04:00:05.888609   38154 start.go:360] acquireMachinesLock for ha-783000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:00:05.888673   38154 start.go:364] duration metric: took 47.63µs to acquireMachinesLock for "ha-783000"
	I0311 04:00:05.888699   38154 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:00:05.888712   38154 fix.go:54] fixHost starting: 
	I0311 04:00:05.889013   38154 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:00:05.889039   38154 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:00:05.897281   38154 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62457
	I0311 04:00:05.897629   38154 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:00:05.897991   38154 main.go:141] libmachine: Using API Version  1
	I0311 04:00:05.898007   38154 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:00:05.898227   38154 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:00:05.898337   38154 main.go:141] libmachine: (ha-783000) Calling .DriverName
	I0311 04:00:05.898423   38154 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 04:00:05.898505   38154 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:00:05.898519   38154 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 04:00:05.898561   38154 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 04:00:05.898562   38154 fix.go:112] recreateIfNeeded on ha-783000: state=Stopped err=<nil>
	I0311 04:00:05.898579   38154 main.go:141] libmachine: (ha-783000) Calling .DriverName
	W0311 04:00:05.898651   38154 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:00:05.940583   38154 out.go:177] * Restarting existing hyperkit VM for "ha-783000" ...
	I0311 04:00:05.961608   38154 main.go:141] libmachine: (ha-783000) Calling .Start
	I0311 04:00:05.961880   38154 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:00:05.961937   38154 main.go:141] libmachine: (ha-783000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.pid
	I0311 04:00:05.962038   38154 main.go:141] libmachine: (ha-783000) DBG | Using UUID 0a4b99f2-d66f-491b-9616-c70c5a6ea955
	I0311 04:00:05.964012   38154 main.go:141] libmachine: (ha-783000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:00:05.964152   38154 fix.go:56] duration metric: took 75.427609ms for fixHost
	I0311 04:00:05.964164   38154 start.go:83] releasing machines lock for "ha-783000", held for 75.481073ms
	W0311 04:00:05.964183   38154 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0311 04:00:05.964255   38154 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:00:05.964265   38154 start.go:728] Will try again in 5 seconds ...
	I0311 04:00:10.965609   38154 start.go:360] acquireMachinesLock for ha-783000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:00:10.965759   38154 start.go:364] duration metric: took 117.599µs to acquireMachinesLock for "ha-783000"
	I0311 04:00:10.965793   38154 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:00:10.965801   38154 fix.go:54] fixHost starting: 
	I0311 04:00:10.966241   38154 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:00:10.966288   38154 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:00:10.975554   38154 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62459
	I0311 04:00:10.975931   38154 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:00:10.976324   38154 main.go:141] libmachine: Using API Version  1
	I0311 04:00:10.976345   38154 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:00:10.976545   38154 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:00:10.976669   38154 main.go:141] libmachine: (ha-783000) Calling .DriverName
	I0311 04:00:10.976751   38154 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 04:00:10.976839   38154 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:00:10.976848   38154 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 04:00:10.976860   38154 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 04:00:10.976908   38154 fix.go:112] recreateIfNeeded on ha-783000: state=Stopped err=<nil>
	I0311 04:00:10.976929   38154 main.go:141] libmachine: (ha-783000) Calling .DriverName
	W0311 04:00:10.976997   38154 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:00:10.998820   38154 out.go:177] * Restarting existing hyperkit VM for "ha-783000" ...
	I0311 04:00:11.042384   38154 main.go:141] libmachine: (ha-783000) Calling .Start
	I0311 04:00:11.042673   38154 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:00:11.042730   38154 main.go:141] libmachine: (ha-783000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.pid
	I0311 04:00:11.042802   38154 main.go:141] libmachine: (ha-783000) DBG | Using UUID 0a4b99f2-d66f-491b-9616-c70c5a6ea955
	I0311 04:00:11.064636   38154 main.go:141] libmachine: (ha-783000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:00:11.064730   38154 fix.go:56] duration metric: took 98.927805ms for fixHost
	I0311 04:00:11.064740   38154 start.go:83] releasing machines lock for "ha-783000", held for 98.966113ms
	W0311 04:00:11.064805   38154 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p ha-783000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p ha-783000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:00:11.107554   38154 out.go:177] 
	W0311 04:00:11.128496   38154 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:00:11.128581   38154 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:00:11.128600   38154 out.go:239] * Related issues:
	* Related issues:
	W0311 04:00:11.128630   38154 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:00:11.128655   38154 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:00:11.171598   38154 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:562: failed to start cluster. args "out/minikube-darwin-amd64 start -p ha-783000 --wait=true -v=7 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (75.172746ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/RestartCluster (5.91s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DegradedAfterClusterRestart (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:390: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:413: expected profile "ha-783000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-783000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-783000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACoun
t\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-783000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.2
8.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000
0000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (74.652557ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DegradedAfterClusterRestart (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/AddSecondaryNode (0.21s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/AddSecondaryNode
ha_test.go:605: (dbg) Run:  out/minikube-darwin-amd64 node add -p ha-783000 --control-plane -v=7 --alsologtostderr
ha_test.go:605: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p ha-783000 --control-plane -v=7 --alsologtostderr: exit status 83 (139.527284ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-783000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-783000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:00:11.613434   38178 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:00:11.613636   38178 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:00:11.613642   38178 out.go:304] Setting ErrFile to fd 2...
	I0311 04:00:11.613645   38178 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:00:11.613837   38178 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:00:11.614973   38178 mustload.go:65] Loading cluster: ha-783000
	I0311 04:00:11.615259   38178 config.go:182] Loaded profile config "ha-783000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:00:11.615576   38178 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:00:11.615624   38178 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:00:11.623357   38178 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62470
	I0311 04:00:11.623800   38178 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:00:11.624245   38178 main.go:141] libmachine: Using API Version  1
	I0311 04:00:11.624255   38178 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:00:11.624519   38178 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:00:11.624628   38178 main.go:141] libmachine: (ha-783000) Calling .GetState
	I0311 04:00:11.624719   38178 main.go:141] libmachine: (ha-783000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:00:11.624731   38178 main.go:141] libmachine: (ha-783000) DBG | hyperkit pid from json: 0
	I0311 04:00:11.624741   38178 main.go:141] libmachine: (ha-783000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/ha-783000/hyperkit.json: no such file or directory
	I0311 04:00:11.646583   38178 out.go:177] * The control-plane node ha-783000 host is not running: state=Stopped
	I0311 04:00:11.668001   38178 out.go:177]   To start a cluster, run: "minikube start -p ha-783000"

                                                
                                                
** /stderr **
ha_test.go:607: failed to add control-plane node to current ha (multi-control plane) cluster. args "out/minikube-darwin-amd64 node add -p ha-783000 --control-plane -v=7 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (74.800672ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/AddSecondaryNode (0.21s)

                                                
                                    
x
+
TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:304: expected profile "ha-783000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-783000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-783000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServe
rPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-783000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4\",\"Containe
rRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\"
:false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
ha_test.go:307: expected profile "ha-783000" in json of 'profile list' to have "HAppy" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-783000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-783000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-783000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4
\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000000
0},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-783000 -n ha-783000: exit status 7 (73.876326ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-783000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.22s)

                                                
                                    
x
+
TestImageBuild/serial/Setup (11.15s)

                                                
                                                
=== RUN   TestImageBuild/serial/Setup
image_test.go:69: (dbg) Run:  out/minikube-darwin-amd64 start -p image-187000 --driver=hyperkit 
image_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p image-187000 --driver=hyperkit : exit status 60 (11.077567364s)

                                                
                                                
-- stdout --
	* [image-187000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "image-187000" primary control-plane node in "image-187000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "image-187000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p image-187000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
image_test.go:70: failed to start minikube with args: "out/minikube-darwin-amd64 start -p image-187000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p image-187000 -n image-187000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p image-187000 -n image-187000: exit status 7 (75.738861ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "image-187000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestImageBuild/serial/Setup (11.15s)

                                                
                                    
x
+
TestJSONOutput/start/Command (11.47s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 start -p json-output-994000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit 
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p json-output-994000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit : exit status 60 (11.466527648s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"30ffa780-75fb-4008-8c4f-1f496f2f4696","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-994000] minikube v1.32.0 on Darwin 14.3.1","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"2a151892-f6ee-4b9a-a96c-b294b8eaa569","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=18350"}}
	{"specversion":"1.0","id":"2ff18211-f971-4915-bb8b-67b86e0471ba","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig"}}
	{"specversion":"1.0","id":"744a8c25-b7c6-4808-8d40-465dbf54239b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-amd64"}}
	{"specversion":"1.0","id":"204e1b0f-42b3-4b6b-97a7-b30a7872e24d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"166dd514-598e-4766-b122-f0d1a9666e23","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube"}}
	{"specversion":"1.0","id":"ad383879-f9e1-415c-8cf2-a8bdd7a6e5ac","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"99765eb6-23aa-43ed-b43c-cbf02bfffce1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the hyperkit driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"2a84e921-dfe8-4df0-9e4b-964e1564da36","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"json-output-994000\" primary control-plane node in \"json-output-994000\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"82311989-5f60-40db-b595-c9f4456211c5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"94062594-a61a-46c8-b3d9-e3bd8bf7ff8e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Deleting \"json-output-994000\" in hyperkit ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"dcc3200f-3fab-49b9-9e08-68668bc5ba0f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"}}
	{"specversion":"1.0","id":"23158c42-22b5-428b-8fd0-aa9be5102241","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"29a1c6d6-7d90-46c9-805e-a93404274c29","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"Failed to start hyperkit VM. Running \"minikube delete -p json-output-994000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"}}
	{"specversion":"1.0","id":"942fa517-0d04-404f-afbe-6de938d6461a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.","exitcode":"60","issues":"https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594","message":"Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1","name":"PR_HYPERKIT_VMNET_FRAMEWORK","url":""}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 start -p json-output-994000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit ": exit status 60
--- FAIL: TestJSONOutput/start/Command (11.47s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
json_output_test.go:114: step 9 has already been assigned to another step:
Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
Cannot use for:
Deleting "json-output-994000" in hyperkit ...
[Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 30ffa780-75fb-4008-8c4f-1f496f2f4696
datacontenttype: application/json
Data,
{
"currentstep": "0",
"message": "[json-output-994000] minikube v1.32.0 on Darwin 14.3.1",
"name": "Initial Minikube Setup",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 2a151892-f6ee-4b9a-a96c-b294b8eaa569
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_LOCATION=18350"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 2ff18211-f971-4915-bb8b-67b86e0471ba
datacontenttype: application/json
Data,
{
"message": "KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 744a8c25-b7c6-4808-8d40-465dbf54239b
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_BIN=out/minikube-darwin-amd64"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 204e1b0f-42b3-4b6b-97a7-b30a7872e24d
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 166dd514-598e-4766-b122-f0d1a9666e23
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: ad383879-f9e1-415c-8cf2-a8bdd7a6e5ac
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_FORCE_SYSTEMD="
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 99765eb6-23aa-43ed-b43c-cbf02bfffce1
datacontenttype: application/json
Data,
{
"currentstep": "1",
"message": "Using the hyperkit driver based on user configuration",
"name": "Selecting Driver",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 2a84e921-dfe8-4df0-9e4b-964e1564da36
datacontenttype: application/json
Data,
{
"currentstep": "3",
"message": "Starting \"json-output-994000\" primary control-plane node in \"json-output-994000\" cluster",
"name": "Starting Node",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 82311989-5f60-40db-b595-c9f4456211c5
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 94062594-a61a-46c8-b3d9-e3bd8bf7ff8e
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Deleting \"json-output-994000\" in hyperkit ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: dcc3200f-3fab-49b9-9e08-68668bc5ba0f
datacontenttype: application/json
Data,
{
"message": "StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 23158c42-22b5-428b-8fd0-aa9be5102241
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 29a1c6d6-7d90-46c9-805e-a93404274c29
datacontenttype: application/json
Data,
{
"message": "Failed to start hyperkit VM. Running \"minikube delete -p json-output-994000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 942fa517-0d04-404f-afbe-6de938d6461a
datacontenttype: application/json
Data,
{
"advice": "Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.",
"exitcode": "60",
"issues": "https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594",
"message": "Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1",
"name": "PR_HYPERKIT_VMNET_FRAMEWORK",
"url": ""
}
]
--- FAIL: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
json_output_test.go:144: current step is not in increasing order: [Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 30ffa780-75fb-4008-8c4f-1f496f2f4696
datacontenttype: application/json
Data,
{
"currentstep": "0",
"message": "[json-output-994000] minikube v1.32.0 on Darwin 14.3.1",
"name": "Initial Minikube Setup",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 2a151892-f6ee-4b9a-a96c-b294b8eaa569
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_LOCATION=18350"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 2ff18211-f971-4915-bb8b-67b86e0471ba
datacontenttype: application/json
Data,
{
"message": "KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 744a8c25-b7c6-4808-8d40-465dbf54239b
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_BIN=out/minikube-darwin-amd64"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 204e1b0f-42b3-4b6b-97a7-b30a7872e24d
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 166dd514-598e-4766-b122-f0d1a9666e23
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: ad383879-f9e1-415c-8cf2-a8bdd7a6e5ac
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_FORCE_SYSTEMD="
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 99765eb6-23aa-43ed-b43c-cbf02bfffce1
datacontenttype: application/json
Data,
{
"currentstep": "1",
"message": "Using the hyperkit driver based on user configuration",
"name": "Selecting Driver",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 2a84e921-dfe8-4df0-9e4b-964e1564da36
datacontenttype: application/json
Data,
{
"currentstep": "3",
"message": "Starting \"json-output-994000\" primary control-plane node in \"json-output-994000\" cluster",
"name": "Starting Node",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 82311989-5f60-40db-b595-c9f4456211c5
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 94062594-a61a-46c8-b3d9-e3bd8bf7ff8e
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Deleting \"json-output-994000\" in hyperkit ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: dcc3200f-3fab-49b9-9e08-68668bc5ba0f
datacontenttype: application/json
Data,
{
"message": "StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 23158c42-22b5-428b-8fd0-aa9be5102241
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 29a1c6d6-7d90-46c9-805e-a93404274c29
datacontenttype: application/json
Data,
{
"message": "Failed to start hyperkit VM. Running \"minikube delete -p json-output-994000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 942fa517-0d04-404f-afbe-6de938d6461a
datacontenttype: application/json
Data,
{
"advice": "Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.",
"exitcode": "60",
"issues": "https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594",
"message": "Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1",
"name": "PR_HYPERKIT_VMNET_FRAMEWORK",
"url": ""
}
]
--- FAIL: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.15s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 pause -p json-output-994000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p json-output-994000 --output=json --user=testUser: exit status 83 (148.303706ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"11ac32ec-5809-4223-9011-f8840331513f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"The control-plane node json-output-994000 host is not running: state=Stopped"}}
	{"specversion":"1.0","id":"d7b64dfb-d5b4-4541-b39e-a20258890114","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"To start a cluster, run: \"minikube start -p json-output-994000\""}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 pause -p json-output-994000 --output=json --user=testUser": exit status 83
--- FAIL: TestJSONOutput/pause/Command (0.15s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.16s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 unpause -p json-output-994000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 unpause -p json-output-994000 --output=json --user=testUser: exit status 83 (160.479563ms)

                                                
                                                
-- stdout --
	* The control-plane node json-output-994000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p json-output-994000"

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 unpause -p json-output-994000 --output=json --user=testUser": exit status 83
json_output_test.go:213: unable to marshal output: * The control-plane node json-output-994000 host is not running: state=Stopped
json_output_test.go:70: converting to cloud events: invalid character '*' looking for beginning of value
--- FAIL: TestJSONOutput/unpause/Command (0.16s)

                                                
                                    
x
+
TestMinikubeProfile (12.35s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-amd64 start -p first-540000 --driver=hyperkit 
minikube_profile_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p first-540000 --driver=hyperkit : exit status 60 (11.499410405s)

                                                
                                                
-- stdout --
	* [first-540000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "first-540000" primary control-plane node in "first-540000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "first-540000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p first-540000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
minikube_profile_test.go:46: test pre-condition failed. args "out/minikube-darwin-amd64 start -p first-540000 --driver=hyperkit ": exit status 60
panic.go:626: *** TestMinikubeProfile FAILED at 2024-03-11 04:00:50.124433 -0700 PDT m=+876.405657522
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p second-541000 -n second-541000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p second-541000 -n second-541000: exit status 85 (131.382975ms)

                                                
                                                
-- stdout --
	* Profile "second-541000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p second-541000"

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 85 (may be ok)
helpers_test.go:241: "second-541000" host is not running, skipping log retrieval (state="* Profile \"second-541000\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p second-541000\"")
helpers_test.go:175: Cleaning up "second-541000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p second-541000
panic.go:626: *** TestMinikubeProfile FAILED at 2024-03-11 04:00:50.63617 -0700 PDT m=+876.917384993
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p first-540000 -n first-540000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p first-540000 -n first-540000: exit status 7 (74.843212ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "first-540000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "first-540000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p first-540000
--- FAIL: TestMinikubeProfile (12.35s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (11.7s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-amd64 start -p mount-start-1-419000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit 
mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p mount-start-1-419000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit : exit status 60 (11.626026402s)

                                                
                                                
-- stdout --
	* [mount-start-1-419000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting minikube without Kubernetes in cluster mount-start-1-419000
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "mount-start-1-419000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p mount-start-1-419000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-amd64 start -p mount-start-1-419000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p mount-start-1-419000 -n mount-start-1-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p mount-start-1-419000 -n mount-start-1-419000: exit status 7 (75.7164ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "mount-start-1-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMountStart/serial/StartWithMountFirst (11.70s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (11.56s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-496000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit 
E0311 04:01:11.154335   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
multinode_test.go:96: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-496000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit : exit status 60 (11.484443988s)

                                                
                                                
-- stdout --
	* [multinode-496000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "multinode-496000" primary control-plane node in "multinode-496000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "multinode-496000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:01:03.392306   38364 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:01:03.392484   38364 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:01:03.392490   38364 out.go:304] Setting ErrFile to fd 2...
	I0311 04:01:03.392493   38364 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:01:03.392672   38364 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:01:03.394656   38364 out.go:298] Setting JSON to false
	I0311 04:01:03.417536   38364 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":10833,"bootTime":1710144030,"procs":474,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:01:03.417642   38364 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:01:03.439834   38364 out.go:177] * [multinode-496000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:01:03.483875   38364 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:01:03.483946   38364 notify.go:220] Checking for updates...
	I0311 04:01:03.528696   38364 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:01:03.550610   38364 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:01:03.572480   38364 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:01:03.621242   38364 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:01:03.642183   38364 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:01:03.663733   38364 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:01:03.693381   38364 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:01:03.735222   38364 start.go:297] selected driver: hyperkit
	I0311 04:01:03.735253   38364 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:01:03.735289   38364 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:01:03.739650   38364 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:01:03.739755   38364 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:01:03.747606   38364 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:01:03.751464   38364 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:01:03.751486   38364 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0311 04:01:03.751518   38364 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:01:03.751735   38364 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:01:03.751788   38364 cni.go:84] Creating CNI manager for ""
	I0311 04:01:03.751797   38364 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I0311 04:01:03.751805   38364 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0311 04:01:03.751880   38364 start.go:340] cluster config:
	{Name:multinode-496000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-496000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock:
SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:01:03.751962   38364 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:01:03.793902   38364 out.go:177] * Starting "multinode-496000" primary control-plane node in "multinode-496000" cluster
	I0311 04:01:03.814945   38364 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:01:03.815003   38364 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:01:03.815030   38364 cache.go:56] Caching tarball of preloaded images
	I0311 04:01:03.815218   38364 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:01:03.815234   38364 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:01:03.815769   38364 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/multinode-496000/config.json ...
	I0311 04:01:03.815806   38364 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/multinode-496000/config.json: {Name:mk6d5fa9fb8b57bab78c04704f108cb5f103a9ef Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:01:03.816502   38364 start.go:360] acquireMachinesLock for multinode-496000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:01:03.816604   38364 start.go:364] duration metric: took 66.018µs to acquireMachinesLock for "multinode-496000"
	I0311 04:01:03.816636   38364 start.go:93] Provisioning new machine with config: &{Name:multinode-496000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-496000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:01:03.816702   38364 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:01:03.858865   38364 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:01:03.859181   38364 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:01:03.859261   38364 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:01:03.868221   38364 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62564
	I0311 04:01:03.868582   38364 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:01:03.869009   38364 main.go:141] libmachine: Using API Version  1
	I0311 04:01:03.869020   38364 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:01:03.869262   38364 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:01:03.869377   38364 main.go:141] libmachine: (multinode-496000) Calling .GetMachineName
	I0311 04:01:03.869468   38364 main.go:141] libmachine: (multinode-496000) Calling .DriverName
	I0311 04:01:03.869574   38364 start.go:159] libmachine.API.Create for "multinode-496000" (driver="hyperkit")
	I0311 04:01:03.869594   38364 client.go:168] LocalClient.Create starting
	I0311 04:01:03.869637   38364 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:01:03.869687   38364 main.go:141] libmachine: Decoding PEM data...
	I0311 04:01:03.869704   38364 main.go:141] libmachine: Parsing certificate...
	I0311 04:01:03.869770   38364 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:01:03.869806   38364 main.go:141] libmachine: Decoding PEM data...
	I0311 04:01:03.869818   38364 main.go:141] libmachine: Parsing certificate...
	I0311 04:01:03.869830   38364 main.go:141] libmachine: Running pre-create checks...
	I0311 04:01:03.869838   38364 main.go:141] libmachine: (multinode-496000) Calling .PreCreateCheck
	I0311 04:01:03.869917   38364 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:01:03.870092   38364 main.go:141] libmachine: (multinode-496000) Calling .GetConfigRaw
	I0311 04:01:03.870560   38364 main.go:141] libmachine: Creating machine...
	I0311 04:01:03.870574   38364 main.go:141] libmachine: (multinode-496000) Calling .Create
	I0311 04:01:03.870645   38364 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:01:03.870762   38364 main.go:141] libmachine: (multinode-496000) DBG | I0311 04:01:03.870641   38372 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:01:03.870827   38364 main.go:141] libmachine: (multinode-496000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:01:04.047628   38364 main.go:141] libmachine: (multinode-496000) DBG | I0311 04:01:04.047552   38372 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/id_rsa...
	I0311 04:01:04.360932   38364 main.go:141] libmachine: (multinode-496000) DBG | I0311 04:01:04.360851   38372 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/multinode-496000.rawdisk...
	I0311 04:01:04.360947   38364 main.go:141] libmachine: (multinode-496000) DBG | Writing magic tar header
	I0311 04:01:04.360966   38364 main.go:141] libmachine: (multinode-496000) DBG | Writing SSH key tar header
	I0311 04:01:04.361659   38364 main.go:141] libmachine: (multinode-496000) DBG | I0311 04:01:04.361609   38372 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000 ...
	I0311 04:01:04.722914   38364 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:01:04.722951   38364 main.go:141] libmachine: (multinode-496000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.pid
	I0311 04:01:04.722996   38364 main.go:141] libmachine: (multinode-496000) DBG | Using UUID 01ecbe71-7fe2-47f6-a6c9-2518dbbb5289
	I0311 04:01:04.738459   38364 main.go:141] libmachine: (multinode-496000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:01:04.738566   38364 client.go:171] duration metric: took 868.943905ms to LocalClient.Create
	I0311 04:01:06.739535   38364 start.go:128] duration metric: took 2.922754494s to createHost
	I0311 04:01:06.739552   38364 start.go:83] releasing machines lock for "multinode-496000", held for 2.922886697s
	W0311 04:01:06.739568   38364 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:01:06.739871   38364 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:01:06.739894   38364 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:01:06.747892   38364 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62566
	I0311 04:01:06.748279   38364 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:01:06.748659   38364 main.go:141] libmachine: Using API Version  1
	I0311 04:01:06.748674   38364 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:01:06.748882   38364 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:01:06.749221   38364 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:01:06.749247   38364 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:01:06.757289   38364 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62568
	I0311 04:01:06.757626   38364 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:01:06.757947   38364 main.go:141] libmachine: Using API Version  1
	I0311 04:01:06.757963   38364 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:01:06.758180   38364 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:01:06.758279   38364 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:01:06.758360   38364 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:01:06.758384   38364 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:01:06.758401   38364 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:01:06.758441   38364 main.go:141] libmachine: (multinode-496000) Calling .DriverName
	I0311 04:01:06.808001   38364 out.go:177] * Deleting "multinode-496000" in hyperkit ...
	I0311 04:01:06.828954   38364 main.go:141] libmachine: (multinode-496000) Calling .Remove
	I0311 04:01:06.829167   38364 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:01:06.829182   38364 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:01:06.829196   38364 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:01:06.829297   38364 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	W0311 04:01:06.848766   38364 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:01:06.848779   38364 start.go:728] Will try again in 5 seconds ...
	I0311 04:01:11.850109   38364 start.go:360] acquireMachinesLock for multinode-496000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:01:11.850296   38364 start.go:364] duration metric: took 151.562µs to acquireMachinesLock for "multinode-496000"
	I0311 04:01:11.850329   38364 start.go:93] Provisioning new machine with config: &{Name:multinode-496000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-496000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:01:11.850449   38364 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:01:11.875133   38364 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:01:11.875306   38364 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:01:11.875349   38364 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:01:11.885173   38364 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62570
	I0311 04:01:11.885529   38364 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:01:11.885877   38364 main.go:141] libmachine: Using API Version  1
	I0311 04:01:11.885900   38364 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:01:11.886094   38364 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:01:11.886192   38364 main.go:141] libmachine: (multinode-496000) Calling .GetMachineName
	I0311 04:01:11.886277   38364 main.go:141] libmachine: (multinode-496000) Calling .DriverName
	I0311 04:01:11.886375   38364 start.go:159] libmachine.API.Create for "multinode-496000" (driver="hyperkit")
	I0311 04:01:11.886395   38364 client.go:168] LocalClient.Create starting
	I0311 04:01:11.886426   38364 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:01:11.886478   38364 main.go:141] libmachine: Decoding PEM data...
	I0311 04:01:11.886488   38364 main.go:141] libmachine: Parsing certificate...
	I0311 04:01:11.886531   38364 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:01:11.886568   38364 main.go:141] libmachine: Decoding PEM data...
	I0311 04:01:11.886580   38364 main.go:141] libmachine: Parsing certificate...
	I0311 04:01:11.886599   38364 main.go:141] libmachine: Running pre-create checks...
	I0311 04:01:11.886604   38364 main.go:141] libmachine: (multinode-496000) Calling .PreCreateCheck
	I0311 04:01:11.886686   38364 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:01:11.886732   38364 main.go:141] libmachine: (multinode-496000) Calling .GetConfigRaw
	I0311 04:01:11.897203   38364 main.go:141] libmachine: Creating machine...
	I0311 04:01:11.897214   38364 main.go:141] libmachine: (multinode-496000) Calling .Create
	I0311 04:01:11.897318   38364 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:01:11.897463   38364 main.go:141] libmachine: (multinode-496000) DBG | I0311 04:01:11.897309   38378 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:01:11.897535   38364 main.go:141] libmachine: (multinode-496000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:01:12.078461   38364 main.go:141] libmachine: (multinode-496000) DBG | I0311 04:01:12.078367   38378 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/id_rsa...
	I0311 04:01:12.179196   38364 main.go:141] libmachine: (multinode-496000) DBG | I0311 04:01:12.179117   38378 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/multinode-496000.rawdisk...
	I0311 04:01:12.179215   38364 main.go:141] libmachine: (multinode-496000) DBG | Writing magic tar header
	I0311 04:01:12.179231   38364 main.go:141] libmachine: (multinode-496000) DBG | Writing SSH key tar header
	I0311 04:01:12.180008   38364 main.go:141] libmachine: (multinode-496000) DBG | I0311 04:01:12.179917   38378 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000 ...
	I0311 04:01:12.623328   38364 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:01:12.623382   38364 main.go:141] libmachine: (multinode-496000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.pid
	I0311 04:01:12.623430   38364 main.go:141] libmachine: (multinode-496000) DBG | Using UUID 80aee342-b58c-4e79-af6c-507c12cea3af
	I0311 04:01:12.641739   38364 main.go:141] libmachine: (multinode-496000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:01:12.641822   38364 client.go:171] duration metric: took 755.405563ms to LocalClient.Create
	I0311 04:01:14.643095   38364 start.go:128] duration metric: took 2.792561181s to createHost
	I0311 04:01:14.643119   38364 start.go:83] releasing machines lock for "multinode-496000", held for 2.79275732s
	W0311 04:01:14.643233   38364 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-496000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-496000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:01:14.664947   38364 out.go:177] 
	W0311 04:01:14.686854   38364 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:01:14.686925   38364 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:01:14.686947   38364 out.go:239] * Related issues:
	* Related issues:
	W0311 04:01:14.686977   38364 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:01:14.687029   38364 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:01:14.729548   38364 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:98: failed to start cluster. args "out/minikube-darwin-amd64 start -p multinode-496000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000: exit status 7 (75.087741ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/FreshStart2Nodes (11.56s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (110.9s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (100.972786ms)

                                                
                                                
** stderr ** 
	error: cluster "multinode-496000" does not exist

                                                
                                                
** /stderr **
multinode_test.go:495: failed to create busybox deployment to multinode cluster
multinode_test.go:498: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- rollout status deployment/busybox: exit status 1 (100.902615ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:500: failed to deploy busybox to multinode cluster
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.600354ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (106.233049ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.338594ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.927976ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (106.042247ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (105.775401ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.77304ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
E0311 04:01:38.852744   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.832707ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (105.123017ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.433208ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.528973ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:524: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:528: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:528: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (99.670935ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:530: failed get Pod names
multinode_test.go:536: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- exec  -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- exec  -- nslookup kubernetes.io: exit status 1 (98.885897ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:538: Pod  could not resolve 'kubernetes.io': exit status 1
multinode_test.go:546: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- exec  -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- exec  -- nslookup kubernetes.default: exit status 1 (100.828364ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:548: Pod  could not resolve 'kubernetes.default': exit status 1
multinode_test.go:554: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- exec  -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (100.284562ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:556: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000: exit status 7 (75.724044ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeployApp2Nodes (110.90s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.18s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:564: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-496000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (99.971253ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:566: failed to get Pod names: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000: exit status 7 (75.210924ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.18s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (0.22s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run:  out/minikube-darwin-amd64 node add -p multinode-496000 -v 3 --alsologtostderr
multinode_test.go:121: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p multinode-496000 -v 3 --alsologtostderr: exit status 83 (139.626371ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-496000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-496000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:03:06.039789   38451 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:03:06.040605   38451 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:06.040614   38451 out.go:304] Setting ErrFile to fd 2...
	I0311 04:03:06.040620   38451 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:06.041136   38451 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:03:06.041486   38451 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:03:06.041737   38451 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:03:06.042058   38451 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:03:06.042116   38451 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:03:06.049867   38451 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62581
	I0311 04:03:06.050249   38451 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:03:06.050687   38451 main.go:141] libmachine: Using API Version  1
	I0311 04:03:06.050699   38451 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:03:06.050961   38451 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:03:06.051080   38451 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:03:06.051166   38451 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:03:06.051182   38451 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:03:06.051205   38451 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:03:06.073241   38451 out.go:177] * The control-plane node multinode-496000 host is not running: state=Stopped
	I0311 04:03:06.094687   38451 out.go:177]   To start a cluster, run: "minikube start -p multinode-496000"

                                                
                                                
** /stderr **
multinode_test.go:123: failed to add node to current cluster. args "out/minikube-darwin-amd64 node add -p multinode-496000 -v 3 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000: exit status 7 (75.693245ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/AddNode (0.22s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.11s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run:  kubectl --context multinode-496000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
multinode_test.go:221: (dbg) Non-zero exit: kubectl --context multinode-496000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (36.571644ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: multinode-496000

                                                
                                                
** /stderr **
multinode_test.go:223: failed to 'kubectl get nodes' with args "kubectl --context multinode-496000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1
multinode_test.go:230: failed to decode json from label list: args "kubectl --context multinode-496000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000: exit status 7 (75.704107ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/MultiNodeLabels (0.11s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.22s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
multinode_test.go:166: expected profile "multinode-496000" in json of 'profile list' include 3 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"multinode-496000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"multinode-496000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KV
MNUMACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"multinode-496000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"Kubernetes
Version\":\"v1.28.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseIn
terval\":60000000000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000: exit status 7 (75.255592ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ProfileList (0.22s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (0.15s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status --output json --alsologtostderr
multinode_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status --output json --alsologtostderr: exit status 7 (75.526358ms)

                                                
                                                
-- stdout --
	{"Name":"multinode-496000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:03:06.591155   38469 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:03:06.591430   38469 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:06.591435   38469 out.go:304] Setting ErrFile to fd 2...
	I0311 04:03:06.591439   38469 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:06.591621   38469 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:03:06.591802   38469 out.go:298] Setting JSON to true
	I0311 04:03:06.591826   38469 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:03:06.591869   38469 notify.go:220] Checking for updates...
	I0311 04:03:06.592137   38469 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:03:06.592155   38469 status.go:255] checking status of multinode-496000 ...
	I0311 04:03:06.593534   38469 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:03:06.593607   38469 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:03:06.602105   38469 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62596
	I0311 04:03:06.602468   38469 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:03:06.602896   38469 main.go:141] libmachine: Using API Version  1
	I0311 04:03:06.602907   38469 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:03:06.603102   38469 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:03:06.603208   38469 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:03:06.603290   38469 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:03:06.603322   38469 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:03:06.603338   38469 status.go:330] multinode-496000 host status = "Stopped" (err=<nil>)
	I0311 04:03:06.603341   38469 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:03:06.603345   38469 status.go:343] host is not running, skipping remaining checks
	I0311 04:03:06.603352   38469 status.go:257] multinode-496000 status: &{Name:multinode-496000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:191: failed to decode json from status: args "out/minikube-darwin-amd64 -p multinode-496000 status --output json --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000: exit status 7 (74.827836ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/CopyFile (0.15s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (0.39s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 node stop m03
multinode_test.go:248: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 node stop m03: exit status 85 (160.591234ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_295f67d8757edd996fe5c1e7ccde72c355ccf4dc_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:250: node stop returned an error. args "out/minikube-darwin-amd64 -p multinode-496000 node stop m03": exit status 85
multinode_test.go:254: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status: exit status 7 (74.590312ms)

                                                
                                                
-- stdout --
	multinode-496000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:261: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status --alsologtostderr: exit status 7 (75.060636ms)

                                                
                                                
-- stdout --
	multinode-496000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:03:06.978495   38480 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:03:06.978792   38480 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:06.978798   38480 out.go:304] Setting ErrFile to fd 2...
	I0311 04:03:06.978801   38480 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:06.978999   38480 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:03:06.979178   38480 out.go:298] Setting JSON to false
	I0311 04:03:06.979203   38480 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:03:06.979232   38480 notify.go:220] Checking for updates...
	I0311 04:03:06.979469   38480 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:03:06.979485   38480 status.go:255] checking status of multinode-496000 ...
	I0311 04:03:06.979885   38480 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:03:06.979926   38480 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:03:06.988210   38480 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62605
	I0311 04:03:06.988585   38480 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:03:06.989032   38480 main.go:141] libmachine: Using API Version  1
	I0311 04:03:06.989042   38480 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:03:06.989255   38480 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:03:06.989362   38480 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:03:06.989451   38480 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:03:06.989465   38480 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:03:06.989477   38480 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:03:06.989560   38480 status.go:330] multinode-496000 host status = "Stopped" (err=<nil>)
	I0311 04:03:06.989574   38480 status.go:343] host is not running, skipping remaining checks
	I0311 04:03:06.989581   38480 status.go:257] multinode-496000 status: &{Name:multinode-496000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:267: incorrect number of running kubelets: args "out/minikube-darwin-amd64 -p multinode-496000 status --alsologtostderr": multinode-496000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000: exit status 7 (74.752899ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopNode (0.39s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (56.7s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 node start m03 -v=7 --alsologtostderr
multinode_test.go:282: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 node start m03 -v=7 --alsologtostderr: exit status 85 (155.018935ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:03:07.127942   38486 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:03:07.128130   38486 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:07.128136   38486 out.go:304] Setting ErrFile to fd 2...
	I0311 04:03:07.128140   38486 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:07.128334   38486 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:03:07.129606   38486 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:03:07.129902   38486 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:03:07.151152   38486 out.go:177] 
	W0311 04:03:07.172679   38486 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	W0311 04:03:07.172693   38486 out.go:239] * 
	* 
	W0311 04:03:07.176757   38486 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I0311 04:03:07.197858   38486 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:284: I0311 04:03:07.127942   38486 out.go:291] Setting OutFile to fd 1 ...
I0311 04:03:07.128130   38486 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 04:03:07.128136   38486 out.go:304] Setting ErrFile to fd 2...
I0311 04:03:07.128140   38486 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0311 04:03:07.128334   38486 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
I0311 04:03:07.129606   38486 mustload.go:65] Loading cluster: multinode-496000
I0311 04:03:07.129902   38486 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0311 04:03:07.151152   38486 out.go:177] 
W0311 04:03:07.172679   38486 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
W0311 04:03:07.172693   38486 out.go:239] * 
* 
W0311 04:03:07.176757   38486 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I0311 04:03:07.197858   38486 out.go:177] 
multinode_test.go:285: node start returned an error. args "out/minikube-darwin-amd64 -p multinode-496000 node start m03 -v=7 --alsologtostderr": exit status 85
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr: exit status 7 (74.366935ms)

                                                
                                                
-- stdout --
	multinode-496000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:03:07.283841   38488 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:03:07.284033   38488 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:07.284039   38488 out.go:304] Setting ErrFile to fd 2...
	I0311 04:03:07.284042   38488 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:07.284224   38488 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:03:07.284392   38488 out.go:298] Setting JSON to false
	I0311 04:03:07.284415   38488 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:03:07.284455   38488 notify.go:220] Checking for updates...
	I0311 04:03:07.284685   38488 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:03:07.284703   38488 status.go:255] checking status of multinode-496000 ...
	I0311 04:03:07.285057   38488 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:03:07.285102   38488 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:03:07.293082   38488 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62611
	I0311 04:03:07.293425   38488 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:03:07.293837   38488 main.go:141] libmachine: Using API Version  1
	I0311 04:03:07.293868   38488 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:03:07.294111   38488 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:03:07.294238   38488 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:03:07.294321   38488 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:03:07.294335   38488 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:03:07.294352   38488 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:03:07.294409   38488 status.go:330] multinode-496000 host status = "Stopped" (err=<nil>)
	I0311 04:03:07.294421   38488 status.go:343] host is not running, skipping remaining checks
	I0311 04:03:07.294428   38488 status.go:257] multinode-496000 status: &{Name:multinode-496000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr: exit status 7 (75.580014ms)

                                                
                                                
-- stdout --
	multinode-496000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:03:08.131946   38491 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:03:08.132221   38491 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:08.132226   38491 out.go:304] Setting ErrFile to fd 2...
	I0311 04:03:08.132230   38491 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:08.133082   38491 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:03:08.133410   38491 out.go:298] Setting JSON to false
	I0311 04:03:08.133444   38491 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:03:08.133499   38491 notify.go:220] Checking for updates...
	I0311 04:03:08.133717   38491 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:03:08.133735   38491 status.go:255] checking status of multinode-496000 ...
	I0311 04:03:08.134077   38491 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:03:08.134124   38491 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:03:08.142243   38491 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62614
	I0311 04:03:08.142591   38491 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:03:08.143011   38491 main.go:141] libmachine: Using API Version  1
	I0311 04:03:08.143020   38491 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:03:08.143268   38491 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:03:08.143391   38491 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:03:08.143474   38491 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:03:08.143498   38491 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:03:08.143518   38491 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:03:08.143549   38491 status.go:330] multinode-496000 host status = "Stopped" (err=<nil>)
	I0311 04:03:08.143559   38491 status.go:343] host is not running, skipping remaining checks
	I0311 04:03:08.143566   38491 status.go:257] multinode-496000 status: &{Name:multinode-496000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr: exit status 7 (74.671119ms)

                                                
                                                
-- stdout --
	multinode-496000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:03:09.895188   38494 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:03:09.895884   38494 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:09.895891   38494 out.go:304] Setting ErrFile to fd 2...
	I0311 04:03:09.895897   38494 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:09.896294   38494 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:03:09.896761   38494 out.go:298] Setting JSON to false
	I0311 04:03:09.896789   38494 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:03:09.896827   38494 notify.go:220] Checking for updates...
	I0311 04:03:09.897056   38494 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:03:09.897075   38494 status.go:255] checking status of multinode-496000 ...
	I0311 04:03:09.897406   38494 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:03:09.897449   38494 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:03:09.905573   38494 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62617
	I0311 04:03:09.905895   38494 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:03:09.906381   38494 main.go:141] libmachine: Using API Version  1
	I0311 04:03:09.906392   38494 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:03:09.906601   38494 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:03:09.906729   38494 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:03:09.906819   38494 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:03:09.906839   38494 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:03:09.906849   38494 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:03:09.906868   38494 status.go:330] multinode-496000 host status = "Stopped" (err=<nil>)
	I0311 04:03:09.906878   38494 status.go:343] host is not running, skipping remaining checks
	I0311 04:03:09.906885   38494 status.go:257] multinode-496000 status: &{Name:multinode-496000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr: exit status 7 (75.271156ms)

                                                
                                                
-- stdout --
	multinode-496000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:03:13.218234   38497 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:03:13.218505   38497 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:13.218510   38497 out.go:304] Setting ErrFile to fd 2...
	I0311 04:03:13.218514   38497 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:13.218702   38497 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:03:13.218874   38497 out.go:298] Setting JSON to false
	I0311 04:03:13.218898   38497 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:03:13.218937   38497 notify.go:220] Checking for updates...
	I0311 04:03:13.219164   38497 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:03:13.219183   38497 status.go:255] checking status of multinode-496000 ...
	I0311 04:03:13.219540   38497 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:03:13.219595   38497 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:03:13.227573   38497 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62620
	I0311 04:03:13.227900   38497 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:03:13.228314   38497 main.go:141] libmachine: Using API Version  1
	I0311 04:03:13.228343   38497 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:03:13.228571   38497 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:03:13.228685   38497 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:03:13.228772   38497 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:03:13.228787   38497 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:03:13.228799   38497 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:03:13.228841   38497 status.go:330] multinode-496000 host status = "Stopped" (err=<nil>)
	I0311 04:03:13.228852   38497 status.go:343] host is not running, skipping remaining checks
	I0311 04:03:13.228859   38497 status.go:257] multinode-496000 status: &{Name:multinode-496000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr: exit status 7 (77.466105ms)

                                                
                                                
-- stdout --
	multinode-496000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:03:17.809615   38500 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:03:17.809879   38500 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:17.809885   38500 out.go:304] Setting ErrFile to fd 2...
	I0311 04:03:17.809888   38500 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:17.810061   38500 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:03:17.810251   38500 out.go:298] Setting JSON to false
	I0311 04:03:17.810275   38500 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:03:17.810312   38500 notify.go:220] Checking for updates...
	I0311 04:03:17.810542   38500 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:03:17.810560   38500 status.go:255] checking status of multinode-496000 ...
	I0311 04:03:17.810898   38500 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:03:17.810956   38500 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:03:17.819105   38500 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62623
	I0311 04:03:17.819434   38500 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:03:17.819832   38500 main.go:141] libmachine: Using API Version  1
	I0311 04:03:17.819869   38500 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:03:17.820140   38500 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:03:17.820261   38500 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:03:17.820344   38500 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:03:17.820359   38500 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:03:17.820372   38500 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:03:17.820388   38500 status.go:330] multinode-496000 host status = "Stopped" (err=<nil>)
	I0311 04:03:17.820398   38500 status.go:343] host is not running, skipping remaining checks
	I0311 04:03:17.820404   38500 status.go:257] multinode-496000 status: &{Name:multinode-496000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr: exit status 7 (77.276102ms)

                                                
                                                
-- stdout --
	multinode-496000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:03:22.917187   38503 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:03:22.917367   38503 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:22.917373   38503 out.go:304] Setting ErrFile to fd 2...
	I0311 04:03:22.917377   38503 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:22.917553   38503 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:03:22.917725   38503 out.go:298] Setting JSON to false
	I0311 04:03:22.917748   38503 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:03:22.917786   38503 notify.go:220] Checking for updates...
	I0311 04:03:22.918019   38503 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:03:22.918040   38503 status.go:255] checking status of multinode-496000 ...
	I0311 04:03:22.918385   38503 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:03:22.918430   38503 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:03:22.926727   38503 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62626
	I0311 04:03:22.927124   38503 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:03:22.927538   38503 main.go:141] libmachine: Using API Version  1
	I0311 04:03:22.927548   38503 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:03:22.927760   38503 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:03:22.927858   38503 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:03:22.927957   38503 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:03:22.927974   38503 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:03:22.927986   38503 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:03:22.928054   38503 status.go:330] multinode-496000 host status = "Stopped" (err=<nil>)
	I0311 04:03:22.928076   38503 status.go:343] host is not running, skipping remaining checks
	I0311 04:03:22.928083   38503 status.go:257] multinode-496000 status: &{Name:multinode-496000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr: exit status 7 (73.995788ms)

                                                
                                                
-- stdout --
	multinode-496000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:03:31.826565   38507 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:03:31.826750   38507 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:31.826755   38507 out.go:304] Setting ErrFile to fd 2...
	I0311 04:03:31.826759   38507 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:31.826954   38507 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:03:31.827137   38507 out.go:298] Setting JSON to false
	I0311 04:03:31.827161   38507 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:03:31.827204   38507 notify.go:220] Checking for updates...
	I0311 04:03:31.827420   38507 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:03:31.827436   38507 status.go:255] checking status of multinode-496000 ...
	I0311 04:03:31.827796   38507 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:03:31.827859   38507 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:03:31.835908   38507 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62629
	I0311 04:03:31.836226   38507 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:03:31.836645   38507 main.go:141] libmachine: Using API Version  1
	I0311 04:03:31.836671   38507 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:03:31.836899   38507 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:03:31.837009   38507 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:03:31.837086   38507 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:03:31.837110   38507 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:03:31.837122   38507 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:03:31.837140   38507 status.go:330] multinode-496000 host status = "Stopped" (err=<nil>)
	I0311 04:03:31.837146   38507 status.go:343] host is not running, skipping remaining checks
	I0311 04:03:31.837153   38507 status.go:257] multinode-496000 status: &{Name:multinode-496000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr: exit status 7 (79.94526ms)

                                                
                                                
-- stdout --
	multinode-496000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:03:39.071562   38510 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:03:39.071740   38510 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:39.071746   38510 out.go:304] Setting ErrFile to fd 2...
	I0311 04:03:39.071750   38510 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:03:39.071936   38510 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:03:39.072123   38510 out.go:298] Setting JSON to false
	I0311 04:03:39.072147   38510 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:03:39.072192   38510 notify.go:220] Checking for updates...
	I0311 04:03:39.072433   38510 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:03:39.072450   38510 status.go:255] checking status of multinode-496000 ...
	I0311 04:03:39.072779   38510 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:03:39.072822   38510 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:03:39.081220   38510 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62632
	I0311 04:03:39.081605   38510 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:03:39.082036   38510 main.go:141] libmachine: Using API Version  1
	I0311 04:03:39.082046   38510 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:03:39.082245   38510 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:03:39.082354   38510 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:03:39.082433   38510 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:03:39.082449   38510 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:03:39.082461   38510 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:03:39.082495   38510 status.go:330] multinode-496000 host status = "Stopped" (err=<nil>)
	I0311 04:03:39.082505   38510 status.go:343] host is not running, skipping remaining checks
	I0311 04:03:39.082512   38510 status.go:257] multinode-496000 status: &{Name:multinode-496000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr: exit status 7 (75.070462ms)

                                                
                                                
-- stdout --
	multinode-496000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:04:03.679223   38515 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:04:03.679400   38515 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:04:03.679406   38515 out.go:304] Setting ErrFile to fd 2...
	I0311 04:04:03.679410   38515 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:04:03.679587   38515 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:04:03.679764   38515 out.go:298] Setting JSON to false
	I0311 04:04:03.679794   38515 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:04:03.679830   38515 notify.go:220] Checking for updates...
	I0311 04:04:03.680058   38515 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:04:03.680077   38515 status.go:255] checking status of multinode-496000 ...
	I0311 04:04:03.680435   38515 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:03.680499   38515 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:04:03.688738   38515 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62635
	I0311 04:04:03.689060   38515 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:04:03.689466   38515 main.go:141] libmachine: Using API Version  1
	I0311 04:04:03.689495   38515 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:04:03.689668   38515 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:04:03.689775   38515 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:04:03.689865   38515 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:03.689936   38515 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:04:03.689943   38515 status.go:330] multinode-496000 host status = "Stopped" (err=<nil>)
	I0311 04:04:03.689958   38515 status.go:343] host is not running, skipping remaining checks
	I0311 04:04:03.689960   38515 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:04:03.689969   38515 status.go:257] multinode-496000 status: &{Name:multinode-496000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:294: failed to run minikube status. args "out/minikube-darwin-amd64 -p multinode-496000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000: exit status 7 (74.182602ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StartAfterStop (56.70s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (9.08s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-496000
multinode_test.go:321: (dbg) Run:  out/minikube-darwin-amd64 stop -p multinode-496000
multinode_test.go:321: (dbg) Done: out/minikube-darwin-amd64 stop -p multinode-496000: (3.049787366s)
multinode_test.go:326: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-496000 --wait=true -v=8 --alsologtostderr
multinode_test.go:326: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-496000 --wait=true -v=8 --alsologtostderr: exit status 60 (5.829126575s)

                                                
                                                
-- stdout --
	* [multinode-496000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "multinode-496000" primary control-plane node in "multinode-496000" cluster
	* Restarting existing hyperkit VM for "multinode-496000" ...
	* Restarting existing hyperkit VM for "multinode-496000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:04:06.940008   38542 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:04:06.940692   38542 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:04:06.940701   38542 out.go:304] Setting ErrFile to fd 2...
	I0311 04:04:06.940707   38542 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:04:06.941261   38542 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:04:06.942794   38542 out.go:298] Setting JSON to false
	I0311 04:04:06.965137   38542 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11016,"bootTime":1710144030,"procs":461,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:04:06.965230   38542 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:04:06.987395   38542 out.go:177] * [multinode-496000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:04:07.031242   38542 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:04:07.031306   38542 notify.go:220] Checking for updates...
	I0311 04:04:07.074070   38542 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:04:07.095052   38542 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:04:07.115831   38542 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:04:07.137263   38542 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:04:07.159403   38542 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:04:07.181746   38542 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:04:07.181953   38542 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:04:07.182622   38542 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:07.182709   38542 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:04:07.191502   38542 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62651
	I0311 04:04:07.191873   38542 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:04:07.192338   38542 main.go:141] libmachine: Using API Version  1
	I0311 04:04:07.192364   38542 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:04:07.192616   38542 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:04:07.192733   38542 main.go:141] libmachine: (multinode-496000) Calling .DriverName
	I0311 04:04:07.221198   38542 out.go:177] * Using the hyperkit driver based on existing profile
	I0311 04:04:07.263050   38542 start.go:297] selected driver: hyperkit
	I0311 04:04:07.263081   38542 start.go:901] validating driver "hyperkit" against &{Name:multinode-496000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-496000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:04:07.263277   38542 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:04:07.263474   38542 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:04:07.263658   38542 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:04:07.273073   38542 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:04:07.276844   38542 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:07.276866   38542 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0311 04:04:07.279543   38542 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:04:07.279621   38542 cni.go:84] Creating CNI manager for ""
	I0311 04:04:07.279630   38542 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0311 04:04:07.279702   38542 start.go:340] cluster config:
	{Name:multinode-496000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-496000 Namespace:default APIServ
erHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disable
Metrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:04:07.279780   38542 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:04:07.322008   38542 out.go:177] * Starting "multinode-496000" primary control-plane node in "multinode-496000" cluster
	I0311 04:04:07.342718   38542 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:04:07.342754   38542 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:04:07.342769   38542 cache.go:56] Caching tarball of preloaded images
	I0311 04:04:07.342897   38542 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:04:07.342906   38542 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:04:07.343023   38542 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/multinode-496000/config.json ...
	I0311 04:04:07.343514   38542 start.go:360] acquireMachinesLock for multinode-496000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:04:07.343570   38542 start.go:364] duration metric: took 42.292µs to acquireMachinesLock for "multinode-496000"
	I0311 04:04:07.343591   38542 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:04:07.343601   38542 fix.go:54] fixHost starting: 
	I0311 04:04:07.343835   38542 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:07.343859   38542 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:04:07.351788   38542 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62653
	I0311 04:04:07.352123   38542 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:04:07.352457   38542 main.go:141] libmachine: Using API Version  1
	I0311 04:04:07.352476   38542 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:04:07.352687   38542 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:04:07.352793   38542 main.go:141] libmachine: (multinode-496000) Calling .DriverName
	I0311 04:04:07.352882   38542 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:04:07.352958   38542 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:07.352986   38542 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:04:07.353002   38542 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:04:07.353054   38542 fix.go:112] recreateIfNeeded on multinode-496000: state=Stopped err=<nil>
	I0311 04:04:07.353079   38542 main.go:141] libmachine: (multinode-496000) Calling .DriverName
	W0311 04:04:07.353156   38542 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:04:07.373980   38542 out.go:177] * Restarting existing hyperkit VM for "multinode-496000" ...
	I0311 04:04:07.417986   38542 main.go:141] libmachine: (multinode-496000) Calling .Start
	I0311 04:04:07.418283   38542 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:07.418310   38542 main.go:141] libmachine: (multinode-496000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.pid
	I0311 04:04:07.418468   38542 main.go:141] libmachine: (multinode-496000) DBG | Using UUID 80aee342-b58c-4e79-af6c-507c12cea3af
	I0311 04:04:07.437516   38542 main.go:141] libmachine: (multinode-496000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:04:07.437614   38542 fix.go:56] duration metric: took 94.009197ms for fixHost
	I0311 04:04:07.437624   38542 start.go:83] releasing machines lock for "multinode-496000", held for 94.045381ms
	W0311 04:04:07.437642   38542 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0311 04:04:07.437728   38542 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:04:07.437738   38542 start.go:728] Will try again in 5 seconds ...
	I0311 04:04:12.438655   38542 start.go:360] acquireMachinesLock for multinode-496000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:04:12.438827   38542 start.go:364] duration metric: took 110.66µs to acquireMachinesLock for "multinode-496000"
	I0311 04:04:12.438860   38542 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:04:12.438869   38542 fix.go:54] fixHost starting: 
	I0311 04:04:12.439292   38542 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:12.439333   38542 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:04:12.449081   38542 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62655
	I0311 04:04:12.449615   38542 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:04:12.450029   38542 main.go:141] libmachine: Using API Version  1
	I0311 04:04:12.450066   38542 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:04:12.450272   38542 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:04:12.450412   38542 main.go:141] libmachine: (multinode-496000) Calling .DriverName
	I0311 04:04:12.450502   38542 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:04:12.450580   38542 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:12.450604   38542 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:04:12.450618   38542 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:04:12.450633   38542 fix.go:112] recreateIfNeeded on multinode-496000: state=Stopped err=<nil>
	I0311 04:04:12.450644   38542 main.go:141] libmachine: (multinode-496000) Calling .DriverName
	W0311 04:04:12.450728   38542 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:04:12.472298   38542 out.go:177] * Restarting existing hyperkit VM for "multinode-496000" ...
	I0311 04:04:12.515059   38542 main.go:141] libmachine: (multinode-496000) Calling .Start
	I0311 04:04:12.515212   38542 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:12.515239   38542 main.go:141] libmachine: (multinode-496000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.pid
	I0311 04:04:12.515278   38542 main.go:141] libmachine: (multinode-496000) DBG | Using UUID 80aee342-b58c-4e79-af6c-507c12cea3af
	I0311 04:04:12.516594   38542 main.go:141] libmachine: (multinode-496000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:04:12.516647   38542 fix.go:56] duration metric: took 77.778031ms for fixHost
	I0311 04:04:12.516656   38542 start.go:83] releasing machines lock for "multinode-496000", held for 77.81577ms
	W0311 04:04:12.516727   38542 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-496000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-496000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:04:12.559335   38542 out.go:177] 
	W0311 04:04:12.581330   38542 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:04:12.581401   38542 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:04:12.581417   38542 out.go:239] * Related issues:
	* Related issues:
	W0311 04:04:12.581453   38542 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:04:12.581511   38542 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:04:12.624070   38542 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:328: failed to run minikube start. args "out/minikube-darwin-amd64 node list -p multinode-496000" : exit status 60
multinode_test.go:331: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-496000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000: exit status 7 (74.001224ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartKeepsNodes (9.08s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (0.31s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 node delete m03
multinode_test.go:416: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 node delete m03: exit status 83 (159.98226ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-496000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-496000"

                                                
                                                
-- /stdout --
multinode_test.go:418: node delete returned an error. args "out/minikube-darwin-amd64 -p multinode-496000 node delete m03": exit status 83
multinode_test.go:422: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status --alsologtostderr
multinode_test.go:422: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status --alsologtostderr: exit status 7 (75.032486ms)

                                                
                                                
-- stdout --
	multinode-496000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:04:13.071706   38562 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:04:13.072378   38562 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:04:13.072388   38562 out.go:304] Setting ErrFile to fd 2...
	I0311 04:04:13.072395   38562 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:04:13.072999   38562 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:04:13.073199   38562 out.go:298] Setting JSON to false
	I0311 04:04:13.073227   38562 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:04:13.073270   38562 notify.go:220] Checking for updates...
	I0311 04:04:13.073491   38562 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:04:13.073507   38562 status.go:255] checking status of multinode-496000 ...
	I0311 04:04:13.073887   38562 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:13.073922   38562 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:04:13.082059   38562 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62663
	I0311 04:04:13.082456   38562 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:04:13.082888   38562 main.go:141] libmachine: Using API Version  1
	I0311 04:04:13.082896   38562 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:04:13.083126   38562 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:04:13.083250   38562 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:04:13.083341   38562 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:13.083356   38562 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:04:13.083369   38562 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:04:13.083398   38562 status.go:330] multinode-496000 host status = "Stopped" (err=<nil>)
	I0311 04:04:13.083404   38562 status.go:343] host is not running, skipping remaining checks
	I0311 04:04:13.083410   38562 status.go:257] multinode-496000 status: &{Name:multinode-496000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:424: failed to run minikube status. args "out/minikube-darwin-amd64 -p multinode-496000 status --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000: exit status 7 (74.293848ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeleteNode (0.31s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (3.61s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 stop
multinode_test.go:345: (dbg) Done: out/minikube-darwin-amd64 -p multinode-496000 stop: (3.388253914s)
multinode_test.go:351: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status: exit status 7 (74.953614ms)

                                                
                                                
-- stdout --
	multinode-496000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:358: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-496000 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-496000 status --alsologtostderr: exit status 7 (74.772473ms)

                                                
                                                
-- stdout --
	multinode-496000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:04:16.684535   38590 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:04:16.684797   38590 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:04:16.684803   38590 out.go:304] Setting ErrFile to fd 2...
	I0311 04:04:16.684807   38590 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:04:16.684978   38590 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:04:16.685701   38590 out.go:298] Setting JSON to false
	I0311 04:04:16.685742   38590 mustload.go:65] Loading cluster: multinode-496000
	I0311 04:04:16.685965   38590 notify.go:220] Checking for updates...
	I0311 04:04:16.686397   38590 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:04:16.686422   38590 status.go:255] checking status of multinode-496000 ...
	I0311 04:04:16.686752   38590 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:16.686801   38590 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:04:16.694928   38590 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62682
	I0311 04:04:16.695266   38590 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:04:16.695675   38590 main.go:141] libmachine: Using API Version  1
	I0311 04:04:16.695685   38590 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:04:16.695947   38590 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:04:16.696064   38590 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:04:16.696145   38590 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:16.696165   38590 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:04:16.696187   38590 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:04:16.696242   38590 status.go:330] multinode-496000 host status = "Stopped" (err=<nil>)
	I0311 04:04:16.696255   38590 status.go:343] host is not running, skipping remaining checks
	I0311 04:04:16.696261   38590 status.go:257] multinode-496000 status: &{Name:multinode-496000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:364: incorrect number of stopped hosts: args "out/minikube-darwin-amd64 -p multinode-496000 status --alsologtostderr": multinode-496000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
multinode_test.go:368: incorrect number of stopped kubelets: args "out/minikube-darwin-amd64 -p multinode-496000 status --alsologtostderr": multinode-496000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000: exit status 7 (73.874669ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopMultiNode (3.61s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (5.83s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-496000 --wait=true -v=8 --alsologtostderr --driver=hyperkit 
multinode_test.go:376: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-496000 --wait=true -v=8 --alsologtostderr --driver=hyperkit : exit status 60 (5.753823099s)

                                                
                                                
-- stdout --
	* [multinode-496000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "multinode-496000" primary control-plane node in "multinode-496000" cluster
	* Restarting existing hyperkit VM for "multinode-496000" ...
	* Restarting existing hyperkit VM for "multinode-496000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:04:16.833363   38596 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:04:16.833741   38596 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:04:16.833748   38596 out.go:304] Setting ErrFile to fd 2...
	I0311 04:04:16.833753   38596 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:04:16.834083   38596 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:04:16.835552   38596 out.go:298] Setting JSON to false
	I0311 04:04:16.857661   38596 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11026,"bootTime":1710144030,"procs":469,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:04:16.857761   38596 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:04:16.880261   38596 out.go:177] * [multinode-496000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:04:16.924703   38596 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:04:16.924769   38596 notify.go:220] Checking for updates...
	I0311 04:04:16.946713   38596 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:04:16.967671   38596 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:04:16.988638   38596 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:04:17.009609   38596 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:04:17.030717   38596 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:04:17.052521   38596 config.go:182] Loaded profile config "multinode-496000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:04:17.053213   38596 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:17.053382   38596 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:04:17.062397   38596 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62688
	I0311 04:04:17.062787   38596 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:04:17.063208   38596 main.go:141] libmachine: Using API Version  1
	I0311 04:04:17.063226   38596 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:04:17.063443   38596 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:04:17.063561   38596 main.go:141] libmachine: (multinode-496000) Calling .DriverName
	I0311 04:04:17.063792   38596 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:04:17.064053   38596 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:17.064080   38596 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:04:17.071862   38596 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62690
	I0311 04:04:17.072182   38596 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:04:17.072540   38596 main.go:141] libmachine: Using API Version  1
	I0311 04:04:17.072556   38596 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:04:17.072770   38596 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:04:17.072875   38596 main.go:141] libmachine: (multinode-496000) Calling .DriverName
	I0311 04:04:17.101669   38596 out.go:177] * Using the hyperkit driver based on existing profile
	I0311 04:04:17.122551   38596 start.go:297] selected driver: hyperkit
	I0311 04:04:17.122579   38596 start.go:901] validating driver "hyperkit" against &{Name:multinode-496000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-496000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:04:17.122764   38596 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:04:17.122986   38596 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:04:17.123151   38596 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:04:17.132362   38596 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:04:17.136108   38596 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:17.136130   38596 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0311 04:04:17.138704   38596 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:04:17.138783   38596 cni.go:84] Creating CNI manager for ""
	I0311 04:04:17.138792   38596 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0311 04:04:17.138882   38596 start.go:340] cluster config:
	{Name:multinode-496000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-496000 Namespace:default APIServ
erHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disable
Metrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:04:17.138961   38596 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:04:17.181560   38596 out.go:177] * Starting "multinode-496000" primary control-plane node in "multinode-496000" cluster
	I0311 04:04:17.202538   38596 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:04:17.202612   38596 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:04:17.202641   38596 cache.go:56] Caching tarball of preloaded images
	I0311 04:04:17.202837   38596 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:04:17.202857   38596 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:04:17.202991   38596 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/multinode-496000/config.json ...
	I0311 04:04:17.203875   38596 start.go:360] acquireMachinesLock for multinode-496000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:04:17.203975   38596 start.go:364] duration metric: took 74.16µs to acquireMachinesLock for "multinode-496000"
	I0311 04:04:17.204014   38596 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:04:17.204033   38596 fix.go:54] fixHost starting: 
	I0311 04:04:17.204447   38596 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:17.204490   38596 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:04:17.213112   38596 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62692
	I0311 04:04:17.213471   38596 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:04:17.213883   38596 main.go:141] libmachine: Using API Version  1
	I0311 04:04:17.213902   38596 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:04:17.214117   38596 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:04:17.214248   38596 main.go:141] libmachine: (multinode-496000) Calling .DriverName
	I0311 04:04:17.214353   38596 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:04:17.214443   38596 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:17.214454   38596 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:04:17.214486   38596 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:04:17.214508   38596 fix.go:112] recreateIfNeeded on multinode-496000: state=Stopped err=<nil>
	I0311 04:04:17.214525   38596 main.go:141] libmachine: (multinode-496000) Calling .DriverName
	W0311 04:04:17.214607   38596 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:04:17.235619   38596 out.go:177] * Restarting existing hyperkit VM for "multinode-496000" ...
	I0311 04:04:17.256658   38596 main.go:141] libmachine: (multinode-496000) Calling .Start
	I0311 04:04:17.256901   38596 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:17.256948   38596 main.go:141] libmachine: (multinode-496000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.pid
	I0311 04:04:17.257037   38596 main.go:141] libmachine: (multinode-496000) DBG | Using UUID 80aee342-b58c-4e79-af6c-507c12cea3af
	I0311 04:04:17.259013   38596 main.go:141] libmachine: (multinode-496000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:04:17.259068   38596 fix.go:56] duration metric: took 55.039173ms for fixHost
	I0311 04:04:17.259075   38596 start.go:83] releasing machines lock for "multinode-496000", held for 55.087585ms
	W0311 04:04:17.259088   38596 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0311 04:04:17.259132   38596 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:04:17.259138   38596 start.go:728] Will try again in 5 seconds ...
	I0311 04:04:22.260388   38596 start.go:360] acquireMachinesLock for multinode-496000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:04:22.260590   38596 start.go:364] duration metric: took 144.812µs to acquireMachinesLock for "multinode-496000"
	I0311 04:04:22.260624   38596 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:04:22.260633   38596 fix.go:54] fixHost starting: 
	I0311 04:04:22.261106   38596 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:22.261148   38596 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:04:22.270512   38596 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62694
	I0311 04:04:22.270876   38596 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:04:22.271238   38596 main.go:141] libmachine: Using API Version  1
	I0311 04:04:22.271252   38596 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:04:22.271463   38596 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:04:22.271598   38596 main.go:141] libmachine: (multinode-496000) Calling .DriverName
	I0311 04:04:22.271687   38596 main.go:141] libmachine: (multinode-496000) Calling .GetState
	I0311 04:04:22.271770   38596 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:22.271785   38596 main.go:141] libmachine: (multinode-496000) DBG | hyperkit pid from json: 0
	I0311 04:04:22.271799   38596 main.go:141] libmachine: (multinode-496000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.json: no such file or directory
	I0311 04:04:22.271821   38596 fix.go:112] recreateIfNeeded on multinode-496000: state=Stopped err=<nil>
	I0311 04:04:22.271829   38596 main.go:141] libmachine: (multinode-496000) Calling .DriverName
	W0311 04:04:22.271912   38596 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:04:22.315515   38596 out.go:177] * Restarting existing hyperkit VM for "multinode-496000" ...
	I0311 04:04:22.337396   38596 main.go:141] libmachine: (multinode-496000) Calling .Start
	I0311 04:04:22.337634   38596 main.go:141] libmachine: (multinode-496000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:22.337651   38596 main.go:141] libmachine: (multinode-496000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/multinode-496000/hyperkit.pid
	I0311 04:04:22.337699   38596 main.go:141] libmachine: (multinode-496000) DBG | Using UUID 80aee342-b58c-4e79-af6c-507c12cea3af
	I0311 04:04:22.339481   38596 main.go:141] libmachine: (multinode-496000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:04:22.339565   38596 fix.go:56] duration metric: took 78.929783ms for fixHost
	I0311 04:04:22.339576   38596 start.go:83] releasing machines lock for "multinode-496000", held for 78.971687ms
	W0311 04:04:22.339648   38596 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-496000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-496000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:04:22.382675   38596 out.go:177] 
	W0311 04:04:22.404476   38596 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:04:22.404544   38596 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:04:22.404562   38596 out.go:239] * Related issues:
	* Related issues:
	W0311 04:04:22.404593   38596 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:04:22.404625   38596 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:04:22.446585   38596 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:378: failed to start cluster. args "out/minikube-darwin-amd64 start -p multinode-496000 --wait=true -v=8 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000: exit status 7 (76.115523ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartMultiNode (5.83s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (22.97s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-496000
multinode_test.go:464: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-496000-m01 --driver=hyperkit 
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-496000-m01 --driver=hyperkit : exit status 60 (11.260062721s)

                                                
                                                
-- stdout --
	* [multinode-496000-m01] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "multinode-496000-m01" primary control-plane node in "multinode-496000-m01" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "multinode-496000-m01" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-496000-m01" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-496000-m02 --driver=hyperkit 
multinode_test.go:472: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-496000-m02 --driver=hyperkit : exit status 60 (11.160563847s)

                                                
                                                
-- stdout --
	* [multinode-496000-m02] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "multinode-496000-m02" primary control-plane node in "multinode-496000-m02" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "multinode-496000-m02" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-496000-m02" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
multinode_test.go:474: failed to start profile. args "out/minikube-darwin-amd64 start -p multinode-496000-m02 --driver=hyperkit " : exit status 60
multinode_test.go:479: (dbg) Run:  out/minikube-darwin-amd64 node add -p multinode-496000
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p multinode-496000: exit status 83 (140.298835ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-496000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-496000"

                                                
                                                
-- /stdout --
multinode_test.go:484: (dbg) Run:  out/minikube-darwin-amd64 delete -p multinode-496000-m02
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-496000 -n multinode-496000: exit status 7 (75.090288ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-496000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ValidateNameConflict (22.97s)

                                                
                                    
x
+
TestPreload (11.54s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-darwin-amd64 start -p test-preload-134000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4
preload_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p test-preload-134000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4: exit status 60 (11.192742528s)

                                                
                                                
-- stdout --
	* [test-preload-134000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "test-preload-134000" primary control-plane node in "test-preload-134000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "test-preload-134000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:04:45.988654   38665 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:04:45.989242   38665 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:04:45.989252   38665 out.go:304] Setting ErrFile to fd 2...
	I0311 04:04:45.989258   38665 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:04:45.989861   38665 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:04:45.991361   38665 out.go:298] Setting JSON to false
	I0311 04:04:46.013957   38665 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11056,"bootTime":1710144030,"procs":467,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:04:46.014092   38665 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:04:46.037465   38665 out.go:177] * [test-preload-134000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:04:46.101434   38665 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:04:46.079833   38665 notify.go:220] Checking for updates...
	I0311 04:04:46.144543   38665 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:04:46.165516   38665 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:04:46.186631   38665 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:04:46.208494   38665 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:04:46.229574   38665 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:04:46.251312   38665 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:04:46.251464   38665 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:04:46.281418   38665 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:04:46.302329   38665 start.go:297] selected driver: hyperkit
	I0311 04:04:46.302353   38665 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:04:46.302371   38665 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:04:46.306019   38665 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:04:46.306129   38665 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:04:46.313945   38665 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:04:46.317730   38665 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:46.317758   38665 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0311 04:04:46.317792   38665 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:04:46.318010   38665 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:04:46.318070   38665 cni.go:84] Creating CNI manager for ""
	I0311 04:04:46.318085   38665 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:04:46.318092   38665 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0311 04:04:46.318154   38665 start.go:340] cluster config:
	{Name:test-preload-134000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-134000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAu
thSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:04:46.318238   38665 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:04:46.361583   38665 out.go:177] * Starting "test-preload-134000" primary control-plane node in "test-preload-134000" cluster
	I0311 04:04:46.382250   38665 preload.go:132] Checking if preload exists for k8s version v1.24.4 and runtime docker
	I0311 04:04:46.382437   38665 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/test-preload-134000/config.json ...
	I0311 04:04:46.382498   38665 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/test-preload-134000/config.json: {Name:mkf80a5e8b1e547fb4a84c4303969cf3c90f745f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:04:46.382610   38665 cache.go:107] acquiring lock: {Name:mk575988cb62127dcd9267ea1f2f82284485bac4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:04:46.382614   38665 cache.go:107] acquiring lock: {Name:mkbbc34819a6f2e4e0b5f8fbac64583fc58ed594 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:04:46.382648   38665 cache.go:107] acquiring lock: {Name:mkff9e79f06ad3acf56a5039448025b227bfb3ea Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:04:46.382889   38665 cache.go:107] acquiring lock: {Name:mk60337ab84f4c9fa8fdfdfe71023182b65df440 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:04:46.382916   38665 cache.go:107] acquiring lock: {Name:mk452c736f7656b34ea7691512e7ab4e59acc68a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:04:46.382903   38665 cache.go:107] acquiring lock: {Name:mk912199f8963df3966eca474f3285aba8c6eb5d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:04:46.382990   38665 cache.go:107] acquiring lock: {Name:mka8b6d46b335fc6c5caa131cecc4bd7b4b52adf Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:04:46.383059   38665 cache.go:107] acquiring lock: {Name:mke41544b200ac7ab5872a4c41ef51aeb67fb13e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:04:46.383429   38665 start.go:360] acquireMachinesLock for test-preload-134000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:04:46.383483   38665 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0311 04:04:46.383615   38665 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.4
	I0311 04:04:46.383626   38665 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I0311 04:04:46.383633   38665 start.go:364] duration metric: took 155.12µs to acquireMachinesLock for "test-preload-134000"
	I0311 04:04:46.383626   38665 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.24.4
	I0311 04:04:46.383688   38665 image.go:134] retrieving image: registry.k8s.io/pause:3.7
	I0311 04:04:46.383775   38665 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.24.4
	I0311 04:04:46.383694   38665 start.go:93] Provisioning new machine with config: &{Name:test-preload-134000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCon
fig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-134000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]
MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:04:46.383840   38665 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:04:46.383856   38665 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.24.4
	I0311 04:04:46.405633   38665 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:04:46.384024   38665 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I0311 04:04:46.406037   38665 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:46.406209   38665 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:04:46.415857   38665 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62734
	I0311 04:04:46.416195   38665 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:04:46.416589   38665 main.go:141] libmachine: Using API Version  1
	I0311 04:04:46.416599   38665 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:04:46.416823   38665 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:04:46.416925   38665 main.go:141] libmachine: (test-preload-134000) Calling .GetMachineName
	I0311 04:04:46.417003   38665 main.go:141] libmachine: (test-preload-134000) Calling .DriverName
	I0311 04:04:46.417097   38665 start.go:159] libmachine.API.Create for "test-preload-134000" (driver="hyperkit")
	I0311 04:04:46.417121   38665 client.go:168] LocalClient.Create starting
	I0311 04:04:46.417156   38665 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:04:46.417208   38665 main.go:141] libmachine: Decoding PEM data...
	I0311 04:04:46.417223   38665 main.go:141] libmachine: Parsing certificate...
	I0311 04:04:46.417271   38665 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:04:46.417306   38665 main.go:141] libmachine: Decoding PEM data...
	I0311 04:04:46.417318   38665 main.go:141] libmachine: Parsing certificate...
	I0311 04:04:46.417329   38665 main.go:141] libmachine: Running pre-create checks...
	I0311 04:04:46.417339   38665 main.go:141] libmachine: (test-preload-134000) Calling .PreCreateCheck
	I0311 04:04:46.417414   38665 main.go:141] libmachine: (test-preload-134000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:46.417589   38665 main.go:141] libmachine: (test-preload-134000) Calling .GetConfigRaw
	I0311 04:04:46.426860   38665 main.go:141] libmachine: Creating machine...
	I0311 04:04:46.426873   38665 main.go:141] libmachine: (test-preload-134000) Calling .Create
	I0311 04:04:46.427030   38665 main.go:141] libmachine: (test-preload-134000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:46.427251   38665 main.go:141] libmachine: (test-preload-134000) DBG | I0311 04:04:46.427015   38673 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:04:46.427347   38665 main.go:141] libmachine: (test-preload-134000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:04:46.438645   38665 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.4
	I0311 04:04:46.438685   38665 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0311 04:04:46.441865   38665 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.4
	I0311 04:04:46.441946   38665 image.go:177] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I0311 04:04:46.442029   38665 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I0311 04:04:46.442105   38665 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.4
	I0311 04:04:46.442464   38665 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I0311 04:04:46.442732   38665 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.4
	I0311 04:04:46.617287   38665 main.go:141] libmachine: (test-preload-134000) DBG | I0311 04:04:46.617144   38673 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/test-preload-134000/id_rsa...
	I0311 04:04:46.702905   38665 main.go:141] libmachine: (test-preload-134000) DBG | I0311 04:04:46.702763   38673 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/test-preload-134000/test-preload-134000.rawdisk...
	I0311 04:04:46.702954   38665 main.go:141] libmachine: (test-preload-134000) DBG | Writing magic tar header
	I0311 04:04:46.702996   38665 main.go:141] libmachine: (test-preload-134000) DBG | Writing SSH key tar header
	I0311 04:04:46.703496   38665 main.go:141] libmachine: (test-preload-134000) DBG | I0311 04:04:46.703466   38673 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/test-preload-134000 ...
	I0311 04:04:47.070237   38665 main.go:141] libmachine: (test-preload-134000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:47.070263   38665 main.go:141] libmachine: (test-preload-134000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/test-preload-134000/hyperkit.pid
	I0311 04:04:47.070273   38665 main.go:141] libmachine: (test-preload-134000) DBG | Using UUID 6987ded9-c095-44ae-81c3-3b0e66ea12c5
	I0311 04:04:47.087928   38665 main.go:141] libmachine: (test-preload-134000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:04:47.088069   38665 client.go:171] duration metric: took 670.927946ms to LocalClient.Create
	I0311 04:04:48.073531   38665 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4
	I0311 04:04:48.347841   38665 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4
	I0311 04:04:48.480632   38665 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6
	I0311 04:04:48.489309   38665 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4
	I0311 04:04:48.489978   38665 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7
	I0311 04:04:48.509589   38665 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4
	I0311 04:04:48.537666   38665 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.3-0
	I0311 04:04:48.540234   38665 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7 exists
	I0311 04:04:48.540253   38665 cache.go:96] cache image "registry.k8s.io/pause:3.7" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7" took 2.157431013s
	I0311 04:04:48.540262   38665 cache.go:80] save to tar file registry.k8s.io/pause:3.7 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7 succeeded
	I0311 04:04:48.731781   38665 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6 exists
	I0311 04:04:48.731801   38665 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.8.6" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6" took 2.348842813s
	I0311 04:04:48.731809   38665 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.8.6 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6 succeeded
	I0311 04:04:48.761062   38665 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5
	I0311 04:04:48.839879   38665 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4 exists
	I0311 04:04:48.839900   38665 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.24.4" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4" took 2.457071827s
	I0311 04:04:48.839908   38665 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.24.4 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4 succeeded
	I0311 04:04:48.908854   38665 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4 exists
	I0311 04:04:48.908870   38665 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.24.4" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4" took 2.526018383s
	I0311 04:04:48.908878   38665 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.24.4 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4 succeeded
	I0311 04:04:49.011575   38665 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4 exists
	I0311 04:04:49.011591   38665 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.24.4" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4" took 2.628933772s
	I0311 04:04:49.011599   38665 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.24.4 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4 succeeded
	I0311 04:04:49.038451   38665 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4 exists
	I0311 04:04:49.038468   38665 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.24.4" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4" took 2.655827502s
	I0311 04:04:49.038477   38665 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.24.4 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4 succeeded
	I0311 04:04:49.099705   38665 start.go:128] duration metric: took 2.715805265s to createHost
	I0311 04:04:49.099720   38665 start.go:83] releasing machines lock for "test-preload-134000", held for 2.71603367s
	W0311 04:04:49.099742   38665 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:04:49.100030   38665 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:49.100053   38665 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:04:49.108109   38665 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62751
	I0311 04:04:49.108438   38665 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:04:49.108769   38665 main.go:141] libmachine: Using API Version  1
	I0311 04:04:49.108782   38665 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:04:49.108964   38665 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:04:49.109310   38665 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:49.109334   38665 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:04:49.117181   38665 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62753
	I0311 04:04:49.117493   38665 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:04:49.117796   38665 main.go:141] libmachine: Using API Version  1
	I0311 04:04:49.117808   38665 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:04:49.117994   38665 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:04:49.118088   38665 main.go:141] libmachine: (test-preload-134000) Calling .GetState
	I0311 04:04:49.118163   38665 main.go:141] libmachine: (test-preload-134000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:49.118226   38665 main.go:141] libmachine: (test-preload-134000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/test-preload-134000/hyperkit.json: no such file or directory
	I0311 04:04:49.118238   38665 main.go:141] libmachine: (test-preload-134000) DBG | hyperkit pid from json: 0
	I0311 04:04:49.118264   38665 main.go:141] libmachine: (test-preload-134000) Calling .DriverName
	I0311 04:04:49.164457   38665 out.go:177] * Deleting "test-preload-134000" in hyperkit ...
	I0311 04:04:49.186770   38665 main.go:141] libmachine: (test-preload-134000) Calling .Remove
	I0311 04:04:49.186889   38665 main.go:141] libmachine: (test-preload-134000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:49.186898   38665 main.go:141] libmachine: (test-preload-134000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:49.186909   38665 main.go:141] libmachine: (test-preload-134000) DBG | hyperkit pid from json: 0
	I0311 04:04:49.186937   38665 main.go:141] libmachine: (test-preload-134000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/test-preload-134000/hyperkit.json: no such file or directory
	W0311 04:04:49.203779   38665 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:04:49.203796   38665 start.go:728] Will try again in 5 seconds ...
	I0311 04:04:49.972680   38665 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.3-0 exists
	I0311 04:04:49.972699   38665 cache.go:96] cache image "registry.k8s.io/etcd:3.5.3-0" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.3-0" took 3.589758049s
	I0311 04:04:49.972707   38665 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.3-0 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.3-0 succeeded
	I0311 04:04:50.518053   38665 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0311 04:04:50.518068   38665 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 4.135412797s
	I0311 04:04:50.518082   38665 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0311 04:04:50.518094   38665 cache.go:87] Successfully saved all images to host disk.
	I0311 04:04:54.204007   38665 start.go:360] acquireMachinesLock for test-preload-134000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:04:54.204258   38665 start.go:364] duration metric: took 214.3µs to acquireMachinesLock for "test-preload-134000"
	I0311 04:04:54.204286   38665 start.go:93] Provisioning new machine with config: &{Name:test-preload-134000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCon
fig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-134000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]
MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:04:54.204390   38665 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:04:54.249939   38665 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:04:54.250104   38665 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 04:04:54.250149   38665 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:04:54.260239   38665 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62755
	I0311 04:04:54.260761   38665 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:04:54.261167   38665 main.go:141] libmachine: Using API Version  1
	I0311 04:04:54.261241   38665 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:04:54.261530   38665 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:04:54.261634   38665 main.go:141] libmachine: (test-preload-134000) Calling .GetMachineName
	I0311 04:04:54.261708   38665 main.go:141] libmachine: (test-preload-134000) Calling .DriverName
	I0311 04:04:54.261803   38665 start.go:159] libmachine.API.Create for "test-preload-134000" (driver="hyperkit")
	I0311 04:04:54.261823   38665 client.go:168] LocalClient.Create starting
	I0311 04:04:54.261851   38665 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:04:54.261898   38665 main.go:141] libmachine: Decoding PEM data...
	I0311 04:04:54.261910   38665 main.go:141] libmachine: Parsing certificate...
	I0311 04:04:54.261949   38665 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:04:54.261986   38665 main.go:141] libmachine: Decoding PEM data...
	I0311 04:04:54.262001   38665 main.go:141] libmachine: Parsing certificate...
	I0311 04:04:54.262012   38665 main.go:141] libmachine: Running pre-create checks...
	I0311 04:04:54.262018   38665 main.go:141] libmachine: (test-preload-134000) Calling .PreCreateCheck
	I0311 04:04:54.262096   38665 main.go:141] libmachine: (test-preload-134000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:54.262128   38665 main.go:141] libmachine: (test-preload-134000) Calling .GetConfigRaw
	I0311 04:04:54.262552   38665 main.go:141] libmachine: Creating machine...
	I0311 04:04:54.262559   38665 main.go:141] libmachine: (test-preload-134000) Calling .Create
	I0311 04:04:54.262636   38665 main.go:141] libmachine: (test-preload-134000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:54.262753   38665 main.go:141] libmachine: (test-preload-134000) DBG | I0311 04:04:54.262630   38709 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:04:54.262798   38665 main.go:141] libmachine: (test-preload-134000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:04:54.440215   38665 main.go:141] libmachine: (test-preload-134000) DBG | I0311 04:04:54.440155   38709 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/test-preload-134000/id_rsa...
	I0311 04:04:54.552867   38665 main.go:141] libmachine: (test-preload-134000) DBG | I0311 04:04:54.552792   38709 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/test-preload-134000/test-preload-134000.rawdisk...
	I0311 04:04:54.552889   38665 main.go:141] libmachine: (test-preload-134000) DBG | Writing magic tar header
	I0311 04:04:54.552901   38665 main.go:141] libmachine: (test-preload-134000) DBG | Writing SSH key tar header
	I0311 04:04:54.553547   38665 main.go:141] libmachine: (test-preload-134000) DBG | I0311 04:04:54.553494   38709 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/test-preload-134000 ...
	I0311 04:04:54.911033   38665 main.go:141] libmachine: (test-preload-134000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0311 04:04:54.911061   38665 main.go:141] libmachine: (test-preload-134000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/test-preload-134000/hyperkit.pid
	I0311 04:04:54.911110   38665 main.go:141] libmachine: (test-preload-134000) DBG | Using UUID 929ebb69-51fc-48cb-a423-42c3839c859e
	I0311 04:04:54.927097   38665 main.go:141] libmachine: (test-preload-134000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:04:54.927186   38665 client.go:171] duration metric: took 665.346702ms to LocalClient.Create
	I0311 04:04:56.928317   38665 start.go:128] duration metric: took 2.723867171s to createHost
	I0311 04:04:56.928334   38665 start.go:83] releasing machines lock for "test-preload-134000", held for 2.724023577s
	W0311 04:04:56.928443   38665 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p test-preload-134000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p test-preload-134000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:04:56.970754   38665 out.go:177] 
	W0311 04:04:56.993873   38665 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:04:56.993944   38665 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:04:56.993976   38665 out.go:239] * Related issues:
	* Related issues:
	W0311 04:04:56.994066   38665 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:04:56.994094   38665 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:04:57.057811   38665 out.go:177] 

                                                
                                                
** /stderr **
preload_test.go:46: out/minikube-darwin-amd64 start -p test-preload-134000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4 failed: exit status 60
panic.go:626: *** TestPreload FAILED at 2024-03-11 04:04:57.123668 -0700 PDT m=+1123.395900611
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p test-preload-134000 -n test-preload-134000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p test-preload-134000 -n test-preload-134000: exit status 7 (75.812914ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "test-preload-134000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "test-preload-134000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p test-preload-134000
--- FAIL: TestPreload (11.54s)

                                                
                                    
x
+
TestScheduledStopUnix (11.45s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-darwin-amd64 start -p scheduled-stop-183000 --memory=2048 --driver=hyperkit 
scheduled_stop_test.go:128: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p scheduled-stop-183000 --memory=2048 --driver=hyperkit : exit status 60 (11.104667915s)

                                                
                                                
-- stdout --
	* [scheduled-stop-183000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "scheduled-stop-183000" primary control-plane node in "scheduled-stop-183000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "scheduled-stop-183000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p scheduled-stop-183000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
scheduled_stop_test.go:130: starting minikube: exit status 60

                                                
                                                
-- stdout --
	* [scheduled-stop-183000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "scheduled-stop-183000" primary control-plane node in "scheduled-stop-183000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "scheduled-stop-183000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p scheduled-stop-183000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
panic.go:626: *** TestScheduledStopUnix FAILED at 2024-03-11 04:05:08.5724 -0700 PDT m=+1134.844463491
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p scheduled-stop-183000 -n scheduled-stop-183000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p scheduled-stop-183000 -n scheduled-stop-183000: exit status 7 (76.658289ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "scheduled-stop-183000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "scheduled-stop-183000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p scheduled-stop-183000
--- FAIL: TestScheduledStopUnix (11.45s)

                                                
                                    
x
+
TestSkaffold (17.87s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:59: (dbg) Run:  /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/skaffold.exe932644812 version
skaffold_test.go:63: skaffold version: v2.10.0
skaffold_test.go:66: (dbg) Run:  out/minikube-darwin-amd64 start -p skaffold-217000 --memory=2600 --driver=hyperkit 
skaffold_test.go:66: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p skaffold-217000 --memory=2600 --driver=hyperkit : exit status 60 (11.351998286s)

                                                
                                                
-- stdout --
	* [skaffold-217000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "skaffold-217000" primary control-plane node in "skaffold-217000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	* Deleting "skaffold-217000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p skaffold-217000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
skaffold_test.go:68: starting minikube: exit status 60

                                                
                                                
-- stdout --
	* [skaffold-217000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "skaffold-217000" primary control-plane node in "skaffold-217000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	* Deleting "skaffold-217000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p skaffold-217000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
panic.go:626: *** TestSkaffold FAILED at 2024-03-11 04:05:26.441448 -0700 PDT m=+1152.713246698
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p skaffold-217000 -n skaffold-217000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p skaffold-217000 -n skaffold-217000: exit status 7 (75.008714ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "skaffold-217000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "skaffold-217000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p skaffold-217000
--- FAIL: TestSkaffold (17.87s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (63.01s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube-v1.26.0.1972098824 start -p running-upgrade-828000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:120: (dbg) Non-zero exit: /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube-v1.26.0.1972098824 start -p running-upgrade-828000 --memory=2200 --vm-driver=hyperkit : exit status 60 (44.246271328s)

                                                
                                                
-- stdout --
	* [running-upgrade-828000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/legacy_kubeconfig64275677
	* Using the hyperkit driver based on user configuration
	* Downloading VM boot image ...
	* minikube 1.32.0 is available! Download it: https://github.com/kubernetes/minikube/releases/tag/v1.32.0
	* To disable this notice, run: 'minikube config set WantUpdateNotification false'
	
	* Starting control plane node running-upgrade-828000 in cluster running-upgrade-828000
	* Downloading Kubernetes v1.24.1 preload ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "running-upgrade-828000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p running-upgrade-828000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:120: (dbg) Run:  /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube-v1.26.0.1972098824 start -p running-upgrade-828000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:120: (dbg) Non-zero exit: /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube-v1.26.0.1972098824 start -p running-upgrade-828000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.756162536s)

                                                
                                                
-- stdout --
	* [running-upgrade-828000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/legacy_kubeconfig3853118677
	* Using the hyperkit driver based on existing profile
	* Starting control plane node running-upgrade-828000 in cluster running-upgrade-828000
	* Restarting existing hyperkit VM for "running-upgrade-828000" ...
	* Restarting existing hyperkit VM for "running-upgrade-828000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p running-upgrade-828000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:120: (dbg) Run:  /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube-v1.26.0.1972098824 start -p running-upgrade-828000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:120: (dbg) Non-zero exit: /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube-v1.26.0.1972098824 start -p running-upgrade-828000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.838227446s)

                                                
                                                
-- stdout --
	* [running-upgrade-828000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/legacy_kubeconfig2480767815
	* Using the hyperkit driver based on existing profile
	* Starting control plane node running-upgrade-828000 in cluster running-upgrade-828000
	* Restarting existing hyperkit VM for "running-upgrade-828000" ...
	* Restarting existing hyperkit VM for "running-upgrade-828000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p running-upgrade-828000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:126: legacy v1.26.0 start failed: exit status 60
panic.go:626: *** TestRunningBinaryUpgrade FAILED at 2024-03-11 04:07:30.201609 -0700 PDT m=+1276.471575918
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p running-upgrade-828000 -n running-upgrade-828000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p running-upgrade-828000 -n running-upgrade-828000: exit status 7 (75.063122ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "running-upgrade-828000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "running-upgrade-828000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p running-upgrade-828000
--- FAIL: TestRunningBinaryUpgrade (63.01s)

                                                
                                    
x
+
TestKubernetesUpgrade (21.13s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-darwin-amd64 start -p kubernetes-upgrade-905000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=hyperkit 
version_upgrade_test.go:222: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubernetes-upgrade-905000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=hyperkit : exit status 60 (11.160596041s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-905000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "kubernetes-upgrade-905000" primary control-plane node in "kubernetes-upgrade-905000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "kubernetes-upgrade-905000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:07:30.609788   39140 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:07:30.610463   39140 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:07:30.610472   39140 out.go:304] Setting ErrFile to fd 2...
	I0311 04:07:30.610478   39140 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:07:30.610927   39140 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:07:30.612883   39140 out.go:298] Setting JSON to false
	I0311 04:07:30.635333   39140 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11220,"bootTime":1710144030,"procs":468,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:07:30.635427   39140 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:07:30.658370   39140 out.go:177] * [kubernetes-upgrade-905000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:07:30.701136   39140 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:07:30.701227   39140 notify.go:220] Checking for updates...
	I0311 04:07:30.745004   39140 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:07:30.768060   39140 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:07:30.789286   39140 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:07:30.810931   39140 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:07:30.832041   39140 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:07:30.854080   39140 config.go:182] Loaded profile config "cert-expiration-991000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:07:30.854280   39140 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:07:30.854456   39140 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:07:30.885866   39140 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:07:30.929097   39140 start.go:297] selected driver: hyperkit
	I0311 04:07:30.929130   39140 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:07:30.929153   39140 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:07:30.933453   39140 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:07:30.933568   39140 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:07:30.941247   39140 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:07:30.945082   39140 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:07:30.945103   39140 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:07:30.945130   39140 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:07:30.945340   39140 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0311 04:07:30.945392   39140 cni.go:84] Creating CNI manager for ""
	I0311 04:07:30.945412   39140 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0311 04:07:30.945478   39140 start.go:340] cluster config:
	{Name:kubernetes-upgrade-905000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-905000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:07:30.945568   39140 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:07:30.988117   39140 out.go:177] * Starting "kubernetes-upgrade-905000" primary control-plane node in "kubernetes-upgrade-905000" cluster
	I0311 04:07:31.009927   39140 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0311 04:07:31.009972   39140 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0311 04:07:31.009997   39140 cache.go:56] Caching tarball of preloaded images
	I0311 04:07:31.010128   39140 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:07:31.010139   39140 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0311 04:07:31.010243   39140 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/kubernetes-upgrade-905000/config.json ...
	I0311 04:07:31.010266   39140 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/kubernetes-upgrade-905000/config.json: {Name:mkb5d4cae88117fd1c662ed0902a9912bdcbe67a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:07:31.010798   39140 start.go:360] acquireMachinesLock for kubernetes-upgrade-905000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:07:31.010876   39140 start.go:364] duration metric: took 58.978µs to acquireMachinesLock for "kubernetes-upgrade-905000"
	I0311 04:07:31.010904   39140 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-905000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-905000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt
imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:07:31.010941   39140 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:07:31.031814   39140 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:07:31.031962   39140 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:07:31.032002   39140 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:07:31.039979   39140 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62992
	I0311 04:07:31.040581   39140 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:07:31.041044   39140 main.go:141] libmachine: Using API Version  1
	I0311 04:07:31.041055   39140 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:07:31.041300   39140 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:07:31.041406   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .GetMachineName
	I0311 04:07:31.041507   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .DriverName
	I0311 04:07:31.041631   39140 start.go:159] libmachine.API.Create for "kubernetes-upgrade-905000" (driver="hyperkit")
	I0311 04:07:31.041663   39140 client.go:168] LocalClient.Create starting
	I0311 04:07:31.041696   39140 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:07:31.041742   39140 main.go:141] libmachine: Decoding PEM data...
	I0311 04:07:31.041758   39140 main.go:141] libmachine: Parsing certificate...
	I0311 04:07:31.041821   39140 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:07:31.041859   39140 main.go:141] libmachine: Decoding PEM data...
	I0311 04:07:31.041871   39140 main.go:141] libmachine: Parsing certificate...
	I0311 04:07:31.041883   39140 main.go:141] libmachine: Running pre-create checks...
	I0311 04:07:31.041889   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .PreCreateCheck
	I0311 04:07:31.041975   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:07:31.042123   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .GetConfigRaw
	I0311 04:07:31.042541   39140 main.go:141] libmachine: Creating machine...
	I0311 04:07:31.042550   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .Create
	I0311 04:07:31.042622   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:07:31.042729   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | I0311 04:07:31.042612   39148 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:07:31.042784   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:07:31.232855   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | I0311 04:07:31.232719   39148 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubernetes-upgrade-905000/id_rsa...
	I0311 04:07:31.395498   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | I0311 04:07:31.395418   39148 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubernetes-upgrade-905000/kubernetes-upgrade-905000.rawdisk...
	I0311 04:07:31.395510   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | Writing magic tar header
	I0311 04:07:31.395519   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | Writing SSH key tar header
	I0311 04:07:31.396285   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | I0311 04:07:31.396191   39148 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubernetes-upgrade-905000 ...
	I0311 04:07:31.756599   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:07:31.756637   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubernetes-upgrade-905000/hyperkit.pid
	I0311 04:07:31.756685   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | Using UUID 3dc98e2b-5876-431a-8bd6-aaba2a58c918
	I0311 04:07:31.777459   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:07:31.777563   39140 client.go:171] duration metric: took 735.880035ms to LocalClient.Create
	I0311 04:07:33.778719   39140 start.go:128] duration metric: took 2.767720514s to createHost
	I0311 04:07:33.778794   39140 start.go:83] releasing machines lock for "kubernetes-upgrade-905000", held for 2.767827937s
	W0311 04:07:33.778824   39140 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:07:33.779382   39140 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:07:33.779423   39140 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:07:33.788561   39140 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62994
	I0311 04:07:33.788903   39140 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:07:33.789258   39140 main.go:141] libmachine: Using API Version  1
	I0311 04:07:33.789268   39140 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:07:33.789515   39140 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:07:33.789857   39140 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:07:33.789882   39140 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:07:33.797905   39140 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62996
	I0311 04:07:33.798254   39140 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:07:33.798583   39140 main.go:141] libmachine: Using API Version  1
	I0311 04:07:33.798594   39140 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:07:33.798791   39140 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:07:33.798892   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .GetState
	I0311 04:07:33.798975   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:07:33.798994   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubernetes-upgrade-905000/hyperkit.json: no such file or directory
	I0311 04:07:33.799000   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | hyperkit pid from json: 0
	I0311 04:07:33.799071   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .DriverName
	I0311 04:07:33.842603   39140 out.go:177] * Deleting "kubernetes-upgrade-905000" in hyperkit ...
	I0311 04:07:33.863428   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .Remove
	I0311 04:07:33.863737   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:07:33.863759   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:07:33.863791   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubernetes-upgrade-905000/hyperkit.json: no such file or directory
	I0311 04:07:33.863886   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | hyperkit pid from json: 0
	W0311 04:07:33.882806   39140 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:07:33.882820   39140 start.go:728] Will try again in 5 seconds ...
	I0311 04:07:38.885110   39140 start.go:360] acquireMachinesLock for kubernetes-upgrade-905000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:07:38.885315   39140 start.go:364] duration metric: took 161.169µs to acquireMachinesLock for "kubernetes-upgrade-905000"
	I0311 04:07:38.885354   39140 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-905000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-905000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt
imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:07:38.885473   39140 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:07:38.910009   39140 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:07:38.910158   39140 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:07:38.910222   39140 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:07:38.919686   39140 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62998
	I0311 04:07:38.920050   39140 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:07:38.920388   39140 main.go:141] libmachine: Using API Version  1
	I0311 04:07:38.920404   39140 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:07:38.920595   39140 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:07:38.920692   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .GetMachineName
	I0311 04:07:38.920780   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .DriverName
	I0311 04:07:38.920881   39140 start.go:159] libmachine.API.Create for "kubernetes-upgrade-905000" (driver="hyperkit")
	I0311 04:07:38.920897   39140 client.go:168] LocalClient.Create starting
	I0311 04:07:38.920923   39140 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:07:38.920988   39140 main.go:141] libmachine: Decoding PEM data...
	I0311 04:07:38.920999   39140 main.go:141] libmachine: Parsing certificate...
	I0311 04:07:38.921036   39140 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:07:38.921070   39140 main.go:141] libmachine: Decoding PEM data...
	I0311 04:07:38.921080   39140 main.go:141] libmachine: Parsing certificate...
	I0311 04:07:38.921092   39140 main.go:141] libmachine: Running pre-create checks...
	I0311 04:07:38.921097   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .PreCreateCheck
	I0311 04:07:38.921173   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:07:38.921216   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .GetConfigRaw
	I0311 04:07:38.921674   39140 main.go:141] libmachine: Creating machine...
	I0311 04:07:38.921683   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .Create
	I0311 04:07:38.921757   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:07:38.921861   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | I0311 04:07:38.921744   39154 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:07:38.921933   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:07:39.109940   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | I0311 04:07:39.109845   39154 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubernetes-upgrade-905000/id_rsa...
	I0311 04:07:39.197217   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | I0311 04:07:39.197132   39154 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubernetes-upgrade-905000/kubernetes-upgrade-905000.rawdisk...
	I0311 04:07:39.197230   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | Writing magic tar header
	I0311 04:07:39.197275   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | Writing SSH key tar header
	I0311 04:07:39.197959   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | I0311 04:07:39.197872   39154 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubernetes-upgrade-905000 ...
	I0311 04:07:39.556932   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:07:39.556970   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubernetes-upgrade-905000/hyperkit.pid
	I0311 04:07:39.557006   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | Using UUID 54afe81d-df09-4818-ae61-709144258ca4
	I0311 04:07:39.573318   39140 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:07:39.573391   39140 client.go:171] duration metric: took 652.477641ms to LocalClient.Create
	I0311 04:07:41.574691   39140 start.go:128] duration metric: took 2.689165087s to createHost
	I0311 04:07:41.574709   39140 start.go:83] releasing machines lock for "kubernetes-upgrade-905000", held for 2.689340485s
	W0311 04:07:41.574797   39140 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-905000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-905000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:07:41.595670   39140 out.go:177] 
	W0311 04:07:41.618364   39140 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:07:41.618428   39140 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:07:41.618446   39140 out.go:239] * Related issues:
	* Related issues:
	W0311 04:07:41.618479   39140 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:07:41.618533   39140 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:07:41.644597   39140 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:224: failed to start minikube HEAD with oldest k8s version: out/minikube-darwin-amd64 start -p kubernetes-upgrade-905000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=hyperkit : exit status 60
version_upgrade_test.go:227: (dbg) Run:  out/minikube-darwin-amd64 stop -p kubernetes-upgrade-905000
version_upgrade_test.go:227: (dbg) Done: out/minikube-darwin-amd64 stop -p kubernetes-upgrade-905000: (3.691546888s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-darwin-amd64 -p kubernetes-upgrade-905000 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p kubernetes-upgrade-905000 status --format={{.Host}}: exit status 7 (74.932145ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 start -p kubernetes-upgrade-905000 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=hyperkit 
version_upgrade_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubernetes-upgrade-905000 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=hyperkit : exit status 60 (5.813387324s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-905000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "kubernetes-upgrade-905000" primary control-plane node in "kubernetes-upgrade-905000" cluster
	* Restarting existing hyperkit VM for "kubernetes-upgrade-905000" ...
	* Restarting existing hyperkit VM for "kubernetes-upgrade-905000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:07:45.539544   39182 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:07:45.539798   39182 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:07:45.539803   39182 out.go:304] Setting ErrFile to fd 2...
	I0311 04:07:45.539808   39182 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:07:45.540001   39182 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:07:45.541482   39182 out.go:298] Setting JSON to false
	I0311 04:07:45.563839   39182 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11235,"bootTime":1710144030,"procs":466,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:07:45.563936   39182 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:07:45.586215   39182 out.go:177] * [kubernetes-upgrade-905000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:07:45.628940   39182 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:07:45.629026   39182 notify.go:220] Checking for updates...
	I0311 04:07:45.671739   39182 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:07:45.693855   39182 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:07:45.715563   39182 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:07:45.736968   39182 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:07:45.758944   39182 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:07:45.781362   39182 config.go:182] Loaded profile config "kubernetes-upgrade-905000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0311 04:07:45.782021   39182 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:07:45.782095   39182 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:07:45.790957   39182 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63015
	I0311 04:07:45.791319   39182 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:07:45.791769   39182 main.go:141] libmachine: Using API Version  1
	I0311 04:07:45.791805   39182 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:07:45.792059   39182 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:07:45.792177   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .DriverName
	I0311 04:07:45.792386   39182 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:07:45.792644   39182 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:07:45.792673   39182 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:07:45.800183   39182 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63017
	I0311 04:07:45.800488   39182 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:07:45.800831   39182 main.go:141] libmachine: Using API Version  1
	I0311 04:07:45.800849   39182 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:07:45.801029   39182 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:07:45.801130   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .DriverName
	I0311 04:07:45.829608   39182 out.go:177] * Using the hyperkit driver based on existing profile
	I0311 04:07:45.872617   39182 start.go:297] selected driver: hyperkit
	I0311 04:07:45.872649   39182 start.go:901] validating driver "hyperkit" against &{Name:kubernetes-upgrade-905000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-905000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt
imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:07:45.872808   39182 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:07:45.877175   39182 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:07:45.877282   39182 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:07:45.885067   39182 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:07:45.888856   39182 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:07:45.888879   39182 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:07:45.889059   39182 cni.go:84] Creating CNI manager for ""
	I0311 04:07:45.889073   39182 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:07:45.889112   39182 start.go:340] cluster config:
	{Name:kubernetes-upgrade-905000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:kubernetes-upgrade-905000 Na
mespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMne
tClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:07:45.889198   39182 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:07:45.932964   39182 out.go:177] * Starting "kubernetes-upgrade-905000" primary control-plane node in "kubernetes-upgrade-905000" cluster
	I0311 04:07:45.954490   39182 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0311 04:07:45.954527   39182 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0311 04:07:45.954544   39182 cache.go:56] Caching tarball of preloaded images
	I0311 04:07:45.954689   39182 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:07:45.954705   39182 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0311 04:07:45.954815   39182 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/kubernetes-upgrade-905000/config.json ...
	I0311 04:07:45.955262   39182 start.go:360] acquireMachinesLock for kubernetes-upgrade-905000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:07:45.955313   39182 start.go:364] duration metric: took 39.062µs to acquireMachinesLock for "kubernetes-upgrade-905000"
	I0311 04:07:45.955333   39182 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:07:45.955342   39182 fix.go:54] fixHost starting: 
	I0311 04:07:45.955621   39182 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:07:45.955647   39182 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:07:45.963677   39182 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63019
	I0311 04:07:45.964042   39182 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:07:45.964374   39182 main.go:141] libmachine: Using API Version  1
	I0311 04:07:45.964384   39182 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:07:45.964610   39182 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:07:45.964717   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .DriverName
	I0311 04:07:45.964798   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .GetState
	I0311 04:07:45.964887   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:07:45.964897   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | hyperkit pid from json: 0
	I0311 04:07:45.964908   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubernetes-upgrade-905000/hyperkit.json: no such file or directory
	I0311 04:07:45.964955   39182 fix.go:112] recreateIfNeeded on kubernetes-upgrade-905000: state=Stopped err=<nil>
	I0311 04:07:45.964981   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .DriverName
	W0311 04:07:45.965063   39182 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:07:46.007917   39182 out.go:177] * Restarting existing hyperkit VM for "kubernetes-upgrade-905000" ...
	I0311 04:07:46.029571   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .Start
	I0311 04:07:46.029785   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:07:46.029892   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubernetes-upgrade-905000/hyperkit.pid
	I0311 04:07:46.029952   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | Using UUID 54afe81d-df09-4818-ae61-709144258ca4
	I0311 04:07:46.031358   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:07:46.031476   39182 fix.go:56] duration metric: took 76.128447ms for fixHost
	I0311 04:07:46.031487   39182 start.go:83] releasing machines lock for "kubernetes-upgrade-905000", held for 76.165762ms
	W0311 04:07:46.031506   39182 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0311 04:07:46.031560   39182 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:07:46.031569   39182 start.go:728] Will try again in 5 seconds ...
	I0311 04:07:51.032833   39182 start.go:360] acquireMachinesLock for kubernetes-upgrade-905000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:07:51.033037   39182 start.go:364] duration metric: took 164.8µs to acquireMachinesLock for "kubernetes-upgrade-905000"
	I0311 04:07:51.033079   39182 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:07:51.033088   39182 fix.go:54] fixHost starting: 
	I0311 04:07:51.033540   39182 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:07:51.033582   39182 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:07:51.042870   39182 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63021
	I0311 04:07:51.043220   39182 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:07:51.043594   39182 main.go:141] libmachine: Using API Version  1
	I0311 04:07:51.043610   39182 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:07:51.043839   39182 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:07:51.043948   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .DriverName
	I0311 04:07:51.044037   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .GetState
	I0311 04:07:51.044109   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:07:51.044129   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubernetes-upgrade-905000/hyperkit.json: no such file or directory
	I0311 04:07:51.044136   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | hyperkit pid from json: 0
	I0311 04:07:51.044163   39182 fix.go:112] recreateIfNeeded on kubernetes-upgrade-905000: state=Stopped err=<nil>
	I0311 04:07:51.044172   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .DriverName
	W0311 04:07:51.044261   39182 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:07:51.066400   39182 out.go:177] * Restarting existing hyperkit VM for "kubernetes-upgrade-905000" ...
	I0311 04:07:51.088356   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) Calling .Start
	I0311 04:07:51.088646   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:07:51.088678   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubernetes-upgrade-905000/hyperkit.pid
	I0311 04:07:51.088738   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | Using UUID 54afe81d-df09-4818-ae61-709144258ca4
	I0311 04:07:51.114879   39182 main.go:141] libmachine: (kubernetes-upgrade-905000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:07:51.114981   39182 fix.go:56] duration metric: took 81.890964ms for fixHost
	I0311 04:07:51.114997   39182 start.go:83] releasing machines lock for "kubernetes-upgrade-905000", held for 81.93912ms
	W0311 04:07:51.115081   39182 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-905000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-905000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:07:51.163874   39182 out.go:177] 
	W0311 04:07:51.185902   39182 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:07:51.186008   39182 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:07:51.186032   39182 out.go:239] * Related issues:
	* Related issues:
	W0311 04:07:51.186057   39182 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:07:51.186147   39182 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:07:51.228762   39182 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:245: failed to upgrade with newest k8s version. args: out/minikube-darwin-amd64 start -p kubernetes-upgrade-905000 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=hyperkit  : exit status 60
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-905000 version --output=json
version_upgrade_test.go:248: (dbg) Non-zero exit: kubectl --context kubernetes-upgrade-905000 version --output=json: exit status 1 (37.702285ms)

                                                
                                                
** stderr ** 
	error: context "kubernetes-upgrade-905000" does not exist

                                                
                                                
** /stderr **
version_upgrade_test.go:250: error running kubectl: exit status 1
panic.go:626: *** TestKubernetesUpgrade FAILED at 2024-03-11 04:07:51.330301 -0700 PDT m=+1297.599955512
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p kubernetes-upgrade-905000 -n kubernetes-upgrade-905000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p kubernetes-upgrade-905000 -n kubernetes-upgrade-905000: exit status 7 (74.382523ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "kubernetes-upgrade-905000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "kubernetes-upgrade-905000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p kubernetes-upgrade-905000
--- FAIL: TestKubernetesUpgrade (21.13s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (25.5s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube-v1.26.0.1671816182 start -p stopped-upgrade-392000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:183: (dbg) Non-zero exit: /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube-v1.26.0.1671816182 start -p stopped-upgrade-392000 --memory=2200 --vm-driver=hyperkit : exit status 60 (11.600961275s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-392000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/legacy_kubeconfig609861033
	* Using the hyperkit driver based on user configuration
	* Starting control plane node stopped-upgrade-392000 in cluster stopped-upgrade-392000
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "stopped-upgrade-392000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-392000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:183: (dbg) Run:  /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube-v1.26.0.1671816182 start -p stopped-upgrade-392000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:183: (dbg) Non-zero exit: /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube-v1.26.0.1671816182 start -p stopped-upgrade-392000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.855667658s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-392000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/legacy_kubeconfig3008704852
	* Using the hyperkit driver based on existing profile
	* Starting control plane node stopped-upgrade-392000 in cluster stopped-upgrade-392000
	* Restarting existing hyperkit VM for "stopped-upgrade-392000" ...
	* Restarting existing hyperkit VM for "stopped-upgrade-392000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-392000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:183: (dbg) Run:  /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube-v1.26.0.1671816182 start -p stopped-upgrade-392000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:183: (dbg) Non-zero exit: /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/minikube-v1.26.0.1671816182 start -p stopped-upgrade-392000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.794092277s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-392000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/legacy_kubeconfig1147111585
	* Using the hyperkit driver based on existing profile
	* Starting control plane node stopped-upgrade-392000 in cluster stopped-upgrade-392000
	* Restarting existing hyperkit VM for "stopped-upgrade-392000" ...
	* Restarting existing hyperkit VM for "stopped-upgrade-392000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-392000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:189: legacy v1.26.0 start failed: exit status 60
--- FAIL: TestStoppedBinaryUpgrade/Upgrade (25.50s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (0.33s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-darwin-amd64 logs -p stopped-upgrade-392000
version_upgrade_test.go:206: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p stopped-upgrade-392000: exit status 83 (323.427378ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| Command |                         Args                         |          Profile          |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| ssh     | -p cilium-040000 sudo cat                            | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | /etc/hosts                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo cat                            | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | /etc/resolv.conf                                     |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo crictl                         | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | pods                                                 |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo crictl                         | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | ps --all                                             |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo find                           | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | /etc/cni -type f -exec sh -c                         |                           |         |         |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo ip a s                         | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	| ssh     | -p cilium-040000 sudo ip r s                         | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	| ssh     | -p cilium-040000 sudo                                | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | iptables-save                                        |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo iptables                       | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | -t nat -L -n -v                                      |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo                                | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | systemctl status kubelet --all                       |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo                                | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | systemctl cat kubelet                                |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo                                | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | journalctl -xeu kubelet --all                        |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo cat                            | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | /etc/kubernetes/kubelet.conf                         |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo cat                            | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | /var/lib/kubelet/config.yaml                         |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo                                | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | systemctl status docker --all                        |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo                                | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | systemctl cat docker                                 |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo cat                            | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | /etc/docker/daemon.json                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo docker                         | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | system info                                          |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo                                | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | systemctl status cri-docker                          |                           |         |         |                     |                     |
	|         | --all --full --no-pager                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo                                | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | systemctl cat cri-docker                             |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo cat                            | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | /etc/systemd/system/cri-docker.service.d/10-cni.conf |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo cat                            | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | /usr/lib/systemd/system/cri-docker.service           |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo                                | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | cri-dockerd --version                                |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo                                | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | systemctl status containerd                          |                           |         |         |                     |                     |
	|         | --all --full --no-pager                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo                                | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | systemctl cat containerd                             |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo cat                            | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | /lib/systemd/system/containerd.service               |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo cat                            | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | /etc/containerd/config.toml                          |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo                                | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | containerd config dump                               |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo                                | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | systemctl status crio --all                          |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo                                | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | systemctl cat crio --no-pager                        |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo find                           | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | /etc/crio -type f -exec sh -c                        |                           |         |         |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                           |         |         |                     |                     |
	| ssh     | -p cilium-040000 sudo crio                           | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | config                                               |                           |         |         |                     |                     |
	| delete  | -p cilium-040000                                     | cilium-040000             | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT | 11 Mar 24 04:05 PDT |
	| delete  | -p offline-docker-295000                             | offline-docker-295000     | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT | 11 Mar 24 04:05 PDT |
	| start   | -p force-systemd-env-161000                          | force-systemd-env-161000  | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| start   | -p force-systemd-flag-759000                         | force-systemd-flag-759000 | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | --memory=2048 --force-systemd                        |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | force-systemd-env-161000                             | force-systemd-env-161000  | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | ssh docker info --format                             |                           |         |         |                     |                     |
	|         | {{.CgroupDriver}}                                    |                           |         |         |                     |                     |
	| delete  | -p force-systemd-env-161000                          | force-systemd-env-161000  | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT | 11 Mar 24 04:05 PDT |
	| start   | -p docker-flags-821000                               | docker-flags-821000       | jenkins | v1.32.0 | 11 Mar 24 04:05 PDT |                     |
	|         | --cache-images=false                                 |                           |         |         |                     |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --install-addons=false                               |                           |         |         |                     |                     |
	|         | --wait=false                                         |                           |         |         |                     |                     |
	|         | --docker-env=FOO=BAR                                 |                           |         |         |                     |                     |
	|         | --docker-env=BAZ=BAT                                 |                           |         |         |                     |                     |
	|         | --docker-opt=debug                                   |                           |         |         |                     |                     |
	|         | --docker-opt=icc=true                                |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | force-systemd-flag-759000                            | force-systemd-flag-759000 | jenkins | v1.32.0 | 11 Mar 24 04:06 PDT |                     |
	|         | ssh docker info --format                             |                           |         |         |                     |                     |
	|         | {{.CgroupDriver}}                                    |                           |         |         |                     |                     |
	| delete  | -p force-systemd-flag-759000                         | force-systemd-flag-759000 | jenkins | v1.32.0 | 11 Mar 24 04:06 PDT | 11 Mar 24 04:06 PDT |
	| start   | -p cert-expiration-991000                            | cert-expiration-991000    | jenkins | v1.32.0 | 11 Mar 24 04:06 PDT |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --cert-expiration=3m                                 |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | docker-flags-821000 ssh                              | docker-flags-821000       | jenkins | v1.32.0 | 11 Mar 24 04:06 PDT |                     |
	|         | sudo systemctl show docker                           |                           |         |         |                     |                     |
	|         | --property=Environment                               |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | docker-flags-821000 ssh                              | docker-flags-821000       | jenkins | v1.32.0 | 11 Mar 24 04:06 PDT |                     |
	|         | sudo systemctl show docker                           |                           |         |         |                     |                     |
	|         | --property=ExecStart                                 |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| delete  | -p docker-flags-821000                               | docker-flags-821000       | jenkins | v1.32.0 | 11 Mar 24 04:06 PDT | 11 Mar 24 04:06 PDT |
	| start   | -p cert-options-573000                               | cert-options-573000       | jenkins | v1.32.0 | 11 Mar 24 04:06 PDT |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --apiserver-ips=127.0.0.1                            |                           |         |         |                     |                     |
	|         | --apiserver-ips=192.168.15.15                        |                           |         |         |                     |                     |
	|         | --apiserver-names=localhost                          |                           |         |         |                     |                     |
	|         | --apiserver-names=www.google.com                     |                           |         |         |                     |                     |
	|         | --apiserver-port=8555                                |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | cert-options-573000 ssh                              | cert-options-573000       | jenkins | v1.32.0 | 11 Mar 24 04:06 PDT |                     |
	|         | openssl x509 -text -noout -in                        |                           |         |         |                     |                     |
	|         | /var/lib/minikube/certs/apiserver.crt                |                           |         |         |                     |                     |
	| ssh     | -p cert-options-573000 -- sudo                       | cert-options-573000       | jenkins | v1.32.0 | 11 Mar 24 04:06 PDT |                     |
	|         | cat /etc/kubernetes/admin.conf                       |                           |         |         |                     |                     |
	| delete  | -p cert-options-573000                               | cert-options-573000       | jenkins | v1.32.0 | 11 Mar 24 04:06 PDT | 11 Mar 24 04:06 PDT |
	| start   | -p running-upgrade-828000                            | minikube                  | jenkins | v1.26.0 | 11 Mar 24 04:06 PDT |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p running-upgrade-828000                            | minikube                  | jenkins | v1.26.0 | 11 Mar 24 04:07 PDT |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p running-upgrade-828000                            | minikube                  | jenkins | v1.26.0 | 11 Mar 24 04:07 PDT |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| delete  | -p running-upgrade-828000                            | running-upgrade-828000    | jenkins | v1.32.0 | 11 Mar 24 04:07 PDT | 11 Mar 24 04:07 PDT |
	| start   | -p kubernetes-upgrade-905000                         | kubernetes-upgrade-905000 | jenkins | v1.32.0 | 11 Mar 24 04:07 PDT |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                         |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| stop    | -p kubernetes-upgrade-905000                         | kubernetes-upgrade-905000 | jenkins | v1.32.0 | 11 Mar 24 04:07 PDT | 11 Mar 24 04:07 PDT |
	| start   | -p kubernetes-upgrade-905000                         | kubernetes-upgrade-905000 | jenkins | v1.32.0 | 11 Mar 24 04:07 PDT |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.29.0-rc.2                    |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| delete  | -p kubernetes-upgrade-905000                         | kubernetes-upgrade-905000 | jenkins | v1.32.0 | 11 Mar 24 04:07 PDT | 11 Mar 24 04:07 PDT |
	| start   | -p stopped-upgrade-392000                            | minikube                  | jenkins | v1.26.0 | 11 Mar 24 04:07 PDT |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p stopped-upgrade-392000                            | minikube                  | jenkins | v1.26.0 | 11 Mar 24 04:08 PDT |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p stopped-upgrade-392000                            | minikube                  | jenkins | v1.26.0 | 11 Mar 24 04:08 PDT |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/11 04:08:15
	Running on machine: MacOS-Agent-1
	Binary: Built with gc go1.18.3 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0311 04:08:15.978094   39231 out.go:296] Setting OutFile to fd 1 ...
	I0311 04:08:15.978280   39231 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0311 04:08:15.978283   39231 out.go:309] Setting ErrFile to fd 2...
	I0311 04:08:15.978285   39231 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0311 04:08:15.978615   39231 root.go:329] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:08:15.978873   39231 out.go:303] Setting JSON to false
	I0311 04:08:16.001445   39231 start.go:115] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11265,"bootTime":1710144030,"procs":464,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:08:16.001541   39231 start.go:123] gopshost.Virtualization returned error: not implemented yet
	I0311 04:08:16.025296   39231 out.go:177] * [stopped-upgrade-392000] minikube v1.26.0 on Darwin 14.3.1
	I0311 04:08:16.047216   39231 notify.go:193] Checking for updates...
	I0311 04:08:16.068779   39231 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:08:16.091032   39231 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:08:16.112847   39231 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:08:16.133751   39231 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:08:16.155102   39231 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:08:16.176997   39231 out.go:177]   - KUBECONFIG=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/legacy_kubeconfig1147111585
	I0311 04:08:16.199233   39231 config.go:178] Loaded profile config "stopped-upgrade-392000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0311 04:08:16.199849   39231 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:08:16.199912   39231 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0311 04:08:16.208723   39231 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:63057
	I0311 04:08:16.209100   39231 main.go:134] libmachine: () Calling .GetVersion
	I0311 04:08:16.209527   39231 main.go:134] libmachine: Using API Version  1
	I0311 04:08:16.209536   39231 main.go:134] libmachine: () Calling .SetConfigRaw
	I0311 04:08:16.209732   39231 main.go:134] libmachine: () Calling .GetMachineName
	I0311 04:08:16.209828   39231 main.go:134] libmachine: (stopped-upgrade-392000) Calling .DriverName
	I0311 04:08:16.209955   39231 driver.go:360] Setting default libvirt URI to qemu:///system
	I0311 04:08:16.210195   39231 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:08:16.210214   39231 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0311 04:08:16.217652   39231 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:63059
	I0311 04:08:16.217972   39231 main.go:134] libmachine: () Calling .GetVersion
	I0311 04:08:16.218295   39231 main.go:134] libmachine: Using API Version  1
	I0311 04:08:16.218303   39231 main.go:134] libmachine: () Calling .SetConfigRaw
	I0311 04:08:16.218513   39231 main.go:134] libmachine: () Calling .GetMachineName
	I0311 04:08:16.218616   39231 main.go:134] libmachine: (stopped-upgrade-392000) Calling .DriverName
	I0311 04:08:16.246961   39231 out.go:177] * Using the hyperkit driver based on existing profile
	I0311 04:08:16.288605   39231 start.go:284] selected driver: hyperkit
	I0311 04:08:16.288649   39231 start.go:805] validating driver "hyperkit" against &{Name:stopped-upgrade-392000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:s
topped-upgrade-392000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath:}
	I0311 04:08:16.288816   39231 start.go:816] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:08:16.292751   39231 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:08:16.292831   39231 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:08:16.300379   39231 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:08:16.303990   39231 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:08:16.304018   39231 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:08:16.304104   39231 cni.go:95] Creating CNI manager for ""
	I0311 04:08:16.304117   39231 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
	I0311 04:08:16.304126   39231 start_flags.go:310] config:
	{Name:stopped-upgrade-392000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:stopped-upgrade-392000 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0311 04:08:16.304243   39231 iso.go:128] acquiring lock: {Name:mkab24f6998271f028dfd15ba5c0f9cdd1280521 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:08:16.346738   39231 out.go:177] * Starting control plane node stopped-upgrade-392000 in cluster stopped-upgrade-392000
	I0311 04:08:16.367615   39231 preload.go:132] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I0311 04:08:16.367677   39231 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4
	I0311 04:08:16.367705   39231 cache.go:57] Caching tarball of preloaded images
	I0311 04:08:16.367862   39231 preload.go:174] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:08:16.367878   39231 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.1 on docker
	I0311 04:08:16.368036   39231 profile.go:148] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/stopped-upgrade-392000/config.json ...
	I0311 04:08:16.368806   39231 cache.go:208] Successfully downloaded all kic artifacts
	I0311 04:08:16.368853   39231 start.go:352] acquiring machines lock for stopped-upgrade-392000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:08:16.368957   39231 start.go:356] acquired machines lock for "stopped-upgrade-392000" in 83.942µs
	I0311 04:08:16.368981   39231 start.go:94] Skipping create...Using existing machine configuration
	I0311 04:08:16.368988   39231 fix.go:55] fixHost starting: 
	I0311 04:08:16.369401   39231 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:08:16.369423   39231 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0311 04:08:16.378010   39231 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:63061
	I0311 04:08:16.378431   39231 main.go:134] libmachine: () Calling .GetVersion
	I0311 04:08:16.378766   39231 main.go:134] libmachine: Using API Version  1
	I0311 04:08:16.378773   39231 main.go:134] libmachine: () Calling .SetConfigRaw
	I0311 04:08:16.379016   39231 main.go:134] libmachine: () Calling .GetMachineName
	I0311 04:08:16.379114   39231 main.go:134] libmachine: (stopped-upgrade-392000) Calling .DriverName
	I0311 04:08:16.379211   39231 main.go:134] libmachine: (stopped-upgrade-392000) Calling .GetState
	I0311 04:08:16.379302   39231 main.go:134] libmachine: (stopped-upgrade-392000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:08:16.379312   39231 main.go:134] libmachine: (stopped-upgrade-392000) DBG | hyperkit pid from json: 0
	I0311 04:08:16.379320   39231 main.go:134] libmachine: (stopped-upgrade-392000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/stopped-upgrade-392000/hyperkit.json: no such file or directory
	I0311 04:08:16.379376   39231 fix.go:103] recreateIfNeeded on stopped-upgrade-392000: state=Stopped err=<nil>
	I0311 04:08:16.379413   39231 main.go:134] libmachine: (stopped-upgrade-392000) Calling .DriverName
	W0311 04:08:16.379504   39231 fix.go:129] unexpected machine state, will restart: <nil>
	I0311 04:08:16.422786   39231 out.go:177] * Restarting existing hyperkit VM for "stopped-upgrade-392000" ...
	I0311 04:08:16.443676   39231 main.go:134] libmachine: (stopped-upgrade-392000) Calling .Start
	I0311 04:08:16.443961   39231 main.go:134] libmachine: (stopped-upgrade-392000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:08:16.444019   39231 main.go:134] libmachine: (stopped-upgrade-392000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/stopped-upgrade-392000/hyperkit.pid
	I0311 04:08:16.444160   39231 main.go:134] libmachine: (stopped-upgrade-392000) DBG | Using UUID a2336684-df97-11ee-ba36-149d997cd0f1
	I0311 04:08:16.462880   39231 main.go:134] libmachine: (stopped-upgrade-392000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:08:16.463019   39231 fix.go:57] fixHost completed within 94.023818ms
	I0311 04:08:16.463024   39231 start.go:81] releasing machines lock for "stopped-upgrade-392000", held for 94.059939ms
	W0311 04:08:16.463037   39231 start.go:599] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0311 04:08:16.463159   39231 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:08:16.463168   39231 start.go:614] Will try again in 5 seconds ...
	I0311 04:08:21.463637   39231 start.go:352] acquiring machines lock for stopped-upgrade-392000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:08:21.463785   39231 start.go:356] acquired machines lock for "stopped-upgrade-392000" in 126.297µs
	I0311 04:08:21.463843   39231 start.go:94] Skipping create...Using existing machine configuration
	I0311 04:08:21.463847   39231 fix.go:55] fixHost starting: 
	I0311 04:08:21.464270   39231 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:08:21.464307   39231 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0311 04:08:21.473313   39231 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:63063
	I0311 04:08:21.473661   39231 main.go:134] libmachine: () Calling .GetVersion
	I0311 04:08:21.474020   39231 main.go:134] libmachine: Using API Version  1
	I0311 04:08:21.474037   39231 main.go:134] libmachine: () Calling .SetConfigRaw
	I0311 04:08:21.474238   39231 main.go:134] libmachine: () Calling .GetMachineName
	I0311 04:08:21.474351   39231 main.go:134] libmachine: (stopped-upgrade-392000) Calling .DriverName
	I0311 04:08:21.474440   39231 main.go:134] libmachine: (stopped-upgrade-392000) Calling .GetState
	I0311 04:08:21.474510   39231 main.go:134] libmachine: (stopped-upgrade-392000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:08:21.474521   39231 main.go:134] libmachine: (stopped-upgrade-392000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/stopped-upgrade-392000/hyperkit.json: no such file or directory
	I0311 04:08:21.474526   39231 main.go:134] libmachine: (stopped-upgrade-392000) DBG | hyperkit pid from json: 0
	I0311 04:08:21.474576   39231 fix.go:103] recreateIfNeeded on stopped-upgrade-392000: state=Stopped err=<nil>
	I0311 04:08:21.474591   39231 main.go:134] libmachine: (stopped-upgrade-392000) Calling .DriverName
	W0311 04:08:21.474667   39231 fix.go:129] unexpected machine state, will restart: <nil>
	I0311 04:08:21.496815   39231 out.go:177] * Restarting existing hyperkit VM for "stopped-upgrade-392000" ...
	I0311 04:08:21.518164   39231 main.go:134] libmachine: (stopped-upgrade-392000) Calling .Start
	I0311 04:08:21.518475   39231 main.go:134] libmachine: (stopped-upgrade-392000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:08:21.518512   39231 main.go:134] libmachine: (stopped-upgrade-392000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/stopped-upgrade-392000/hyperkit.pid
	I0311 04:08:21.518589   39231 main.go:134] libmachine: (stopped-upgrade-392000) DBG | Using UUID a2336684-df97-11ee-ba36-149d997cd0f1
	I0311 04:08:21.520760   39231 main.go:134] libmachine: (stopped-upgrade-392000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:08:21.520835   39231 fix.go:57] fixHost completed within 56.987127ms
	I0311 04:08:21.520839   39231 start.go:81] releasing machines lock for "stopped-upgrade-392000", held for 57.016768ms
	W0311 04:08:21.520962   39231 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-392000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:08:21.563485   39231 out.go:177] 
	W0311 04:08:21.585344   39231 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:08:21.585513   39231 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:08:21.585529   39231 out.go:239] * Related issues:
	W0311 04:08:21.585603   39231 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:08:21.585687   39231 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:08:21.650101   39231 out.go:177] 
	
	
	* The control-plane node stopped-upgrade-392000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p stopped-upgrade-392000"

                                                
                                                
-- /stdout --
version_upgrade_test.go:208: `minikube logs` after upgrade to HEAD from v1.26.0 failed: exit status 83
--- FAIL: TestStoppedBinaryUpgrade/MinikubeLogs (0.33s)

                                                
                                    
x
+
TestPause/serial/Start (11.3s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-darwin-amd64 start -p pause-279000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit 
pause_test.go:80: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p pause-279000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit : exit status 60 (11.226607863s)

                                                
                                                
-- stdout --
	* [pause-279000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "pause-279000" primary control-plane node in "pause-279000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "pause-279000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p pause-279000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
pause_test.go:82: failed to start minikube with args: "out/minikube-darwin-amd64 start -p pause-279000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-279000 -n pause-279000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-279000 -n pause-279000: exit status 7 (75.049453ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "pause-279000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestPause/serial/Start (11.30s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (11.33s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-686000 --driver=hyperkit 
no_kubernetes_test.go:95: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-686000 --driver=hyperkit : exit status 60 (11.255467443s)

                                                
                                                
-- stdout --
	* [NoKubernetes-686000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "NoKubernetes-686000" primary control-plane node in "NoKubernetes-686000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "NoKubernetes-686000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-686000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:97: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-686000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-686000 -n NoKubernetes-686000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-686000 -n NoKubernetes-686000: exit status 7 (75.09723ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-686000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithK8s (11.33s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (6.23s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-686000 --no-kubernetes --driver=hyperkit 
no_kubernetes_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-686000 --no-kubernetes --driver=hyperkit : exit status 60 (6.152519122s)

                                                
                                                
-- stdout --
	* [NoKubernetes-686000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-686000
	* Restarting existing hyperkit VM for "NoKubernetes-686000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-686000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-686000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:114: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-686000 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-686000 -n NoKubernetes-686000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-686000 -n NoKubernetes-686000: exit status 7 (75.57733ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-686000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithStopK8s (6.23s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (6.23s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-686000 --no-kubernetes --driver=hyperkit 
no_kubernetes_test.go:136: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-686000 --no-kubernetes --driver=hyperkit : exit status 60 (6.150967674s)

                                                
                                                
-- stdout --
	* [NoKubernetes-686000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-686000
	* Restarting existing hyperkit VM for "NoKubernetes-686000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-686000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-686000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:138: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-686000 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-686000 -n NoKubernetes-686000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-686000 -n NoKubernetes-686000: exit status 7 (75.840069ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-686000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/Start (6.23s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (6.69s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-686000 --driver=hyperkit 
no_kubernetes_test.go:191: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-686000 --driver=hyperkit : exit status 60 (6.615562507s)

                                                
                                                
-- stdout --
	* [NoKubernetes-686000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-686000
	* Restarting existing hyperkit VM for "NoKubernetes-686000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-686000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-686000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:193: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-686000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-686000 -n NoKubernetes-686000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-686000 -n NoKubernetes-686000: exit status 7 (74.612212ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-686000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartNoArgs (6.69s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (11.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p auto-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p auto-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=hyperkit : exit status 60 (11.340593128s)

                                                
                                                
-- stdout --
	* [auto-040000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "auto-040000" primary control-plane node in "auto-040000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "auto-040000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:09:09.467244   39399 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:09:09.467506   39399 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:09:09.467511   39399 out.go:304] Setting ErrFile to fd 2...
	I0311 04:09:09.467515   39399 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:09:09.467688   39399 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:09:09.469101   39399 out.go:298] Setting JSON to false
	I0311 04:09:09.491120   39399 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11319,"bootTime":1710144030,"procs":467,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:09:09.491214   39399 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:09:09.515364   39399 out.go:177] * [auto-040000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:09:09.559343   39399 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:09:09.559389   39399 notify.go:220] Checking for updates...
	I0311 04:09:09.602172   39399 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:09:09.623325   39399 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:09:09.644015   39399 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:09:09.665160   39399 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:09.686238   39399 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:09:09.708866   39399 config.go:182] Loaded profile config "cert-expiration-991000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:09:09.709047   39399 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:09:09.709209   39399 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:09:09.739237   39399 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:09:09.781040   39399 start.go:297] selected driver: hyperkit
	I0311 04:09:09.781068   39399 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:09:09.781089   39399 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:09:09.784977   39399 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:09:09.785088   39399 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:09:09.792878   39399 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:09:09.796656   39399 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:09.796679   39399 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:09:09.796709   39399 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:09:09.796919   39399 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:09:09.796978   39399 cni.go:84] Creating CNI manager for ""
	I0311 04:09:09.796994   39399 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:09:09.797000   39399 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0311 04:09:09.797061   39399 start.go:340] cluster config:
	{Name:auto-040000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:auto-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:d
ocker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgen
tPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:09:09.797145   39399 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:09:09.839165   39399 out.go:177] * Starting "auto-040000" primary control-plane node in "auto-040000" cluster
	I0311 04:09:09.860046   39399 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:09:09.860111   39399 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:09:09.860141   39399 cache.go:56] Caching tarball of preloaded images
	I0311 04:09:09.860366   39399 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:09:09.860386   39399 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:09:09.860516   39399 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/auto-040000/config.json ...
	I0311 04:09:09.860550   39399 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/auto-040000/config.json: {Name:mkd3f12b2be31bbca57f4d6473f1d1f72db283fa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:09:09.861119   39399 start.go:360] acquireMachinesLock for auto-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:09:09.861226   39399 start.go:364] duration metric: took 87.126µs to acquireMachinesLock for "auto-040000"
	I0311 04:09:09.861272   39399 start.go:93] Provisioning new machine with config: &{Name:auto-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.28.4 ClusterName:auto-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mou
ntType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:09:09.861357   39399 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:09:09.904072   39399 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:09:09.904308   39399 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:09.904373   39399 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:09.913618   39399 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63173
	I0311 04:09:09.913966   39399 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:09.914370   39399 main.go:141] libmachine: Using API Version  1
	I0311 04:09:09.914381   39399 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:09.914609   39399 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:09.914721   39399 main.go:141] libmachine: (auto-040000) Calling .GetMachineName
	I0311 04:09:09.914856   39399 main.go:141] libmachine: (auto-040000) Calling .DriverName
	I0311 04:09:09.915006   39399 start.go:159] libmachine.API.Create for "auto-040000" (driver="hyperkit")
	I0311 04:09:09.915027   39399 client.go:168] LocalClient.Create starting
	I0311 04:09:09.915065   39399 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:09:09.915112   39399 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:09.915130   39399 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:09.915201   39399 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:09:09.915236   39399 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:09.915247   39399 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:09.915259   39399 main.go:141] libmachine: Running pre-create checks...
	I0311 04:09:09.915269   39399 main.go:141] libmachine: (auto-040000) Calling .PreCreateCheck
	I0311 04:09:09.915350   39399 main.go:141] libmachine: (auto-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:09.915529   39399 main.go:141] libmachine: (auto-040000) Calling .GetConfigRaw
	I0311 04:09:09.915969   39399 main.go:141] libmachine: Creating machine...
	I0311 04:09:09.915977   39399 main.go:141] libmachine: (auto-040000) Calling .Create
	I0311 04:09:09.916051   39399 main.go:141] libmachine: (auto-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:09.916165   39399 main.go:141] libmachine: (auto-040000) DBG | I0311 04:09:09.916039   39407 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:09.916216   39399 main.go:141] libmachine: (auto-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:09:10.106593   39399 main.go:141] libmachine: (auto-040000) DBG | I0311 04:09:10.106492   39407 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/auto-040000/id_rsa...
	I0311 04:09:10.251423   39399 main.go:141] libmachine: (auto-040000) DBG | I0311 04:09:10.251343   39407 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/auto-040000/auto-040000.rawdisk...
	I0311 04:09:10.251436   39399 main.go:141] libmachine: (auto-040000) DBG | Writing magic tar header
	I0311 04:09:10.251444   39399 main.go:141] libmachine: (auto-040000) DBG | Writing SSH key tar header
	I0311 04:09:10.252222   39399 main.go:141] libmachine: (auto-040000) DBG | I0311 04:09:10.252132   39407 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/auto-040000 ...
	I0311 04:09:10.613837   39399 main.go:141] libmachine: (auto-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:10.613872   39399 main.go:141] libmachine: (auto-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/auto-040000/hyperkit.pid
	I0311 04:09:10.613890   39399 main.go:141] libmachine: (auto-040000) DBG | Using UUID 4f0db3e2-5839-4d52-8e63-441e1d25a88b
	I0311 04:09:10.630554   39399 main.go:141] libmachine: (auto-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:09:10.630659   39399 client.go:171] duration metric: took 715.61076ms to LocalClient.Create
	I0311 04:09:12.630967   39399 start.go:128] duration metric: took 2.769548568s to createHost
	I0311 04:09:12.630993   39399 start.go:83] releasing machines lock for "auto-040000", held for 2.76971328s
	W0311 04:09:12.631024   39399 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:09:12.631612   39399 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:12.631687   39399 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:12.641016   39399 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63175
	I0311 04:09:12.641378   39399 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:12.641733   39399 main.go:141] libmachine: Using API Version  1
	I0311 04:09:12.641742   39399 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:12.641973   39399 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:12.642349   39399 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:12.642372   39399 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:12.650011   39399 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63177
	I0311 04:09:12.650368   39399 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:12.650724   39399 main.go:141] libmachine: Using API Version  1
	I0311 04:09:12.650741   39399 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:12.650962   39399 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:12.651062   39399 main.go:141] libmachine: (auto-040000) Calling .GetState
	I0311 04:09:12.651147   39399 main.go:141] libmachine: (auto-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:12.651181   39399 main.go:141] libmachine: (auto-040000) DBG | hyperkit pid from json: 0
	I0311 04:09:12.651195   39399 main.go:141] libmachine: (auto-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/auto-040000/hyperkit.json: no such file or directory
	I0311 04:09:12.651213   39399 main.go:141] libmachine: (auto-040000) Calling .DriverName
	I0311 04:09:12.693868   39399 out.go:177] * Deleting "auto-040000" in hyperkit ...
	I0311 04:09:12.718927   39399 main.go:141] libmachine: (auto-040000) Calling .Remove
	I0311 04:09:12.719269   39399 main.go:141] libmachine: (auto-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:12.719291   39399 main.go:141] libmachine: (auto-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:12.719312   39399 main.go:141] libmachine: (auto-040000) DBG | hyperkit pid from json: 0
	I0311 04:09:12.719347   39399 main.go:141] libmachine: (auto-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/auto-040000/hyperkit.json: no such file or directory
	W0311 04:09:12.738196   39399 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:09:12.738209   39399 start.go:728] Will try again in 5 seconds ...
	I0311 04:09:17.740534   39399 start.go:360] acquireMachinesLock for auto-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:09:17.740762   39399 start.go:364] duration metric: took 167.819µs to acquireMachinesLock for "auto-040000"
	I0311 04:09:17.740799   39399 start.go:93] Provisioning new machine with config: &{Name:auto-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.28.4 ClusterName:auto-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mou
ntType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:09:17.740899   39399 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:09:17.762678   39399 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:09:17.762842   39399 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:17.762925   39399 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:17.772388   39399 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63186
	I0311 04:09:17.772759   39399 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:17.773137   39399 main.go:141] libmachine: Using API Version  1
	I0311 04:09:17.773150   39399 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:17.773358   39399 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:17.773530   39399 main.go:141] libmachine: (auto-040000) Calling .GetMachineName
	I0311 04:09:17.773620   39399 main.go:141] libmachine: (auto-040000) Calling .DriverName
	I0311 04:09:17.773747   39399 start.go:159] libmachine.API.Create for "auto-040000" (driver="hyperkit")
	I0311 04:09:17.773766   39399 client.go:168] LocalClient.Create starting
	I0311 04:09:17.773797   39399 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:09:17.773845   39399 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:17.773857   39399 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:17.773908   39399 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:09:17.773943   39399 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:17.773968   39399 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:17.773981   39399 main.go:141] libmachine: Running pre-create checks...
	I0311 04:09:17.773986   39399 main.go:141] libmachine: (auto-040000) Calling .PreCreateCheck
	I0311 04:09:17.774070   39399 main.go:141] libmachine: (auto-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:17.774094   39399 main.go:141] libmachine: (auto-040000) Calling .GetConfigRaw
	I0311 04:09:17.774493   39399 main.go:141] libmachine: Creating machine...
	I0311 04:09:17.774510   39399 main.go:141] libmachine: (auto-040000) Calling .Create
	I0311 04:09:17.774586   39399 main.go:141] libmachine: (auto-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:17.774692   39399 main.go:141] libmachine: (auto-040000) DBG | I0311 04:09:17.774574   39423 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:17.774765   39399 main.go:141] libmachine: (auto-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:09:17.964660   39399 main.go:141] libmachine: (auto-040000) DBG | I0311 04:09:17.964557   39423 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/auto-040000/id_rsa...
	I0311 04:09:18.209314   39399 main.go:141] libmachine: (auto-040000) DBG | I0311 04:09:18.209221   39423 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/auto-040000/auto-040000.rawdisk...
	I0311 04:09:18.209328   39399 main.go:141] libmachine: (auto-040000) DBG | Writing magic tar header
	I0311 04:09:18.209347   39399 main.go:141] libmachine: (auto-040000) DBG | Writing SSH key tar header
	I0311 04:09:18.210075   39399 main.go:141] libmachine: (auto-040000) DBG | I0311 04:09:18.210035   39423 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/auto-040000 ...
	I0311 04:09:18.571312   39399 main.go:141] libmachine: (auto-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:18.571330   39399 main.go:141] libmachine: (auto-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/auto-040000/hyperkit.pid
	I0311 04:09:18.571370   39399 main.go:141] libmachine: (auto-040000) DBG | Using UUID 33fae318-502b-4d66-929a-b9fcccd87efa
	I0311 04:09:18.590009   39399 main.go:141] libmachine: (auto-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:09:18.590101   39399 client.go:171] duration metric: took 816.315724ms to LocalClient.Create
	I0311 04:09:20.591227   39399 start.go:128] duration metric: took 2.850271065s to createHost
	I0311 04:09:20.591259   39399 start.go:83] releasing machines lock for "auto-040000", held for 2.850437666s
	W0311 04:09:20.591362   39399 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p auto-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p auto-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:09:20.612153   39399 out.go:177] 
	W0311 04:09:20.637068   39399 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:09:20.637121   39399 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:09:20.637142   39399 out.go:239] * Related issues:
	* Related issues:
	W0311 04:09:20.637170   39399 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:09:20.637226   39399 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:09:20.681847   39399 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/auto/Start (11.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (11.67s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p calico-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p calico-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=hyperkit : exit status 60 (11.667749722s)

                                                
                                                
-- stdout --
	* [calico-040000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "calico-040000" primary control-plane node in "calico-040000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "calico-040000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:09:22.552053   39475 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:09:22.552646   39475 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:09:22.552659   39475 out.go:304] Setting ErrFile to fd 2...
	I0311 04:09:22.552667   39475 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:09:22.553012   39475 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:09:22.555572   39475 out.go:298] Setting JSON to false
	I0311 04:09:22.579280   39475 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11332,"bootTime":1710144030,"procs":478,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:09:22.579364   39475 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:09:22.600415   39475 out.go:177] * [calico-040000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:09:22.664437   39475 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:09:22.642661   39475 notify.go:220] Checking for updates...
	I0311 04:09:22.729600   39475 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:09:22.794407   39475 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:09:22.836231   39475 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:09:22.857225   39475 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:22.899341   39475 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:09:22.920633   39475 config.go:182] Loaded profile config "auto-040000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:09:22.920771   39475 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:09:22.920890   39475 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:09:22.962253   39475 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:09:23.025305   39475 start.go:297] selected driver: hyperkit
	I0311 04:09:23.025338   39475 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:09:23.025357   39475 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:09:23.029857   39475 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:09:23.029962   39475 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:09:23.037721   39475 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:09:23.041604   39475 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:23.041627   39475 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:09:23.041659   39475 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:09:23.041863   39475 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:09:23.041927   39475 cni.go:84] Creating CNI manager for "calico"
	I0311 04:09:23.041936   39475 start_flags.go:319] Found "Calico" CNI - setting NetworkPlugin=cni
	I0311 04:09:23.042019   39475 start.go:340] cluster config:
	{Name:calico-040000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:calico-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunti
me:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSoc
k: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:09:23.042100   39475 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:09:23.087903   39475 out.go:177] * Starting "calico-040000" primary control-plane node in "calico-040000" cluster
	I0311 04:09:23.109035   39475 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:09:23.109067   39475 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:09:23.109083   39475 cache.go:56] Caching tarball of preloaded images
	I0311 04:09:23.109184   39475 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:09:23.109193   39475 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:09:23.109255   39475 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/calico-040000/config.json ...
	I0311 04:09:23.109271   39475 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/calico-040000/config.json: {Name:mk5a295374ea37f29a3d1a8aea1f11d47806c234 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:09:23.109557   39475 start.go:360] acquireMachinesLock for calico-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:09:23.109618   39475 start.go:364] duration metric: took 41.867µs to acquireMachinesLock for "calico-040000"
	I0311 04:09:23.109641   39475 start.go:93] Provisioning new machine with config: &{Name:calico-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:calico-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:09:23.109688   39475 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:09:23.131052   39475 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:09:23.131363   39475 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:23.131451   39475 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:23.140466   39475 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63218
	I0311 04:09:23.140810   39475 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:23.141294   39475 main.go:141] libmachine: Using API Version  1
	I0311 04:09:23.141313   39475 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:23.141587   39475 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:23.141698   39475 main.go:141] libmachine: (calico-040000) Calling .GetMachineName
	I0311 04:09:23.141805   39475 main.go:141] libmachine: (calico-040000) Calling .DriverName
	I0311 04:09:23.141917   39475 start.go:159] libmachine.API.Create for "calico-040000" (driver="hyperkit")
	I0311 04:09:23.141942   39475 client.go:168] LocalClient.Create starting
	I0311 04:09:23.141984   39475 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:09:23.142035   39475 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:23.142050   39475 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:23.142106   39475 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:09:23.142142   39475 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:23.142153   39475 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:23.142166   39475 main.go:141] libmachine: Running pre-create checks...
	I0311 04:09:23.142176   39475 main.go:141] libmachine: (calico-040000) Calling .PreCreateCheck
	I0311 04:09:23.142243   39475 main.go:141] libmachine: (calico-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:23.142420   39475 main.go:141] libmachine: (calico-040000) Calling .GetConfigRaw
	I0311 04:09:23.152660   39475 main.go:141] libmachine: Creating machine...
	I0311 04:09:23.152717   39475 main.go:141] libmachine: (calico-040000) Calling .Create
	I0311 04:09:23.152882   39475 main.go:141] libmachine: (calico-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:23.153051   39475 main.go:141] libmachine: (calico-040000) DBG | I0311 04:09:23.152856   39492 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:23.153149   39475 main.go:141] libmachine: (calico-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:09:23.422090   39475 main.go:141] libmachine: (calico-040000) DBG | I0311 04:09:23.422030   39492 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/calico-040000/id_rsa...
	I0311 04:09:23.549521   39475 main.go:141] libmachine: (calico-040000) DBG | I0311 04:09:23.549452   39492 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/calico-040000/calico-040000.rawdisk...
	I0311 04:09:23.549539   39475 main.go:141] libmachine: (calico-040000) DBG | Writing magic tar header
	I0311 04:09:23.549550   39475 main.go:141] libmachine: (calico-040000) DBG | Writing SSH key tar header
	I0311 04:09:23.550380   39475 main.go:141] libmachine: (calico-040000) DBG | I0311 04:09:23.550348   39492 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/calico-040000 ...
	I0311 04:09:24.018236   39475 main.go:141] libmachine: (calico-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:24.018299   39475 main.go:141] libmachine: (calico-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/calico-040000/hyperkit.pid
	I0311 04:09:24.018322   39475 main.go:141] libmachine: (calico-040000) DBG | Using UUID aa147947-a56b-4143-9839-2190e1685c2c
	I0311 04:09:24.038751   39475 main.go:141] libmachine: (calico-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:09:24.038843   39475 client.go:171] duration metric: took 896.878222ms to LocalClient.Create
	I0311 04:09:26.040074   39475 start.go:128] duration metric: took 2.930307968s to createHost
	I0311 04:09:26.040093   39475 start.go:83] releasing machines lock for "calico-040000", held for 2.930424212s
	W0311 04:09:26.040113   39475 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:09:26.040521   39475 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:26.040555   39475 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:26.049128   39475 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63256
	I0311 04:09:26.049493   39475 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:26.049813   39475 main.go:141] libmachine: Using API Version  1
	I0311 04:09:26.049822   39475 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:26.050048   39475 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:26.050405   39475 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:26.050434   39475 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:26.058483   39475 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63258
	I0311 04:09:26.058889   39475 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:26.059265   39475 main.go:141] libmachine: Using API Version  1
	I0311 04:09:26.059278   39475 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:26.059518   39475 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:26.059644   39475 main.go:141] libmachine: (calico-040000) Calling .GetState
	I0311 04:09:26.059731   39475 main.go:141] libmachine: (calico-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:26.059746   39475 main.go:141] libmachine: (calico-040000) DBG | hyperkit pid from json: 0
	I0311 04:09:26.059755   39475 main.go:141] libmachine: (calico-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/calico-040000/hyperkit.json: no such file or directory
	I0311 04:09:26.059808   39475 main.go:141] libmachine: (calico-040000) Calling .DriverName
	I0311 04:09:26.103415   39475 out.go:177] * Deleting "calico-040000" in hyperkit ...
	I0311 04:09:26.124420   39475 main.go:141] libmachine: (calico-040000) Calling .Remove
	I0311 04:09:26.124696   39475 main.go:141] libmachine: (calico-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:26.124727   39475 main.go:141] libmachine: (calico-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/calico-040000/hyperkit.json: no such file or directory
	I0311 04:09:26.124741   39475 main.go:141] libmachine: (calico-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:26.124764   39475 main.go:141] libmachine: (calico-040000) DBG | hyperkit pid from json: 0
	W0311 04:09:26.203735   39475 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:09:26.203757   39475 start.go:728] Will try again in 5 seconds ...
	I0311 04:09:31.205275   39475 start.go:360] acquireMachinesLock for calico-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:09:31.205460   39475 start.go:364] duration metric: took 147.034µs to acquireMachinesLock for "calico-040000"
	I0311 04:09:31.205507   39475 start.go:93] Provisioning new machine with config: &{Name:calico-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:calico-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:09:31.205688   39475 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:09:31.227494   39475 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:09:31.227657   39475 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:31.227704   39475 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:31.237016   39475 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63284
	I0311 04:09:31.237412   39475 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:31.237745   39475 main.go:141] libmachine: Using API Version  1
	I0311 04:09:31.237758   39475 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:31.237981   39475 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:31.238087   39475 main.go:141] libmachine: (calico-040000) Calling .GetMachineName
	I0311 04:09:31.238184   39475 main.go:141] libmachine: (calico-040000) Calling .DriverName
	I0311 04:09:31.238290   39475 start.go:159] libmachine.API.Create for "calico-040000" (driver="hyperkit")
	I0311 04:09:31.238309   39475 client.go:168] LocalClient.Create starting
	I0311 04:09:31.238336   39475 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:09:31.238381   39475 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:31.238391   39475 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:31.238432   39475 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:09:31.238467   39475 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:31.238484   39475 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:31.238498   39475 main.go:141] libmachine: Running pre-create checks...
	I0311 04:09:31.238504   39475 main.go:141] libmachine: (calico-040000) Calling .PreCreateCheck
	I0311 04:09:31.238593   39475 main.go:141] libmachine: (calico-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:31.238624   39475 main.go:141] libmachine: (calico-040000) Calling .GetConfigRaw
	I0311 04:09:31.249690   39475 main.go:141] libmachine: Creating machine...
	I0311 04:09:31.249702   39475 main.go:141] libmachine: (calico-040000) Calling .Create
	I0311 04:09:31.249873   39475 main.go:141] libmachine: (calico-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:31.249998   39475 main.go:141] libmachine: (calico-040000) DBG | I0311 04:09:31.249823   39591 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:31.250075   39475 main.go:141] libmachine: (calico-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:09:31.429565   39475 main.go:141] libmachine: (calico-040000) DBG | I0311 04:09:31.429505   39591 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/calico-040000/id_rsa...
	I0311 04:09:31.573681   39475 main.go:141] libmachine: (calico-040000) DBG | I0311 04:09:31.573627   39591 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/calico-040000/calico-040000.rawdisk...
	I0311 04:09:31.573704   39475 main.go:141] libmachine: (calico-040000) DBG | Writing magic tar header
	I0311 04:09:31.573741   39475 main.go:141] libmachine: (calico-040000) DBG | Writing SSH key tar header
	I0311 04:09:31.574316   39475 main.go:141] libmachine: (calico-040000) DBG | I0311 04:09:31.574260   39591 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/calico-040000 ...
	I0311 04:09:31.938852   39475 main.go:141] libmachine: (calico-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:31.938869   39475 main.go:141] libmachine: (calico-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/calico-040000/hyperkit.pid
	I0311 04:09:31.938937   39475 main.go:141] libmachine: (calico-040000) DBG | Using UUID 17e101a0-c480-4ba7-b8fa-93f9380f3251
	I0311 04:09:31.954829   39475 main.go:141] libmachine: (calico-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:09:31.954913   39475 client.go:171] duration metric: took 716.587428ms to LocalClient.Create
	I0311 04:09:33.955174   39475 start.go:128] duration metric: took 2.749433147s to createHost
	I0311 04:09:33.955190   39475 start.go:83] releasing machines lock for "calico-040000", held for 2.749675057s
	W0311 04:09:33.955313   39475 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p calico-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p calico-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:09:33.997734   39475 out.go:177] 
	W0311 04:09:34.019792   39475 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:09:34.019865   39475 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:09:34.019899   39475 out.go:239] * Related issues:
	* Related issues:
	W0311 04:09:34.019916   39475 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:09:34.019933   39475 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:09:34.083769   39475 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/calico/Start (11.67s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (11.53s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p custom-flannel-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p custom-flannel-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=hyperkit : exit status 60 (11.529794619s)

                                                
                                                
-- stdout --
	* [custom-flannel-040000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "custom-flannel-040000" primary control-plane node in "custom-flannel-040000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "custom-flannel-040000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:09:27.188176   39579 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:09:27.188348   39579 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:09:27.188354   39579 out.go:304] Setting ErrFile to fd 2...
	I0311 04:09:27.188358   39579 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:09:27.188539   39579 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:09:27.190836   39579 out.go:298] Setting JSON to false
	I0311 04:09:27.213370   39579 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11337,"bootTime":1710144030,"procs":506,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:09:27.213468   39579 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:09:27.237027   39579 out.go:177] * [custom-flannel-040000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:09:27.278928   39579 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:09:27.278991   39579 notify.go:220] Checking for updates...
	I0311 04:09:27.301161   39579 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:09:27.322980   39579 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:09:27.343977   39579 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:09:27.364906   39579 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:27.385949   39579 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:09:27.407954   39579 config.go:182] Loaded profile config "calico-040000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:09:27.408173   39579 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:09:27.408341   39579 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:09:27.437914   39579 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:09:27.479872   39579 start.go:297] selected driver: hyperkit
	I0311 04:09:27.479904   39579 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:09:27.479925   39579 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:09:27.484161   39579 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:09:27.484271   39579 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:09:27.492019   39579 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:09:27.495772   39579 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:27.495796   39579 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:09:27.495826   39579 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:09:27.496041   39579 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:09:27.496102   39579 cni.go:84] Creating CNI manager for "testdata/kube-flannel.yaml"
	I0311 04:09:27.496126   39579 start_flags.go:319] Found "testdata/kube-flannel.yaml" CNI - setting NetworkPlugin=cni
	I0311 04:09:27.496190   39579 start.go:340] cluster config:
	{Name:custom-flannel-040000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loca
l ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: S
ocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:09:27.496278   39579 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:09:27.539885   39579 out.go:177] * Starting "custom-flannel-040000" primary control-plane node in "custom-flannel-040000" cluster
	I0311 04:09:27.561086   39579 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:09:27.561189   39579 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:09:27.561220   39579 cache.go:56] Caching tarball of preloaded images
	I0311 04:09:27.561392   39579 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:09:27.561407   39579 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:09:27.561504   39579 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/custom-flannel-040000/config.json ...
	I0311 04:09:27.561540   39579 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/custom-flannel-040000/config.json: {Name:mkd7501a4ba4a2ce4d3dafaaa7abf4ca6d6f19d4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:09:27.582777   39579 start.go:360] acquireMachinesLock for custom-flannel-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:09:27.582942   39579 start.go:364] duration metric: took 120.643µs to acquireMachinesLock for "custom-flannel-040000"
	I0311 04:09:27.582997   39579 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mou
ntMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:09:27.583123   39579 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:09:27.605036   39579 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:09:27.605319   39579 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:27.605419   39579 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:27.613414   39579 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63278
	I0311 04:09:27.613822   39579 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:27.614284   39579 main.go:141] libmachine: Using API Version  1
	I0311 04:09:27.614295   39579 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:27.614555   39579 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:27.614676   39579 main.go:141] libmachine: (custom-flannel-040000) Calling .GetMachineName
	I0311 04:09:27.614773   39579 main.go:141] libmachine: (custom-flannel-040000) Calling .DriverName
	I0311 04:09:27.614911   39579 start.go:159] libmachine.API.Create for "custom-flannel-040000" (driver="hyperkit")
	I0311 04:09:27.614935   39579 client.go:168] LocalClient.Create starting
	I0311 04:09:27.614968   39579 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:09:27.615019   39579 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:27.615037   39579 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:27.615095   39579 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:09:27.615132   39579 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:27.615145   39579 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:27.615161   39579 main.go:141] libmachine: Running pre-create checks...
	I0311 04:09:27.615172   39579 main.go:141] libmachine: (custom-flannel-040000) Calling .PreCreateCheck
	I0311 04:09:27.615261   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:27.615450   39579 main.go:141] libmachine: (custom-flannel-040000) Calling .GetConfigRaw
	I0311 04:09:27.615866   39579 main.go:141] libmachine: Creating machine...
	I0311 04:09:27.615877   39579 main.go:141] libmachine: (custom-flannel-040000) Calling .Create
	I0311 04:09:27.615950   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:27.616064   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | I0311 04:09:27.615940   39587 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:27.616121   39579 main.go:141] libmachine: (custom-flannel-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:09:27.796281   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | I0311 04:09:27.796173   39587 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/custom-flannel-040000/id_rsa...
	I0311 04:09:27.875312   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | I0311 04:09:27.875264   39587 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/custom-flannel-040000/custom-flannel-040000.rawdisk...
	I0311 04:09:27.875321   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | Writing magic tar header
	I0311 04:09:27.875333   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | Writing SSH key tar header
	I0311 04:09:27.875951   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | I0311 04:09:27.875895   39587 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/custom-flannel-040000 ...
	I0311 04:09:28.239770   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:28.239789   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/custom-flannel-040000/hyperkit.pid
	I0311 04:09:28.239835   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | Using UUID c1752507-3baa-45a1-ab4f-01ba99056bde
	I0311 04:09:28.257210   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:09:28.257297   39579 client.go:171] duration metric: took 642.340547ms to LocalClient.Create
	I0311 04:09:30.258984   39579 start.go:128] duration metric: took 2.675802398s to createHost
	I0311 04:09:30.259008   39579 start.go:83] releasing machines lock for "custom-flannel-040000", held for 2.676011505s
	W0311 04:09:30.259036   39579 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:09:30.259571   39579 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:30.259611   39579 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:30.268466   39579 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63280
	I0311 04:09:30.268869   39579 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:30.269231   39579 main.go:141] libmachine: Using API Version  1
	I0311 04:09:30.269242   39579 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:30.269450   39579 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:30.269787   39579 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:30.269809   39579 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:30.277763   39579 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63282
	I0311 04:09:30.278097   39579 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:30.278413   39579 main.go:141] libmachine: Using API Version  1
	I0311 04:09:30.278426   39579 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:30.278628   39579 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:30.278738   39579 main.go:141] libmachine: (custom-flannel-040000) Calling .GetState
	I0311 04:09:30.278819   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:30.278838   39579 main.go:141] libmachine: (custom-flannel-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/custom-flannel-040000/hyperkit.json: no such file or directory
	I0311 04:09:30.278849   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | hyperkit pid from json: 0
	I0311 04:09:30.278911   39579 main.go:141] libmachine: (custom-flannel-040000) Calling .DriverName
	I0311 04:09:30.309804   39579 out.go:177] * Deleting "custom-flannel-040000" in hyperkit ...
	I0311 04:09:30.330212   39579 main.go:141] libmachine: (custom-flannel-040000) Calling .Remove
	I0311 04:09:30.330376   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:30.330401   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:30.330416   39579 main.go:141] libmachine: (custom-flannel-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/custom-flannel-040000/hyperkit.json: no such file or directory
	I0311 04:09:30.330430   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | hyperkit pid from json: 0
	W0311 04:09:30.347506   39579 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:09:30.347523   39579 start.go:728] Will try again in 5 seconds ...
	I0311 04:09:35.349683   39579 start.go:360] acquireMachinesLock for custom-flannel-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:09:35.349783   39579 start.go:364] duration metric: took 76.685µs to acquireMachinesLock for "custom-flannel-040000"
	I0311 04:09:35.349808   39579 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mou
ntMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:09:35.349875   39579 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:09:35.371532   39579 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:09:35.371632   39579 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:35.371660   39579 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:35.379724   39579 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63296
	I0311 04:09:35.380099   39579 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:35.380445   39579 main.go:141] libmachine: Using API Version  1
	I0311 04:09:35.380463   39579 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:35.380664   39579 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:35.380785   39579 main.go:141] libmachine: (custom-flannel-040000) Calling .GetMachineName
	I0311 04:09:35.380867   39579 main.go:141] libmachine: (custom-flannel-040000) Calling .DriverName
	I0311 04:09:35.380971   39579 start.go:159] libmachine.API.Create for "custom-flannel-040000" (driver="hyperkit")
	I0311 04:09:35.380985   39579 client.go:168] LocalClient.Create starting
	I0311 04:09:35.381014   39579 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:09:35.381052   39579 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:35.381062   39579 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:35.381101   39579 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:09:35.381129   39579 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:35.381146   39579 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:35.381168   39579 main.go:141] libmachine: Running pre-create checks...
	I0311 04:09:35.381174   39579 main.go:141] libmachine: (custom-flannel-040000) Calling .PreCreateCheck
	I0311 04:09:35.381260   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:35.381296   39579 main.go:141] libmachine: (custom-flannel-040000) Calling .GetConfigRaw
	I0311 04:09:35.381768   39579 main.go:141] libmachine: Creating machine...
	I0311 04:09:35.381780   39579 main.go:141] libmachine: (custom-flannel-040000) Calling .Create
	I0311 04:09:35.381882   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:35.382024   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | I0311 04:09:35.381867   39622 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:35.382088   39579 main.go:141] libmachine: (custom-flannel-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:09:35.578506   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | I0311 04:09:35.578400   39622 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/custom-flannel-040000/id_rsa...
	I0311 04:09:36.022291   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | I0311 04:09:36.022205   39622 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/custom-flannel-040000/custom-flannel-040000.rawdisk...
	I0311 04:09:36.022311   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | Writing magic tar header
	I0311 04:09:36.022322   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | Writing SSH key tar header
	I0311 04:09:36.044449   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | I0311 04:09:36.044357   39622 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/custom-flannel-040000 ...
	I0311 04:09:36.468601   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:36.468621   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/custom-flannel-040000/hyperkit.pid
	I0311 04:09:36.468674   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | Using UUID bc5c7553-a3cb-4573-b5f2-e9ecf23368a5
	I0311 04:09:36.486539   39579 main.go:141] libmachine: (custom-flannel-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:09:36.486683   39579 client.go:171] duration metric: took 1.105673843s to LocalClient.Create
	I0311 04:09:38.487333   39579 start.go:128] duration metric: took 3.137403252s to createHost
	I0311 04:09:38.487349   39579 start.go:83] releasing machines lock for "custom-flannel-040000", held for 3.137512854s
	W0311 04:09:38.487403   39579 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p custom-flannel-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p custom-flannel-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:09:38.529683   39579 out.go:177] 
	W0311 04:09:38.550937   39579 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:09:38.551016   39579 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:09:38.551041   39579 out.go:239] * Related issues:
	* Related issues:
	W0311 04:09:38.551077   39579 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:09:38.551098   39579 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:09:38.572620   39579 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/custom-flannel/Start (11.53s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Start (11.75s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p false-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p false-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=hyperkit : exit status 60 (11.747701459s)

                                                
                                                
-- stdout --
	* [false-040000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "false-040000" primary control-plane node in "false-040000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "false-040000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:09:41.044284   39784 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:09:41.044813   39784 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:09:41.044823   39784 out.go:304] Setting ErrFile to fd 2...
	I0311 04:09:41.044830   39784 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:09:41.045141   39784 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:09:41.047713   39784 out.go:298] Setting JSON to false
	I0311 04:09:41.071332   39784 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11351,"bootTime":1710144030,"procs":511,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:09:41.071453   39784 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:09:41.092682   39784 out.go:177] * [false-040000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:09:41.134503   39784 notify.go:220] Checking for updates...
	I0311 04:09:41.134514   39784 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:09:41.155635   39784 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:09:41.176587   39784 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:09:41.197301   39784 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:09:41.218478   39784 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:41.260397   39784 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:09:41.284616   39784 config.go:182] Loaded profile config "custom-flannel-040000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:09:41.284824   39784 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:09:41.284958   39784 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:09:41.314566   39784 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:09:41.356688   39784 start.go:297] selected driver: hyperkit
	I0311 04:09:41.356718   39784 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:09:41.356742   39784 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:09:41.361137   39784 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:09:41.361250   39784 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:09:41.369082   39784 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:09:41.372887   39784 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:41.372913   39784 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:09:41.372947   39784 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:09:41.373162   39784 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:09:41.373222   39784 cni.go:84] Creating CNI manager for "false"
	I0311 04:09:41.373288   39784 start.go:340] cluster config:
	{Name:false-040000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:false-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSH
AgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:09:41.373365   39784 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:09:41.440557   39784 out.go:177] * Starting "false-040000" primary control-plane node in "false-040000" cluster
	I0311 04:09:41.461455   39784 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:09:41.461542   39784 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:09:41.461576   39784 cache.go:56] Caching tarball of preloaded images
	I0311 04:09:41.461817   39784 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:09:41.461837   39784 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:09:41.461975   39784 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/false-040000/config.json ...
	I0311 04:09:41.462013   39784 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/false-040000/config.json: {Name:mkee7d65f798cad04dbe40018d98434748b1add5 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:09:41.462688   39784 start.go:360] acquireMachinesLock for false-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:09:41.462805   39784 start.go:364] duration metric: took 93.293µs to acquireMachinesLock for "false-040000"
	I0311 04:09:41.462851   39784 start.go:93] Provisioning new machine with config: &{Name:false-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Ku
bernetesVersion:v1.28.4 ClusterName:false-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0
MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:09:41.462946   39784 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:09:41.505385   39784 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:09:41.505568   39784 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:41.505614   39784 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:41.514005   39784 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63384
	I0311 04:09:41.514443   39784 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:41.514900   39784 main.go:141] libmachine: Using API Version  1
	I0311 04:09:41.514914   39784 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:41.515123   39784 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:41.515226   39784 main.go:141] libmachine: (false-040000) Calling .GetMachineName
	I0311 04:09:41.515319   39784 main.go:141] libmachine: (false-040000) Calling .DriverName
	I0311 04:09:41.515455   39784 start.go:159] libmachine.API.Create for "false-040000" (driver="hyperkit")
	I0311 04:09:41.515484   39784 client.go:168] LocalClient.Create starting
	I0311 04:09:41.515515   39784 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:09:41.515566   39784 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:41.515580   39784 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:41.515637   39784 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:09:41.515673   39784 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:41.515682   39784 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:41.515695   39784 main.go:141] libmachine: Running pre-create checks...
	I0311 04:09:41.515702   39784 main.go:141] libmachine: (false-040000) Calling .PreCreateCheck
	I0311 04:09:41.515797   39784 main.go:141] libmachine: (false-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:41.516029   39784 main.go:141] libmachine: (false-040000) Calling .GetConfigRaw
	I0311 04:09:41.516531   39784 main.go:141] libmachine: Creating machine...
	I0311 04:09:41.516539   39784 main.go:141] libmachine: (false-040000) Calling .Create
	I0311 04:09:41.516614   39784 main.go:141] libmachine: (false-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:41.516733   39784 main.go:141] libmachine: (false-040000) DBG | I0311 04:09:41.516602   39800 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:41.516815   39784 main.go:141] libmachine: (false-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:09:41.800709   39784 main.go:141] libmachine: (false-040000) DBG | I0311 04:09:41.800609   39800 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/false-040000/id_rsa...
	I0311 04:09:41.883506   39784 main.go:141] libmachine: (false-040000) DBG | I0311 04:09:41.883392   39800 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/false-040000/false-040000.rawdisk...
	I0311 04:09:41.883534   39784 main.go:141] libmachine: (false-040000) DBG | Writing magic tar header
	I0311 04:09:41.883613   39784 main.go:141] libmachine: (false-040000) DBG | Writing SSH key tar header
	I0311 04:09:41.907079   39784 main.go:141] libmachine: (false-040000) DBG | I0311 04:09:41.906988   39800 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/false-040000 ...
	I0311 04:09:42.306571   39784 main.go:141] libmachine: (false-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:42.306589   39784 main.go:141] libmachine: (false-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/false-040000/hyperkit.pid
	I0311 04:09:42.306602   39784 main.go:141] libmachine: (false-040000) DBG | Using UUID ff65ba81-6fbc-4931-bbfe-84520819fe4d
	I0311 04:09:42.474379   39784 main.go:141] libmachine: (false-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:09:42.474484   39784 client.go:171] duration metric: took 958.970949ms to LocalClient.Create
	I0311 04:09:44.475650   39784 start.go:128] duration metric: took 3.012641259s to createHost
	I0311 04:09:44.475676   39784 start.go:83] releasing machines lock for "false-040000", held for 3.012814514s
	W0311 04:09:44.475706   39784 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:09:44.476263   39784 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:44.476313   39784 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:44.485662   39784 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63424
	I0311 04:09:44.486038   39784 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:44.486388   39784 main.go:141] libmachine: Using API Version  1
	I0311 04:09:44.486400   39784 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:44.486633   39784 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:44.486972   39784 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:44.486996   39784 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:44.494888   39784 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63426
	I0311 04:09:44.495268   39784 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:44.495604   39784 main.go:141] libmachine: Using API Version  1
	I0311 04:09:44.495615   39784 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:44.495827   39784 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:44.495920   39784 main.go:141] libmachine: (false-040000) Calling .GetState
	I0311 04:09:44.496008   39784 main.go:141] libmachine: (false-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:44.496026   39784 main.go:141] libmachine: (false-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/false-040000/hyperkit.json: no such file or directory
	I0311 04:09:44.496041   39784 main.go:141] libmachine: (false-040000) DBG | hyperkit pid from json: 0
	I0311 04:09:44.496101   39784 main.go:141] libmachine: (false-040000) Calling .DriverName
	I0311 04:09:44.547442   39784 out.go:177] * Deleting "false-040000" in hyperkit ...
	I0311 04:09:44.568250   39784 main.go:141] libmachine: (false-040000) Calling .Remove
	I0311 04:09:44.568471   39784 main.go:141] libmachine: (false-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:44.568484   39784 main.go:141] libmachine: (false-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:44.568498   39784 main.go:141] libmachine: (false-040000) DBG | hyperkit pid from json: 0
	I0311 04:09:44.568510   39784 main.go:141] libmachine: (false-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/false-040000/hyperkit.json: no such file or directory
	W0311 04:09:44.649263   39784 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:09:44.649280   39784 start.go:728] Will try again in 5 seconds ...
	I0311 04:09:49.650984   39784 start.go:360] acquireMachinesLock for false-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:09:49.651199   39784 start.go:364] duration metric: took 169.036µs to acquireMachinesLock for "false-040000"
	I0311 04:09:49.651247   39784 start.go:93] Provisioning new machine with config: &{Name:false-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Ku
bernetesVersion:v1.28.4 ClusterName:false-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0
MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:09:49.651384   39784 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:09:49.674145   39784 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:09:49.674261   39784 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:49.674297   39784 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:49.682542   39784 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63452
	I0311 04:09:49.682967   39784 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:49.683294   39784 main.go:141] libmachine: Using API Version  1
	I0311 04:09:49.683305   39784 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:49.683516   39784 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:49.683623   39784 main.go:141] libmachine: (false-040000) Calling .GetMachineName
	I0311 04:09:49.683703   39784 main.go:141] libmachine: (false-040000) Calling .DriverName
	I0311 04:09:49.683815   39784 start.go:159] libmachine.API.Create for "false-040000" (driver="hyperkit")
	I0311 04:09:49.683842   39784 client.go:168] LocalClient.Create starting
	I0311 04:09:49.683868   39784 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:09:49.683916   39784 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:49.683927   39784 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:49.683973   39784 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:09:49.684014   39784 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:49.684025   39784 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:49.684036   39784 main.go:141] libmachine: Running pre-create checks...
	I0311 04:09:49.684042   39784 main.go:141] libmachine: (false-040000) Calling .PreCreateCheck
	I0311 04:09:49.684130   39784 main.go:141] libmachine: (false-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:49.684164   39784 main.go:141] libmachine: (false-040000) Calling .GetConfigRaw
	I0311 04:09:49.684701   39784 main.go:141] libmachine: Creating machine...
	I0311 04:09:49.684715   39784 main.go:141] libmachine: (false-040000) Calling .Create
	I0311 04:09:49.684811   39784 main.go:141] libmachine: (false-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:49.684920   39784 main.go:141] libmachine: (false-040000) DBG | I0311 04:09:49.684791   39901 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:49.684975   39784 main.go:141] libmachine: (false-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:09:49.876877   39784 main.go:141] libmachine: (false-040000) DBG | I0311 04:09:49.876800   39901 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/false-040000/id_rsa...
	I0311 04:09:50.143996   39784 main.go:141] libmachine: (false-040000) DBG | I0311 04:09:50.143881   39901 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/false-040000/false-040000.rawdisk...
	I0311 04:09:50.144015   39784 main.go:141] libmachine: (false-040000) DBG | Writing magic tar header
	I0311 04:09:50.144082   39784 main.go:141] libmachine: (false-040000) DBG | Writing SSH key tar header
	I0311 04:09:50.145098   39784 main.go:141] libmachine: (false-040000) DBG | I0311 04:09:50.145049   39901 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/false-040000 ...
	I0311 04:09:50.509927   39784 main.go:141] libmachine: (false-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:50.509944   39784 main.go:141] libmachine: (false-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/false-040000/hyperkit.pid
	I0311 04:09:50.509973   39784 main.go:141] libmachine: (false-040000) DBG | Using UUID faf35766-8ce3-4775-983e-b4a55135dcab
	I0311 04:09:50.528943   39784 main.go:141] libmachine: (false-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:09:50.529023   39784 client.go:171] duration metric: took 845.162237ms to LocalClient.Create
	I0311 04:09:52.529399   39784 start.go:128] duration metric: took 2.877953658s to createHost
	I0311 04:09:52.529414   39784 start.go:83] releasing machines lock for "false-040000", held for 2.878158993s
	W0311 04:09:52.529474   39784 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p false-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p false-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:09:52.591091   39784 out.go:177] 
	W0311 04:09:52.612864   39784 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:09:52.612969   39784 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:09:52.612985   39784 out.go:239] * Related issues:
	* Related issues:
	W0311 04:09:52.613015   39784 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:09:52.613043   39784 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:09:52.655125   39784 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/false/Start (11.75s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (11.41s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p kindnet-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kindnet-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=hyperkit : exit status 60 (11.40725624s)

                                                
                                                
-- stdout --
	* [kindnet-040000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "kindnet-040000" primary control-plane node in "kindnet-040000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "kindnet-040000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:09:45.637631   39889 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:09:45.637816   39889 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:09:45.637822   39889 out.go:304] Setting ErrFile to fd 2...
	I0311 04:09:45.637826   39889 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:09:45.638004   39889 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:09:45.639484   39889 out.go:298] Setting JSON to false
	I0311 04:09:45.661945   39889 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11355,"bootTime":1710144030,"procs":529,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:09:45.662034   39889 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:09:45.685921   39889 out.go:177] * [kindnet-040000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:09:45.729896   39889 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:09:45.729934   39889 notify.go:220] Checking for updates...
	I0311 04:09:45.774626   39889 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:09:45.796695   39889 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:09:45.817685   39889 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:09:45.838494   39889 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:45.859827   39889 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:09:45.882632   39889 config.go:182] Loaded profile config "false-040000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:09:45.882854   39889 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:09:45.883040   39889 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:09:45.912645   39889 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:09:45.954758   39889 start.go:297] selected driver: hyperkit
	I0311 04:09:45.954789   39889 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:09:45.954811   39889 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:09:45.959151   39889 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:09:45.959258   39889 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:09:45.967124   39889 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:09:45.971022   39889 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:45.971045   39889 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:09:45.971072   39889 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:09:45.971263   39889 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:09:45.971330   39889 cni.go:84] Creating CNI manager for "kindnet"
	I0311 04:09:45.971336   39889 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0311 04:09:45.971409   39889 start.go:340] cluster config:
	{Name:kindnet-040000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:kindnet-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:09:45.971489   39889 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:09:45.992530   39889 out.go:177] * Starting "kindnet-040000" primary control-plane node in "kindnet-040000" cluster
	I0311 04:09:46.034532   39889 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:09:46.034575   39889 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:09:46.034591   39889 cache.go:56] Caching tarball of preloaded images
	I0311 04:09:46.034708   39889 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:09:46.034717   39889 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:09:46.034800   39889 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/kindnet-040000/config.json ...
	I0311 04:09:46.034817   39889 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/kindnet-040000/config.json: {Name:mka91c7697b4c1e59335cb729ec98b34285c3b43 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:09:46.035128   39889 start.go:360] acquireMachinesLock for kindnet-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:09:46.035177   39889 start.go:364] duration metric: took 39.955µs to acquireMachinesLock for "kindnet-040000"
	I0311 04:09:46.035201   39889 start.go:93] Provisioning new machine with config: &{Name:kindnet-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kindnet-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:09:46.035240   39889 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:09:46.077796   39889 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:09:46.078086   39889 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:46.078158   39889 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:46.087364   39889 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63446
	I0311 04:09:46.087733   39889 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:46.088167   39889 main.go:141] libmachine: Using API Version  1
	I0311 04:09:46.088177   39889 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:46.088406   39889 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:46.088529   39889 main.go:141] libmachine: (kindnet-040000) Calling .GetMachineName
	I0311 04:09:46.088626   39889 main.go:141] libmachine: (kindnet-040000) Calling .DriverName
	I0311 04:09:46.088738   39889 start.go:159] libmachine.API.Create for "kindnet-040000" (driver="hyperkit")
	I0311 04:09:46.088763   39889 client.go:168] LocalClient.Create starting
	I0311 04:09:46.088795   39889 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:09:46.088846   39889 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:46.088861   39889 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:46.088930   39889 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:09:46.088972   39889 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:46.088985   39889 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:46.088998   39889 main.go:141] libmachine: Running pre-create checks...
	I0311 04:09:46.089003   39889 main.go:141] libmachine: (kindnet-040000) Calling .PreCreateCheck
	I0311 04:09:46.089100   39889 main.go:141] libmachine: (kindnet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:46.089237   39889 main.go:141] libmachine: (kindnet-040000) Calling .GetConfigRaw
	I0311 04:09:46.099092   39889 main.go:141] libmachine: Creating machine...
	I0311 04:09:46.099108   39889 main.go:141] libmachine: (kindnet-040000) Calling .Create
	I0311 04:09:46.099273   39889 main.go:141] libmachine: (kindnet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:46.099488   39889 main.go:141] libmachine: (kindnet-040000) DBG | I0311 04:09:46.099245   39897 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:46.099585   39889 main.go:141] libmachine: (kindnet-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:09:46.275700   39889 main.go:141] libmachine: (kindnet-040000) DBG | I0311 04:09:46.275600   39897 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kindnet-040000/id_rsa...
	I0311 04:09:46.410183   39889 main.go:141] libmachine: (kindnet-040000) DBG | I0311 04:09:46.410103   39897 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kindnet-040000/kindnet-040000.rawdisk...
	I0311 04:09:46.410195   39889 main.go:141] libmachine: (kindnet-040000) DBG | Writing magic tar header
	I0311 04:09:46.410203   39889 main.go:141] libmachine: (kindnet-040000) DBG | Writing SSH key tar header
	I0311 04:09:46.410996   39889 main.go:141] libmachine: (kindnet-040000) DBG | I0311 04:09:46.410889   39897 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kindnet-040000 ...
	I0311 04:09:46.775051   39889 main.go:141] libmachine: (kindnet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:46.775089   39889 main.go:141] libmachine: (kindnet-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kindnet-040000/hyperkit.pid
	I0311 04:09:46.775152   39889 main.go:141] libmachine: (kindnet-040000) DBG | Using UUID f38e31e8-932a-44c9-8b6e-be48a2193896
	I0311 04:09:46.791010   39889 main.go:141] libmachine: (kindnet-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:09:46.791109   39889 client.go:171] duration metric: took 702.322504ms to LocalClient.Create
	I0311 04:09:48.792321   39889 start.go:128] duration metric: took 2.757024783s to createHost
	I0311 04:09:48.792350   39889 start.go:83] releasing machines lock for "kindnet-040000", held for 2.757124639s
	W0311 04:09:48.792386   39889 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:09:48.792962   39889 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:48.793003   39889 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:48.802792   39889 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63448
	I0311 04:09:48.803187   39889 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:48.803562   39889 main.go:141] libmachine: Using API Version  1
	I0311 04:09:48.803577   39889 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:48.803801   39889 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:48.804135   39889 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:48.804158   39889 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:48.812357   39889 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63450
	I0311 04:09:48.812732   39889 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:48.813163   39889 main.go:141] libmachine: Using API Version  1
	I0311 04:09:48.813186   39889 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:48.813407   39889 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:48.813568   39889 main.go:141] libmachine: (kindnet-040000) Calling .GetState
	I0311 04:09:48.813679   39889 main.go:141] libmachine: (kindnet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:48.813709   39889 main.go:141] libmachine: (kindnet-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kindnet-040000/hyperkit.json: no such file or directory
	I0311 04:09:48.813717   39889 main.go:141] libmachine: (kindnet-040000) DBG | hyperkit pid from json: 0
	I0311 04:09:48.813776   39889 main.go:141] libmachine: (kindnet-040000) Calling .DriverName
	I0311 04:09:48.857409   39889 out.go:177] * Deleting "kindnet-040000" in hyperkit ...
	I0311 04:09:48.882567   39889 main.go:141] libmachine: (kindnet-040000) Calling .Remove
	I0311 04:09:48.882875   39889 main.go:141] libmachine: (kindnet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:48.882917   39889 main.go:141] libmachine: (kindnet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:48.882937   39889 main.go:141] libmachine: (kindnet-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kindnet-040000/hyperkit.json: no such file or directory
	I0311 04:09:48.882970   39889 main.go:141] libmachine: (kindnet-040000) DBG | hyperkit pid from json: 0
	W0311 04:09:48.901397   39889 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:09:48.901411   39889 start.go:728] Will try again in 5 seconds ...
	I0311 04:09:53.901773   39889 start.go:360] acquireMachinesLock for kindnet-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:09:53.901855   39889 start.go:364] duration metric: took 60.093µs to acquireMachinesLock for "kindnet-040000"
	I0311 04:09:53.901890   39889 start.go:93] Provisioning new machine with config: &{Name:kindnet-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kindnet-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:09:53.901955   39889 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:09:53.923495   39889 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:09:53.923578   39889 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:53.923622   39889 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:53.931686   39889 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63464
	I0311 04:09:53.932200   39889 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:53.932784   39889 main.go:141] libmachine: Using API Version  1
	I0311 04:09:53.932811   39889 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:53.933197   39889 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:53.933424   39889 main.go:141] libmachine: (kindnet-040000) Calling .GetMachineName
	I0311 04:09:53.933603   39889 main.go:141] libmachine: (kindnet-040000) Calling .DriverName
	I0311 04:09:53.933836   39889 start.go:159] libmachine.API.Create for "kindnet-040000" (driver="hyperkit")
	I0311 04:09:53.933854   39889 client.go:168] LocalClient.Create starting
	I0311 04:09:53.933910   39889 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:09:53.933968   39889 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:53.933985   39889 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:53.934030   39889 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:09:53.934055   39889 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:53.934068   39889 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:53.934085   39889 main.go:141] libmachine: Running pre-create checks...
	I0311 04:09:53.934091   39889 main.go:141] libmachine: (kindnet-040000) Calling .PreCreateCheck
	I0311 04:09:53.934170   39889 main.go:141] libmachine: (kindnet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:53.934196   39889 main.go:141] libmachine: (kindnet-040000) Calling .GetConfigRaw
	I0311 04:09:53.944653   39889 main.go:141] libmachine: Creating machine...
	I0311 04:09:53.944666   39889 main.go:141] libmachine: (kindnet-040000) Calling .Create
	I0311 04:09:53.944807   39889 main.go:141] libmachine: (kindnet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:53.944922   39889 main.go:141] libmachine: (kindnet-040000) DBG | I0311 04:09:53.944793   39932 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:53.945015   39889 main.go:141] libmachine: (kindnet-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:09:54.133698   39889 main.go:141] libmachine: (kindnet-040000) DBG | I0311 04:09:54.133618   39932 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kindnet-040000/id_rsa...
	I0311 04:09:54.287841   39889 main.go:141] libmachine: (kindnet-040000) DBG | I0311 04:09:54.287733   39932 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kindnet-040000/kindnet-040000.rawdisk...
	I0311 04:09:54.287873   39889 main.go:141] libmachine: (kindnet-040000) DBG | Writing magic tar header
	I0311 04:09:54.287897   39889 main.go:141] libmachine: (kindnet-040000) DBG | Writing SSH key tar header
	I0311 04:09:54.289599   39889 main.go:141] libmachine: (kindnet-040000) DBG | I0311 04:09:54.289518   39932 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kindnet-040000 ...
	I0311 04:09:54.774425   39889 main.go:141] libmachine: (kindnet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:54.774473   39889 main.go:141] libmachine: (kindnet-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kindnet-040000/hyperkit.pid
	I0311 04:09:54.774575   39889 main.go:141] libmachine: (kindnet-040000) DBG | Using UUID 5e508974-883d-4b8c-a06e-429c9e30cdcc
	I0311 04:09:54.791935   39889 main.go:141] libmachine: (kindnet-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:09:54.792069   39889 client.go:171] duration metric: took 858.194199ms to LocalClient.Create
	I0311 04:09:56.792265   39889 start.go:128] duration metric: took 2.890258258s to createHost
	I0311 04:09:56.792283   39889 start.go:83] releasing machines lock for "kindnet-040000", held for 2.890365235s
	W0311 04:09:56.792358   39889 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kindnet-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kindnet-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:09:56.834682   39889 out.go:177] 
	W0311 04:09:56.855800   39889 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:09:56.855844   39889 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:09:56.855859   39889 out.go:239] * Related issues:
	* Related issues:
	W0311 04:09:56.855881   39889 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:09:56.855910   39889 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:09:56.877130   39889 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/kindnet/Start (11.41s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (11.68s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p flannel-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p flannel-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=hyperkit : exit status 60 (11.67640871s)

                                                
                                                
-- stdout --
	* [flannel-040000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "flannel-040000" primary control-plane node in "flannel-040000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "flannel-040000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:09:59.212223   40083 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:09:59.212670   40083 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:09:59.212678   40083 out.go:304] Setting ErrFile to fd 2...
	I0311 04:09:59.212684   40083 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:09:59.212936   40083 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:09:59.215236   40083 out.go:298] Setting JSON to false
	I0311 04:09:59.239535   40083 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11369,"bootTime":1710144030,"procs":509,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:09:59.239648   40083 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:09:59.260677   40083 out.go:177] * [flannel-040000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:09:59.324906   40083 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:09:59.302889   40083 notify.go:220] Checking for updates...
	I0311 04:09:59.387881   40083 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:09:59.451694   40083 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:09:59.472439   40083 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:09:59.493642   40083 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:59.514730   40083 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:09:59.535911   40083 config.go:182] Loaded profile config "kindnet-040000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:09:59.536005   40083 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:09:59.536092   40083 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:09:59.564710   40083 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:09:59.606451   40083 start.go:297] selected driver: hyperkit
	I0311 04:09:59.606468   40083 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:09:59.606480   40083 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:09:59.609453   40083 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:09:59.609564   40083 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:09:59.617517   40083 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:09:59.621798   40083 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:59.621912   40083 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:09:59.621952   40083 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:09:59.622200   40083 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:09:59.622277   40083 cni.go:84] Creating CNI manager for "flannel"
	I0311 04:09:59.622290   40083 start_flags.go:319] Found "Flannel" CNI - setting NetworkPlugin=cni
	I0311 04:09:59.622392   40083 start.go:340] cluster config:
	{Name:flannel-040000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:flannel-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:09:59.622480   40083 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:09:59.664679   40083 out.go:177] * Starting "flannel-040000" primary control-plane node in "flannel-040000" cluster
	I0311 04:09:59.685638   40083 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:09:59.685684   40083 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:09:59.685707   40083 cache.go:56] Caching tarball of preloaded images
	I0311 04:09:59.685854   40083 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:09:59.685865   40083 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:09:59.685973   40083 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/flannel-040000/config.json ...
	I0311 04:09:59.685992   40083 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/flannel-040000/config.json: {Name:mkc447d17c53b67fe417649199f6008c59b2bea9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:09:59.686353   40083 start.go:360] acquireMachinesLock for flannel-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:09:59.686407   40083 start.go:364] duration metric: took 42.898µs to acquireMachinesLock for "flannel-040000"
	I0311 04:09:59.686432   40083 start.go:93] Provisioning new machine with config: &{Name:flannel-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:flannel-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:09:59.686488   40083 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:09:59.709890   40083 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:09:59.710222   40083 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:09:59.710301   40083 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:09:59.720552   40083 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63550
	I0311 04:09:59.721093   40083 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:09:59.721686   40083 main.go:141] libmachine: Using API Version  1
	I0311 04:09:59.721696   40083 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:09:59.721896   40083 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:09:59.722009   40083 main.go:141] libmachine: (flannel-040000) Calling .GetMachineName
	I0311 04:09:59.722101   40083 main.go:141] libmachine: (flannel-040000) Calling .DriverName
	I0311 04:09:59.722190   40083 start.go:159] libmachine.API.Create for "flannel-040000" (driver="hyperkit")
	I0311 04:09:59.722214   40083 client.go:168] LocalClient.Create starting
	I0311 04:09:59.722243   40083 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:09:59.722291   40083 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:59.722305   40083 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:59.722362   40083 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:09:59.722405   40083 main.go:141] libmachine: Decoding PEM data...
	I0311 04:09:59.722418   40083 main.go:141] libmachine: Parsing certificate...
	I0311 04:09:59.722432   40083 main.go:141] libmachine: Running pre-create checks...
	I0311 04:09:59.722439   40083 main.go:141] libmachine: (flannel-040000) Calling .PreCreateCheck
	I0311 04:09:59.722532   40083 main.go:141] libmachine: (flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:59.722728   40083 main.go:141] libmachine: (flannel-040000) Calling .GetConfigRaw
	I0311 04:09:59.730998   40083 main.go:141] libmachine: Creating machine...
	I0311 04:09:59.731011   40083 main.go:141] libmachine: (flannel-040000) Calling .Create
	I0311 04:09:59.731240   40083 main.go:141] libmachine: (flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:09:59.731435   40083 main.go:141] libmachine: (flannel-040000) DBG | I0311 04:09:59.731228   40104 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:09:59.731502   40083 main.go:141] libmachine: (flannel-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:10:00.130012   40083 main.go:141] libmachine: (flannel-040000) DBG | I0311 04:10:00.129919   40104 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/flannel-040000/id_rsa...
	I0311 04:10:00.201753   40083 main.go:141] libmachine: (flannel-040000) DBG | I0311 04:10:00.201595   40104 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/flannel-040000/flannel-040000.rawdisk...
	I0311 04:10:00.201793   40083 main.go:141] libmachine: (flannel-040000) DBG | Writing magic tar header
	I0311 04:10:00.201826   40083 main.go:141] libmachine: (flannel-040000) DBG | Writing SSH key tar header
	I0311 04:10:00.223403   40083 main.go:141] libmachine: (flannel-040000) DBG | I0311 04:10:00.223297   40104 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/flannel-040000 ...
	I0311 04:10:00.623007   40083 main.go:141] libmachine: (flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:00.623067   40083 main.go:141] libmachine: (flannel-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/flannel-040000/hyperkit.pid
	I0311 04:10:00.623174   40083 main.go:141] libmachine: (flannel-040000) DBG | Using UUID a7b545be-60e0-4076-90f5-9ff1e54dac82
	I0311 04:10:00.643812   40083 main.go:141] libmachine: (flannel-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:00.643954   40083 client.go:171] duration metric: took 921.716894ms to LocalClient.Create
	I0311 04:10:02.645365   40083 start.go:128] duration metric: took 2.958823896s to createHost
	I0311 04:10:02.645382   40083 start.go:83] releasing machines lock for "flannel-040000", held for 2.958924274s
	W0311 04:10:02.645399   40083 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:10:02.645721   40083 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:02.645744   40083 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:02.654617   40083 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63590
	I0311 04:10:02.655054   40083 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:02.655453   40083 main.go:141] libmachine: Using API Version  1
	I0311 04:10:02.655468   40083 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:02.655690   40083 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:02.656039   40083 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:02.656062   40083 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:02.664449   40083 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63592
	I0311 04:10:02.664819   40083 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:02.665219   40083 main.go:141] libmachine: Using API Version  1
	I0311 04:10:02.665233   40083 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:02.665442   40083 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:02.665547   40083 main.go:141] libmachine: (flannel-040000) Calling .GetState
	I0311 04:10:02.665629   40083 main.go:141] libmachine: (flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:02.665659   40083 main.go:141] libmachine: (flannel-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/flannel-040000/hyperkit.json: no such file or directory
	I0311 04:10:02.665668   40083 main.go:141] libmachine: (flannel-040000) DBG | hyperkit pid from json: 0
	I0311 04:10:02.665712   40083 main.go:141] libmachine: (flannel-040000) Calling .DriverName
	I0311 04:10:02.708432   40083 out.go:177] * Deleting "flannel-040000" in hyperkit ...
	I0311 04:10:02.730137   40083 main.go:141] libmachine: (flannel-040000) Calling .Remove
	I0311 04:10:02.730350   40083 main.go:141] libmachine: (flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:02.730367   40083 main.go:141] libmachine: (flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:02.730388   40083 main.go:141] libmachine: (flannel-040000) DBG | hyperkit pid from json: 0
	I0311 04:10:02.730410   40083 main.go:141] libmachine: (flannel-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/flannel-040000/hyperkit.json: no such file or directory
	W0311 04:10:02.820760   40083 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:02.820773   40083 start.go:728] Will try again in 5 seconds ...
	I0311 04:10:07.821080   40083 start.go:360] acquireMachinesLock for flannel-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:07.821317   40083 start.go:364] duration metric: took 142.979µs to acquireMachinesLock for "flannel-040000"
	I0311 04:10:07.821361   40083 start.go:93] Provisioning new machine with config: &{Name:flannel-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:flannel-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:10:07.821482   40083 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:10:07.843310   40083 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:10:07.843496   40083 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:07.843569   40083 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:07.853162   40083 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63616
	I0311 04:10:07.853537   40083 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:07.853866   40083 main.go:141] libmachine: Using API Version  1
	I0311 04:10:07.853881   40083 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:07.854087   40083 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:07.854178   40083 main.go:141] libmachine: (flannel-040000) Calling .GetMachineName
	I0311 04:10:07.854262   40083 main.go:141] libmachine: (flannel-040000) Calling .DriverName
	I0311 04:10:07.854372   40083 start.go:159] libmachine.API.Create for "flannel-040000" (driver="hyperkit")
	I0311 04:10:07.854388   40083 client.go:168] LocalClient.Create starting
	I0311 04:10:07.854420   40083 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:10:07.854467   40083 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:07.854479   40083 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:07.854518   40083 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:10:07.854559   40083 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:07.854572   40083 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:07.854585   40083 main.go:141] libmachine: Running pre-create checks...
	I0311 04:10:07.854591   40083 main.go:141] libmachine: (flannel-040000) Calling .PreCreateCheck
	I0311 04:10:07.854675   40083 main.go:141] libmachine: (flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:07.854716   40083 main.go:141] libmachine: (flannel-040000) Calling .GetConfigRaw
	I0311 04:10:07.855327   40083 main.go:141] libmachine: Creating machine...
	I0311 04:10:07.855335   40083 main.go:141] libmachine: (flannel-040000) Calling .Create
	I0311 04:10:07.855408   40083 main.go:141] libmachine: (flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:07.855516   40083 main.go:141] libmachine: (flannel-040000) DBG | I0311 04:10:07.855390   40200 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:07.855564   40083 main.go:141] libmachine: (flannel-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:10:08.035586   40083 main.go:141] libmachine: (flannel-040000) DBG | I0311 04:10:08.035521   40200 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/flannel-040000/id_rsa...
	I0311 04:10:08.259500   40083 main.go:141] libmachine: (flannel-040000) DBG | I0311 04:10:08.259408   40200 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/flannel-040000/flannel-040000.rawdisk...
	I0311 04:10:08.259520   40083 main.go:141] libmachine: (flannel-040000) DBG | Writing magic tar header
	I0311 04:10:08.259531   40083 main.go:141] libmachine: (flannel-040000) DBG | Writing SSH key tar header
	I0311 04:10:08.260183   40083 main.go:141] libmachine: (flannel-040000) DBG | I0311 04:10:08.260138   40200 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/flannel-040000 ...
	I0311 04:10:08.620417   40083 main.go:141] libmachine: (flannel-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:08.620438   40083 main.go:141] libmachine: (flannel-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/flannel-040000/hyperkit.pid
	I0311 04:10:08.620452   40083 main.go:141] libmachine: (flannel-040000) DBG | Using UUID 8b9b127d-b37b-4673-9e41-947cc75ff144
	I0311 04:10:08.639560   40083 main.go:141] libmachine: (flannel-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:08.639675   40083 client.go:171] duration metric: took 785.267439ms to LocalClient.Create
	I0311 04:10:10.640416   40083 start.go:128] duration metric: took 2.818877484s to createHost
	I0311 04:10:10.640440   40083 start.go:83] releasing machines lock for "flannel-040000", held for 2.819067329s
	W0311 04:10:10.640540   40083 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p flannel-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p flannel-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:10.687046   40083 out.go:177] 
	W0311 04:10:10.709472   40083 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:10:10.709541   40083 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:10:10.709611   40083 out.go:239] * Related issues:
	* Related issues:
	W0311 04:10:10.709636   40083 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:10:10.709656   40083 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:10:10.731180   40083 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/flannel/Start (11.68s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (11.69s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p enable-default-cni-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p enable-default-cni-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=hyperkit : exit status 60 (11.684000484s)

                                                
                                                
-- stdout --
	* [enable-default-cni-040000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "enable-default-cni-040000" primary control-plane node in "enable-default-cni-040000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "enable-default-cni-040000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:10:03.646634   40188 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:10:03.646883   40188 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:03.646889   40188 out.go:304] Setting ErrFile to fd 2...
	I0311 04:10:03.646893   40188 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:03.647081   40188 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:10:03.648522   40188 out.go:298] Setting JSON to false
	I0311 04:10:03.670806   40188 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11373,"bootTime":1710144030,"procs":532,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:10:03.670950   40188 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:10:03.693661   40188 out.go:177] * [enable-default-cni-040000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:10:03.735761   40188 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:10:03.735834   40188 notify.go:220] Checking for updates...
	I0311 04:10:03.779675   40188 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:10:03.801556   40188 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:10:03.822698   40188 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:10:03.843752   40188 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:03.886616   40188 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:10:03.908587   40188 config.go:182] Loaded profile config "flannel-040000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:10:03.908768   40188 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:10:03.908935   40188 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:10:03.938481   40188 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:10:03.996708   40188 start.go:297] selected driver: hyperkit
	I0311 04:10:03.996737   40188 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:10:03.996760   40188 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:10:04.000969   40188 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:04.001091   40188 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:10:04.009771   40188 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:10:04.013832   40188 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:04.013855   40188 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:10:04.013885   40188 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	E0311 04:10:04.014072   40188 start_flags.go:464] Found deprecated --enable-default-cni flag, setting --cni=bridge
	I0311 04:10:04.014099   40188 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:10:04.014164   40188 cni.go:84] Creating CNI manager for "bridge"
	I0311 04:10:04.014172   40188 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0311 04:10:04.014246   40188 start.go:340] cluster config:
	{Name:enable-default-cni-040000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPa
th: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:10:04.014332   40188 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:04.056604   40188 out.go:177] * Starting "enable-default-cni-040000" primary control-plane node in "enable-default-cni-040000" cluster
	I0311 04:10:04.080523   40188 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:10:04.080643   40188 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:10:04.080674   40188 cache.go:56] Caching tarball of preloaded images
	I0311 04:10:04.080880   40188 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:10:04.080899   40188 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:10:04.081044   40188 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/enable-default-cni-040000/config.json ...
	I0311 04:10:04.081079   40188 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/enable-default-cni-040000/config.json: {Name:mk2b4999794159e6db2195689d5fa3aa1ab71579 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:10:04.082020   40188 start.go:360] acquireMachinesLock for enable-default-cni-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:04.082116   40188 start.go:364] duration metric: took 70.264µs to acquireMachinesLock for "enable-default-cni-040000"
	I0311 04:10:04.082150   40188 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:10:04.082216   40188 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:10:04.103758   40188 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:10:04.104056   40188 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:04.104180   40188 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:04.113922   40188 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63610
	I0311 04:10:04.114294   40188 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:04.114723   40188 main.go:141] libmachine: Using API Version  1
	I0311 04:10:04.114735   40188 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:04.114970   40188 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:04.115095   40188 main.go:141] libmachine: (enable-default-cni-040000) Calling .GetMachineName
	I0311 04:10:04.115188   40188 main.go:141] libmachine: (enable-default-cni-040000) Calling .DriverName
	I0311 04:10:04.115289   40188 start.go:159] libmachine.API.Create for "enable-default-cni-040000" (driver="hyperkit")
	I0311 04:10:04.115312   40188 client.go:168] LocalClient.Create starting
	I0311 04:10:04.115343   40188 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:10:04.115394   40188 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:04.115409   40188 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:04.115465   40188 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:10:04.115513   40188 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:04.115521   40188 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:04.115539   40188 main.go:141] libmachine: Running pre-create checks...
	I0311 04:10:04.115545   40188 main.go:141] libmachine: (enable-default-cni-040000) Calling .PreCreateCheck
	I0311 04:10:04.115619   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:04.115857   40188 main.go:141] libmachine: (enable-default-cni-040000) Calling .GetConfigRaw
	I0311 04:10:04.125067   40188 main.go:141] libmachine: Creating machine...
	I0311 04:10:04.125092   40188 main.go:141] libmachine: (enable-default-cni-040000) Calling .Create
	I0311 04:10:04.125298   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:04.125538   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | I0311 04:10:04.125255   40196 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:04.125608   40188 main.go:141] libmachine: (enable-default-cni-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:10:04.339030   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | I0311 04:10:04.338966   40196 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/enable-default-cni-040000/id_rsa...
	I0311 04:10:04.399183   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | I0311 04:10:04.399105   40196 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/enable-default-cni-040000/enable-default-cni-040000.rawdisk...
	I0311 04:10:04.399194   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | Writing magic tar header
	I0311 04:10:04.399203   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | Writing SSH key tar header
	I0311 04:10:04.400122   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | I0311 04:10:04.400043   40196 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/enable-default-cni-040000 ...
	I0311 04:10:04.762778   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:04.762800   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/enable-default-cni-040000/hyperkit.pid
	I0311 04:10:04.762814   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | Using UUID cab66565-aaa3-4aca-a067-341e0768e234
	I0311 04:10:04.781857   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:04.781944   40188 client.go:171] duration metric: took 666.612378ms to LocalClient.Create
	I0311 04:10:06.782145   40188 start.go:128] duration metric: took 2.699875016s to createHost
	I0311 04:10:06.782170   40188 start.go:83] releasing machines lock for "enable-default-cni-040000", held for 2.700003561s
	W0311 04:10:06.782197   40188 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:10:06.782685   40188 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:06.782717   40188 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:06.791445   40188 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63612
	I0311 04:10:06.791843   40188 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:06.792208   40188 main.go:141] libmachine: Using API Version  1
	I0311 04:10:06.792228   40188 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:06.792416   40188 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:06.792746   40188 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:06.792767   40188 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:06.800702   40188 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63614
	I0311 04:10:06.801051   40188 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:06.801395   40188 main.go:141] libmachine: Using API Version  1
	I0311 04:10:06.801409   40188 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:06.801632   40188 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:06.801751   40188 main.go:141] libmachine: (enable-default-cni-040000) Calling .GetState
	I0311 04:10:06.801849   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:06.801871   40188 main.go:141] libmachine: (enable-default-cni-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/enable-default-cni-040000/hyperkit.json: no such file or directory
	I0311 04:10:06.801879   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | hyperkit pid from json: 0
	I0311 04:10:06.801912   40188 main.go:141] libmachine: (enable-default-cni-040000) Calling .DriverName
	I0311 04:10:06.857596   40188 out.go:177] * Deleting "enable-default-cni-040000" in hyperkit ...
	I0311 04:10:06.879583   40188 main.go:141] libmachine: (enable-default-cni-040000) Calling .Remove
	I0311 04:10:06.879903   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:06.879926   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:06.879949   40188 main.go:141] libmachine: (enable-default-cni-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/enable-default-cni-040000/hyperkit.json: no such file or directory
	I0311 04:10:06.879971   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | hyperkit pid from json: 0
	W0311 04:10:06.899974   40188 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:06.899987   40188 start.go:728] Will try again in 5 seconds ...
	I0311 04:10:11.900281   40188 start.go:360] acquireMachinesLock for enable-default-cni-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:11.900453   40188 start.go:364] duration metric: took 118.569µs to acquireMachinesLock for "enable-default-cni-040000"
	I0311 04:10:11.900497   40188 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:10:11.900634   40188 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:10:11.944367   40188 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:10:11.944616   40188 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:11.944701   40188 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:11.954180   40188 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63628
	I0311 04:10:11.954581   40188 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:11.954901   40188 main.go:141] libmachine: Using API Version  1
	I0311 04:10:11.954911   40188 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:11.955149   40188 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:11.955249   40188 main.go:141] libmachine: (enable-default-cni-040000) Calling .GetMachineName
	I0311 04:10:11.955335   40188 main.go:141] libmachine: (enable-default-cni-040000) Calling .DriverName
	I0311 04:10:11.955438   40188 start.go:159] libmachine.API.Create for "enable-default-cni-040000" (driver="hyperkit")
	I0311 04:10:11.955457   40188 client.go:168] LocalClient.Create starting
	I0311 04:10:11.955486   40188 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:10:11.955519   40188 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:11.955530   40188 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:11.955571   40188 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:10:11.955602   40188 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:11.955617   40188 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:11.955631   40188 main.go:141] libmachine: Running pre-create checks...
	I0311 04:10:11.955637   40188 main.go:141] libmachine: (enable-default-cni-040000) Calling .PreCreateCheck
	I0311 04:10:11.955714   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:11.955740   40188 main.go:141] libmachine: (enable-default-cni-040000) Calling .GetConfigRaw
	I0311 04:10:11.986236   40188 main.go:141] libmachine: Creating machine...
	I0311 04:10:11.986258   40188 main.go:141] libmachine: (enable-default-cni-040000) Calling .Create
	I0311 04:10:11.986471   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:11.986643   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | I0311 04:10:11.986430   40228 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:11.986741   40188 main.go:141] libmachine: (enable-default-cni-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:10:12.189395   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | I0311 04:10:12.189333   40228 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/enable-default-cni-040000/id_rsa...
	I0311 04:10:12.452495   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | I0311 04:10:12.452392   40228 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/enable-default-cni-040000/enable-default-cni-040000.rawdisk...
	I0311 04:10:12.452510   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | Writing magic tar header
	I0311 04:10:12.452526   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | Writing SSH key tar header
	I0311 04:10:12.476070   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | I0311 04:10:12.475940   40228 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/enable-default-cni-040000 ...
	I0311 04:10:12.887861   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:12.887883   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/enable-default-cni-040000/hyperkit.pid
	I0311 04:10:12.887893   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | Using UUID bc3dfb07-92fe-4f14-991a-bcc8ee83ad8a
	I0311 04:10:13.041159   40188 main.go:141] libmachine: (enable-default-cni-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:13.041227   40188 client.go:171] duration metric: took 1.085740739s to LocalClient.Create
	I0311 04:10:15.041341   40188 start.go:128] duration metric: took 3.140647397s to createHost
	I0311 04:10:15.041354   40188 start.go:83] releasing machines lock for "enable-default-cni-040000", held for 3.140841676s
	W0311 04:10:15.041441   40188 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p enable-default-cni-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p enable-default-cni-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:15.085118   40188 out.go:177] 
	W0311 04:10:15.106706   40188 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:10:15.106761   40188 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:10:15.106780   40188 out.go:239] * Related issues:
	* Related issues:
	W0311 04:10:15.106797   40188 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:10:15.106864   40188 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:10:15.185871   40188 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/enable-default-cni/Start (11.69s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (11.55s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p bridge-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p bridge-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=hyperkit : exit status 60 (11.549908031s)

                                                
                                                
-- stdout --
	* [bridge-040000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "bridge-040000" primary control-plane node in "bridge-040000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "bridge-040000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:10:17.989563   40404 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:10:17.990028   40404 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:17.990037   40404 out.go:304] Setting ErrFile to fd 2...
	I0311 04:10:17.990043   40404 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:17.990298   40404 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:10:17.992141   40404 out.go:298] Setting JSON to false
	I0311 04:10:18.016319   40404 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11388,"bootTime":1710144030,"procs":513,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:10:18.016416   40404 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:10:18.037609   40404 out.go:177] * [bridge-040000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:10:18.101608   40404 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:10:18.080067   40404 notify.go:220] Checking for updates...
	I0311 04:10:18.185938   40404 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:10:18.229597   40404 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:10:18.250764   40404 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:10:18.271744   40404 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:18.292399   40404 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:10:18.314485   40404 config.go:182] Loaded profile config "enable-default-cni-040000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:10:18.314760   40404 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:10:18.314975   40404 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:10:18.344687   40404 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:10:18.386692   40404 start.go:297] selected driver: hyperkit
	I0311 04:10:18.386722   40404 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:10:18.386744   40404 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:10:18.391028   40404 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:18.391132   40404 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:10:18.399009   40404 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:10:18.402964   40404 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:18.402985   40404 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:10:18.403028   40404 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:10:18.403225   40404 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:10:18.403290   40404 cni.go:84] Creating CNI manager for "bridge"
	I0311 04:10:18.403299   40404 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0311 04:10:18.403368   40404 start.go:340] cluster config:
	{Name:bridge-040000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:bridge-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunti
me:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSoc
k: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:10:18.403444   40404 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:18.470886   40404 out.go:177] * Starting "bridge-040000" primary control-plane node in "bridge-040000" cluster
	I0311 04:10:18.492812   40404 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:10:18.492896   40404 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:10:18.492929   40404 cache.go:56] Caching tarball of preloaded images
	I0311 04:10:18.493167   40404 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:10:18.493190   40404 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:10:18.493332   40404 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/bridge-040000/config.json ...
	I0311 04:10:18.493372   40404 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/bridge-040000/config.json: {Name:mk9687f11f3831922ac11e17dc4f113faa331be4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:10:18.494081   40404 start.go:360] acquireMachinesLock for bridge-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:18.494204   40404 start.go:364] duration metric: took 98.162µs to acquireMachinesLock for "bridge-040000"
	I0311 04:10:18.494252   40404 start.go:93] Provisioning new machine with config: &{Name:bridge-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:bridge-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:10:18.494369   40404 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:10:18.515765   40404 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:10:18.515907   40404 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:18.515951   40404 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:18.524418   40404 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63726
	I0311 04:10:18.524816   40404 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:18.525264   40404 main.go:141] libmachine: Using API Version  1
	I0311 04:10:18.525275   40404 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:18.525543   40404 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:18.525666   40404 main.go:141] libmachine: (bridge-040000) Calling .GetMachineName
	I0311 04:10:18.525759   40404 main.go:141] libmachine: (bridge-040000) Calling .DriverName
	I0311 04:10:18.525864   40404 start.go:159] libmachine.API.Create for "bridge-040000" (driver="hyperkit")
	I0311 04:10:18.525891   40404 client.go:168] LocalClient.Create starting
	I0311 04:10:18.525927   40404 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:10:18.525984   40404 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:18.526002   40404 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:18.526059   40404 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:10:18.526094   40404 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:18.526105   40404 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:18.526117   40404 main.go:141] libmachine: Running pre-create checks...
	I0311 04:10:18.526127   40404 main.go:141] libmachine: (bridge-040000) Calling .PreCreateCheck
	I0311 04:10:18.526205   40404 main.go:141] libmachine: (bridge-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:18.526357   40404 main.go:141] libmachine: (bridge-040000) Calling .GetConfigRaw
	I0311 04:10:18.536929   40404 main.go:141] libmachine: Creating machine...
	I0311 04:10:18.536943   40404 main.go:141] libmachine: (bridge-040000) Calling .Create
	I0311 04:10:18.537074   40404 main.go:141] libmachine: (bridge-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:18.537217   40404 main.go:141] libmachine: (bridge-040000) DBG | I0311 04:10:18.537062   40419 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:18.537275   40404 main.go:141] libmachine: (bridge-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:10:18.824763   40404 main.go:141] libmachine: (bridge-040000) DBG | I0311 04:10:18.824692   40419 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/bridge-040000/id_rsa...
	I0311 04:10:18.906106   40404 main.go:141] libmachine: (bridge-040000) DBG | I0311 04:10:18.906030   40419 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/bridge-040000/bridge-040000.rawdisk...
	I0311 04:10:18.906125   40404 main.go:141] libmachine: (bridge-040000) DBG | Writing magic tar header
	I0311 04:10:18.906137   40404 main.go:141] libmachine: (bridge-040000) DBG | Writing SSH key tar header
	I0311 04:10:18.906542   40404 main.go:141] libmachine: (bridge-040000) DBG | I0311 04:10:18.906488   40419 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/bridge-040000 ...
	I0311 04:10:19.394229   40404 main.go:141] libmachine: (bridge-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:19.394254   40404 main.go:141] libmachine: (bridge-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/bridge-040000/hyperkit.pid
	I0311 04:10:19.394314   40404 main.go:141] libmachine: (bridge-040000) DBG | Using UUID 15404773-32c6-44b0-b280-dd442d13f180
	I0311 04:10:19.436820   40404 main.go:141] libmachine: (bridge-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:19.436953   40404 client.go:171] duration metric: took 911.035237ms to LocalClient.Create
	I0311 04:10:21.437799   40404 start.go:128] duration metric: took 2.943356616s to createHost
	I0311 04:10:21.437811   40404 start.go:83] releasing machines lock for "bridge-040000", held for 2.943552275s
	W0311 04:10:21.437826   40404 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:10:21.438097   40404 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:21.438121   40404 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:21.446039   40404 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63766
	I0311 04:10:21.446405   40404 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:21.446824   40404 main.go:141] libmachine: Using API Version  1
	I0311 04:10:21.446843   40404 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:21.447108   40404 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:21.447466   40404 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:21.447488   40404 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:21.455646   40404 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63771
	I0311 04:10:21.455965   40404 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:21.456318   40404 main.go:141] libmachine: Using API Version  1
	I0311 04:10:21.456336   40404 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:21.456545   40404 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:21.456655   40404 main.go:141] libmachine: (bridge-040000) Calling .GetState
	I0311 04:10:21.456732   40404 main.go:141] libmachine: (bridge-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:21.456757   40404 main.go:141] libmachine: (bridge-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/bridge-040000/hyperkit.json: no such file or directory
	I0311 04:10:21.456763   40404 main.go:141] libmachine: (bridge-040000) DBG | hyperkit pid from json: 0
	I0311 04:10:21.456832   40404 main.go:141] libmachine: (bridge-040000) Calling .DriverName
	I0311 04:10:21.494710   40404 out.go:177] * Deleting "bridge-040000" in hyperkit ...
	I0311 04:10:21.516371   40404 main.go:141] libmachine: (bridge-040000) Calling .Remove
	I0311 04:10:21.516565   40404 main.go:141] libmachine: (bridge-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:21.516578   40404 main.go:141] libmachine: (bridge-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:21.516591   40404 main.go:141] libmachine: (bridge-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/bridge-040000/hyperkit.json: no such file or directory
	I0311 04:10:21.516598   40404 main.go:141] libmachine: (bridge-040000) DBG | hyperkit pid from json: 0
	W0311 04:10:21.535534   40404 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:21.535555   40404 start.go:728] Will try again in 5 seconds ...
	I0311 04:10:26.537849   40404 start.go:360] acquireMachinesLock for bridge-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:26.538039   40404 start.go:364] duration metric: took 157.321µs to acquireMachinesLock for "bridge-040000"
	I0311 04:10:26.538080   40404 start.go:93] Provisioning new machine with config: &{Name:bridge-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:bridge-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:10:26.538220   40404 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:10:26.560889   40404 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:10:26.561006   40404 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:26.561031   40404 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:26.569266   40404 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63784
	I0311 04:10:26.569664   40404 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:26.570012   40404 main.go:141] libmachine: Using API Version  1
	I0311 04:10:26.570040   40404 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:26.570270   40404 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:26.570400   40404 main.go:141] libmachine: (bridge-040000) Calling .GetMachineName
	I0311 04:10:26.570493   40404 main.go:141] libmachine: (bridge-040000) Calling .DriverName
	I0311 04:10:26.570626   40404 start.go:159] libmachine.API.Create for "bridge-040000" (driver="hyperkit")
	I0311 04:10:26.570642   40404 client.go:168] LocalClient.Create starting
	I0311 04:10:26.570672   40404 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:10:26.570720   40404 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:26.570732   40404 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:26.570774   40404 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:10:26.570811   40404 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:26.570824   40404 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:26.570835   40404 main.go:141] libmachine: Running pre-create checks...
	I0311 04:10:26.570840   40404 main.go:141] libmachine: (bridge-040000) Calling .PreCreateCheck
	I0311 04:10:26.570938   40404 main.go:141] libmachine: (bridge-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:26.570968   40404 main.go:141] libmachine: (bridge-040000) Calling .GetConfigRaw
	I0311 04:10:26.571467   40404 main.go:141] libmachine: Creating machine...
	I0311 04:10:26.571476   40404 main.go:141] libmachine: (bridge-040000) Calling .Create
	I0311 04:10:26.571548   40404 main.go:141] libmachine: (bridge-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:26.571657   40404 main.go:141] libmachine: (bridge-040000) DBG | I0311 04:10:26.571535   40502 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:26.571720   40404 main.go:141] libmachine: (bridge-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:10:26.763440   40404 main.go:141] libmachine: (bridge-040000) DBG | I0311 04:10:26.763367   40502 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/bridge-040000/id_rsa...
	I0311 04:10:26.886561   40404 main.go:141] libmachine: (bridge-040000) DBG | I0311 04:10:26.886478   40502 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/bridge-040000/bridge-040000.rawdisk...
	I0311 04:10:26.886574   40404 main.go:141] libmachine: (bridge-040000) DBG | Writing magic tar header
	I0311 04:10:26.886583   40404 main.go:141] libmachine: (bridge-040000) DBG | Writing SSH key tar header
	I0311 04:10:26.887543   40404 main.go:141] libmachine: (bridge-040000) DBG | I0311 04:10:26.887448   40502 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/bridge-040000 ...
	I0311 04:10:27.248138   40404 main.go:141] libmachine: (bridge-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:27.248157   40404 main.go:141] libmachine: (bridge-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/bridge-040000/hyperkit.pid
	I0311 04:10:27.248170   40404 main.go:141] libmachine: (bridge-040000) DBG | Using UUID f47e3601-0e5c-40c1-87a5-4df947af6bdb
	I0311 04:10:27.270199   40404 main.go:141] libmachine: (bridge-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:27.270281   40404 client.go:171] duration metric: took 699.621559ms to LocalClient.Create
	I0311 04:10:29.270780   40404 start.go:128] duration metric: took 2.732506218s to createHost
	I0311 04:10:29.270803   40404 start.go:83] releasing machines lock for "bridge-040000", held for 2.732711758s
	W0311 04:10:29.270907   40404 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p bridge-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p bridge-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:29.315498   40404 out.go:177] 
	W0311 04:10:29.337384   40404 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:10:29.337459   40404 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:10:29.337477   40404 out.go:239] * Related issues:
	* Related issues:
	W0311 04:10:29.337501   40404 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:10:29.337524   40404 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:10:29.380612   40404 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/bridge/Start (11.55s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Start (11.69s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p kubenet-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubenet-040000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=hyperkit : exit status 60 (11.687016444s)

                                                
                                                
-- stdout --
	* [kubenet-040000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "kubenet-040000" primary control-plane node in "kubenet-040000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "kubenet-040000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:10:21.832977   40490 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:10:21.833730   40490 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:21.833740   40490 out.go:304] Setting ErrFile to fd 2...
	I0311 04:10:21.833746   40490 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:21.834370   40490 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:10:21.835909   40490 out.go:298] Setting JSON to false
	I0311 04:10:21.858681   40490 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11391,"bootTime":1710144030,"procs":531,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:10:21.858771   40490 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:10:21.880982   40490 out.go:177] * [kubenet-040000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:10:21.945127   40490 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:10:21.923082   40490 notify.go:220] Checking for updates...
	I0311 04:10:21.986868   40490 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:10:22.031275   40490 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:10:22.052942   40490 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:10:22.074201   40490 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:22.096287   40490 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:10:22.118710   40490 config.go:182] Loaded profile config "bridge-040000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:10:22.118920   40490 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:10:22.119073   40490 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:10:22.149039   40490 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:10:22.191052   40490 start.go:297] selected driver: hyperkit
	I0311 04:10:22.191084   40490 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:10:22.191107   40490 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:10:22.195288   40490 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:22.195406   40490 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:10:22.203090   40490 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:10:22.206933   40490 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:22.206955   40490 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:10:22.206991   40490 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:10:22.207195   40490 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:10:22.207254   40490 cni.go:80] network plugin configured as "kubenet", returning disabled
	I0311 04:10:22.207326   40490 start.go:340] cluster config:
	{Name:kubenet-040000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:kubenet-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSoc
k: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:10:22.207415   40490 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:22.250057   40490 out.go:177] * Starting "kubenet-040000" primary control-plane node in "kubenet-040000" cluster
	I0311 04:10:22.271944   40490 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:10:22.272015   40490 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:10:22.272089   40490 cache.go:56] Caching tarball of preloaded images
	I0311 04:10:22.272285   40490 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:10:22.272305   40490 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:10:22.272430   40490 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/kubenet-040000/config.json ...
	I0311 04:10:22.272463   40490 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/kubenet-040000/config.json: {Name:mk8fb95007d8fd2549024652d0512d83b789e92e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:10:22.273056   40490 start.go:360] acquireMachinesLock for kubenet-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:22.273156   40490 start.go:364] duration metric: took 81.123µs to acquireMachinesLock for "kubenet-040000"
	I0311 04:10:22.273199   40490 start.go:93] Provisioning new machine with config: &{Name:kubenet-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kubenet-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:10:22.273281   40490 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:10:22.295196   40490 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:10:22.295492   40490 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:22.295565   40490 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:22.305149   40490 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63778
	I0311 04:10:22.305544   40490 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:22.305996   40490 main.go:141] libmachine: Using API Version  1
	I0311 04:10:22.306007   40490 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:22.306252   40490 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:22.306375   40490 main.go:141] libmachine: (kubenet-040000) Calling .GetMachineName
	I0311 04:10:22.306466   40490 main.go:141] libmachine: (kubenet-040000) Calling .DriverName
	I0311 04:10:22.306577   40490 start.go:159] libmachine.API.Create for "kubenet-040000" (driver="hyperkit")
	I0311 04:10:22.306601   40490 client.go:168] LocalClient.Create starting
	I0311 04:10:22.306632   40490 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:10:22.306681   40490 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:22.306700   40490 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:22.306760   40490 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:10:22.306795   40490 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:22.306807   40490 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:22.306819   40490 main.go:141] libmachine: Running pre-create checks...
	I0311 04:10:22.306829   40490 main.go:141] libmachine: (kubenet-040000) Calling .PreCreateCheck
	I0311 04:10:22.306906   40490 main.go:141] libmachine: (kubenet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:22.307075   40490 main.go:141] libmachine: (kubenet-040000) Calling .GetConfigRaw
	I0311 04:10:22.316193   40490 main.go:141] libmachine: Creating machine...
	I0311 04:10:22.316205   40490 main.go:141] libmachine: (kubenet-040000) Calling .Create
	I0311 04:10:22.316327   40490 main.go:141] libmachine: (kubenet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:22.316496   40490 main.go:141] libmachine: (kubenet-040000) DBG | I0311 04:10:22.316304   40498 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:22.316545   40490 main.go:141] libmachine: (kubenet-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:10:22.492442   40490 main.go:141] libmachine: (kubenet-040000) DBG | I0311 04:10:22.492325   40498 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubenet-040000/id_rsa...
	I0311 04:10:22.644452   40490 main.go:141] libmachine: (kubenet-040000) DBG | I0311 04:10:22.644371   40498 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubenet-040000/kubenet-040000.rawdisk...
	I0311 04:10:22.644463   40490 main.go:141] libmachine: (kubenet-040000) DBG | Writing magic tar header
	I0311 04:10:22.644479   40490 main.go:141] libmachine: (kubenet-040000) DBG | Writing SSH key tar header
	I0311 04:10:22.644973   40490 main.go:141] libmachine: (kubenet-040000) DBG | I0311 04:10:22.644905   40498 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubenet-040000 ...
	I0311 04:10:23.080279   40490 main.go:141] libmachine: (kubenet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:23.080303   40490 main.go:141] libmachine: (kubenet-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubenet-040000/hyperkit.pid
	I0311 04:10:23.080327   40490 main.go:141] libmachine: (kubenet-040000) DBG | Using UUID c6c04d47-0c9a-4f23-ad68-a9ed5d7efb6f
	I0311 04:10:23.098124   40490 main.go:141] libmachine: (kubenet-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:23.098227   40490 client.go:171] duration metric: took 791.603875ms to LocalClient.Create
	I0311 04:10:25.098999   40490 start.go:128] duration metric: took 2.825656398s to createHost
	I0311 04:10:25.099013   40490 start.go:83] releasing machines lock for "kubenet-040000", held for 2.825804763s
	W0311 04:10:25.099028   40490 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:10:25.099331   40490 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:25.099357   40490 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:25.107312   40490 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63780
	I0311 04:10:25.107688   40490 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:25.108061   40490 main.go:141] libmachine: Using API Version  1
	I0311 04:10:25.108075   40490 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:25.108275   40490 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:25.108605   40490 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:25.108629   40490 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:25.116465   40490 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63782
	I0311 04:10:25.116825   40490 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:25.117172   40490 main.go:141] libmachine: Using API Version  1
	I0311 04:10:25.117183   40490 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:25.117373   40490 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:25.117483   40490 main.go:141] libmachine: (kubenet-040000) Calling .GetState
	I0311 04:10:25.117564   40490 main.go:141] libmachine: (kubenet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:25.117578   40490 main.go:141] libmachine: (kubenet-040000) DBG | hyperkit pid from json: 0
	I0311 04:10:25.117590   40490 main.go:141] libmachine: (kubenet-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubenet-040000/hyperkit.json: no such file or directory
	I0311 04:10:25.117633   40490 main.go:141] libmachine: (kubenet-040000) Calling .DriverName
	I0311 04:10:25.161174   40490 out.go:177] * Deleting "kubenet-040000" in hyperkit ...
	I0311 04:10:25.184190   40490 main.go:141] libmachine: (kubenet-040000) Calling .Remove
	I0311 04:10:25.184515   40490 main.go:141] libmachine: (kubenet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:25.184538   40490 main.go:141] libmachine: (kubenet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:25.184557   40490 main.go:141] libmachine: (kubenet-040000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubenet-040000/hyperkit.json: no such file or directory
	I0311 04:10:25.184579   40490 main.go:141] libmachine: (kubenet-040000) DBG | hyperkit pid from json: 0
	W0311 04:10:25.203573   40490 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:25.203587   40490 start.go:728] Will try again in 5 seconds ...
	I0311 04:10:30.203775   40490 start.go:360] acquireMachinesLock for kubenet-040000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:30.203848   40490 start.go:364] duration metric: took 47.284µs to acquireMachinesLock for "kubenet-040000"
	I0311 04:10:30.203882   40490 start.go:93] Provisioning new machine with config: &{Name:kubenet-040000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kubenet-040000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:10:30.203950   40490 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:10:30.225331   40490 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0311 04:10:30.225496   40490 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:30.225547   40490 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:30.234520   40490 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63790
	I0311 04:10:30.234934   40490 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:30.235289   40490 main.go:141] libmachine: Using API Version  1
	I0311 04:10:30.235310   40490 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:30.235544   40490 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:30.235667   40490 main.go:141] libmachine: (kubenet-040000) Calling .GetMachineName
	I0311 04:10:30.235780   40490 main.go:141] libmachine: (kubenet-040000) Calling .DriverName
	I0311 04:10:30.235929   40490 start.go:159] libmachine.API.Create for "kubenet-040000" (driver="hyperkit")
	I0311 04:10:30.235955   40490 client.go:168] LocalClient.Create starting
	I0311 04:10:30.236002   40490 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:10:30.236070   40490 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:30.236084   40490 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:30.236138   40490 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:10:30.236165   40490 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:30.236178   40490 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:30.236200   40490 main.go:141] libmachine: Running pre-create checks...
	I0311 04:10:30.236205   40490 main.go:141] libmachine: (kubenet-040000) Calling .PreCreateCheck
	I0311 04:10:30.236297   40490 main.go:141] libmachine: (kubenet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:30.236331   40490 main.go:141] libmachine: (kubenet-040000) Calling .GetConfigRaw
	I0311 04:10:30.268305   40490 main.go:141] libmachine: Creating machine...
	I0311 04:10:30.268328   40490 main.go:141] libmachine: (kubenet-040000) Calling .Create
	I0311 04:10:30.268574   40490 main.go:141] libmachine: (kubenet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:30.268813   40490 main.go:141] libmachine: (kubenet-040000) DBG | I0311 04:10:30.268536   40524 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:30.268949   40490 main.go:141] libmachine: (kubenet-040000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:10:30.659241   40490 main.go:141] libmachine: (kubenet-040000) DBG | I0311 04:10:30.659173   40524 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubenet-040000/id_rsa...
	I0311 04:10:30.771656   40490 main.go:141] libmachine: (kubenet-040000) DBG | I0311 04:10:30.771520   40524 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubenet-040000/kubenet-040000.rawdisk...
	I0311 04:10:30.771678   40490 main.go:141] libmachine: (kubenet-040000) DBG | Writing magic tar header
	I0311 04:10:30.771690   40490 main.go:141] libmachine: (kubenet-040000) DBG | Writing SSH key tar header
	I0311 04:10:30.772240   40490 main.go:141] libmachine: (kubenet-040000) DBG | I0311 04:10:30.772155   40524 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubenet-040000 ...
	I0311 04:10:31.267016   40490 main.go:141] libmachine: (kubenet-040000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:31.267042   40490 main.go:141] libmachine: (kubenet-040000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/kubenet-040000/hyperkit.pid
	I0311 04:10:31.267077   40490 main.go:141] libmachine: (kubenet-040000) DBG | Using UUID 76f8f5cd-2726-43ba-a146-1236c7ec49d4
	I0311 04:10:31.286083   40490 main.go:141] libmachine: (kubenet-040000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:31.286175   40490 client.go:171] duration metric: took 1.05019385s to LocalClient.Create
	I0311 04:10:33.286501   40490 start.go:128] duration metric: took 3.082488433s to createHost
	I0311 04:10:33.286560   40490 start.go:83] releasing machines lock for "kubenet-040000", held for 3.082641837s
	W0311 04:10:33.286678   40490 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubenet-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubenet-040000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:33.332829   40490 out.go:177] 
	W0311 04:10:33.356129   40490 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:10:33.356190   40490 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:10:33.356220   40490 out.go:239] * Related issues:
	* Related issues:
	W0311 04:10:33.356242   40490 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:10:33.356290   40490 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:10:33.397846   40490 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/kubenet/Start (11.69s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (11.93s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p old-k8s-version-910000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-910000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0: exit status 60 (11.858619188s)

                                                
                                                
-- stdout --
	* [old-k8s-version-910000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "old-k8s-version-910000" primary control-plane node in "old-k8s-version-910000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "old-k8s-version-910000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:10:36.251393   40696 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:10:36.272846   40696 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:36.272873   40696 out.go:304] Setting ErrFile to fd 2...
	I0311 04:10:36.272880   40696 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:36.273175   40696 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:10:36.275298   40696 out.go:298] Setting JSON to false
	I0311 04:10:36.299754   40696 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11406,"bootTime":1710144030,"procs":515,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:10:36.299851   40696 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:10:36.320960   40696 out.go:177] * [old-k8s-version-910000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:10:36.383964   40696 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:10:36.362874   40696 notify.go:220] Checking for updates...
	I0311 04:10:36.468974   40696 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:10:36.489984   40696 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:10:36.510888   40696 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:10:36.531858   40696 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:36.552678   40696 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:10:36.574403   40696 config.go:182] Loaded profile config "kubenet-040000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:10:36.574505   40696 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:10:36.574625   40696 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:10:36.607998   40696 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:10:36.650048   40696 start.go:297] selected driver: hyperkit
	I0311 04:10:36.650074   40696 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:10:36.650096   40696 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:10:36.654303   40696 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:36.654407   40696 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:10:36.662196   40696 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:10:36.666075   40696 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:36.666098   40696 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:10:36.666136   40696 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:10:36.666356   40696 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:10:36.666413   40696 cni.go:84] Creating CNI manager for ""
	I0311 04:10:36.666427   40696 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0311 04:10:36.666490   40696 start.go:340] cluster config:
	{Name:old-k8s-version-910000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-910000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loc
al ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSH
AuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:10:36.666578   40696 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:36.735066   40696 out.go:177] * Starting "old-k8s-version-910000" primary control-plane node in "old-k8s-version-910000" cluster
	I0311 04:10:36.776854   40696 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0311 04:10:36.776889   40696 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0311 04:10:36.776904   40696 cache.go:56] Caching tarball of preloaded images
	I0311 04:10:36.777013   40696 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:10:36.777022   40696 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0311 04:10:36.777094   40696 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/old-k8s-version-910000/config.json ...
	I0311 04:10:36.777111   40696 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/old-k8s-version-910000/config.json: {Name:mk2bd6eee32a4e1b45112915c122a640c3eeabaf Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:10:36.777457   40696 start.go:360] acquireMachinesLock for old-k8s-version-910000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:36.777514   40696 start.go:364] duration metric: took 44.707µs to acquireMachinesLock for "old-k8s-version-910000"
	I0311 04:10:36.777537   40696 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-910000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-910000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:10:36.777582   40696 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:10:36.819671   40696 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:10:36.819805   40696 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:36.819843   40696 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:36.828239   40696 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63888
	I0311 04:10:36.828615   40696 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:36.829034   40696 main.go:141] libmachine: Using API Version  1
	I0311 04:10:36.829045   40696 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:36.829256   40696 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:36.829358   40696 main.go:141] libmachine: (old-k8s-version-910000) Calling .GetMachineName
	I0311 04:10:36.829446   40696 main.go:141] libmachine: (old-k8s-version-910000) Calling .DriverName
	I0311 04:10:36.829548   40696 start.go:159] libmachine.API.Create for "old-k8s-version-910000" (driver="hyperkit")
	I0311 04:10:36.829570   40696 client.go:168] LocalClient.Create starting
	I0311 04:10:36.829601   40696 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:10:36.829649   40696 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:36.829671   40696 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:36.829728   40696 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:10:36.829765   40696 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:36.829773   40696 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:36.829797   40696 main.go:141] libmachine: Running pre-create checks...
	I0311 04:10:36.829805   40696 main.go:141] libmachine: (old-k8s-version-910000) Calling .PreCreateCheck
	I0311 04:10:36.829874   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:36.830066   40696 main.go:141] libmachine: (old-k8s-version-910000) Calling .GetConfigRaw
	I0311 04:10:36.830626   40696 main.go:141] libmachine: Creating machine...
	I0311 04:10:36.830634   40696 main.go:141] libmachine: (old-k8s-version-910000) Calling .Create
	I0311 04:10:36.830705   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:36.830828   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | I0311 04:10:36.830696   40713 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:36.830892   40696 main.go:141] libmachine: (old-k8s-version-910000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:10:37.209704   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | I0311 04:10:37.209616   40713 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000/id_rsa...
	I0311 04:10:37.311969   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | I0311 04:10:37.311861   40713 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000/old-k8s-version-910000.rawdisk...
	I0311 04:10:37.311995   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | Writing magic tar header
	I0311 04:10:37.312026   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | Writing SSH key tar header
	I0311 04:10:37.333509   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | I0311 04:10:37.333376   40713 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000 ...
	I0311 04:10:37.738125   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:37.738143   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000/hyperkit.pid
	I0311 04:10:37.738236   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | Using UUID 2562319b-2c31-4e81-859e-163732b442df
	I0311 04:10:37.900237   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:37.900318   40696 client.go:171] duration metric: took 1.070719846s to LocalClient.Create
	I0311 04:10:39.900623   40696 start.go:128] duration metric: took 3.122981076s to createHost
	I0311 04:10:39.900645   40696 start.go:83] releasing machines lock for "old-k8s-version-910000", held for 3.123077816s
	W0311 04:10:39.900673   40696 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:10:39.901192   40696 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:39.901239   40696 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:39.909992   40696 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63930
	I0311 04:10:39.910360   40696 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:39.910713   40696 main.go:141] libmachine: Using API Version  1
	I0311 04:10:39.910722   40696 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:39.910919   40696 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:39.911296   40696 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:39.911324   40696 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:39.919217   40696 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63932
	I0311 04:10:39.919580   40696 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:39.919978   40696 main.go:141] libmachine: Using API Version  1
	I0311 04:10:39.919998   40696 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:39.920193   40696 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:39.920291   40696 main.go:141] libmachine: (old-k8s-version-910000) Calling .GetState
	I0311 04:10:39.920373   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:39.920411   40696 main.go:141] libmachine: (old-k8s-version-910000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000/hyperkit.json: no such file or directory
	I0311 04:10:39.920416   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | hyperkit pid from json: 0
	I0311 04:10:39.920469   40696 main.go:141] libmachine: (old-k8s-version-910000) Calling .DriverName
	I0311 04:10:40.002807   40696 out.go:177] * Deleting "old-k8s-version-910000" in hyperkit ...
	I0311 04:10:40.023720   40696 main.go:141] libmachine: (old-k8s-version-910000) Calling .Remove
	I0311 04:10:40.023929   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:40.023945   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:40.023957   40696 main.go:141] libmachine: (old-k8s-version-910000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000/hyperkit.json: no such file or directory
	I0311 04:10:40.023967   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | hyperkit pid from json: 0
	W0311 04:10:40.042800   40696 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:40.042812   40696 start.go:728] Will try again in 5 seconds ...
	I0311 04:10:45.043117   40696 start.go:360] acquireMachinesLock for old-k8s-version-910000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:45.043342   40696 start.go:364] duration metric: took 184.365µs to acquireMachinesLock for "old-k8s-version-910000"
	I0311 04:10:45.043404   40696 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-910000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-910000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:10:45.043526   40696 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:10:45.072006   40696 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:10:45.072156   40696 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:45.072207   40696 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:45.082240   40696 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63961
	I0311 04:10:45.082767   40696 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:45.083202   40696 main.go:141] libmachine: Using API Version  1
	I0311 04:10:45.083211   40696 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:45.083442   40696 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:45.083614   40696 main.go:141] libmachine: (old-k8s-version-910000) Calling .GetMachineName
	I0311 04:10:45.083746   40696 main.go:141] libmachine: (old-k8s-version-910000) Calling .DriverName
	I0311 04:10:45.083859   40696 start.go:159] libmachine.API.Create for "old-k8s-version-910000" (driver="hyperkit")
	I0311 04:10:45.083908   40696 client.go:168] LocalClient.Create starting
	I0311 04:10:45.083934   40696 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:10:45.083980   40696 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:45.083998   40696 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:45.084040   40696 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:10:45.084077   40696 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:45.084088   40696 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:45.084106   40696 main.go:141] libmachine: Running pre-create checks...
	I0311 04:10:45.084111   40696 main.go:141] libmachine: (old-k8s-version-910000) Calling .PreCreateCheck
	I0311 04:10:45.084205   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:45.084232   40696 main.go:141] libmachine: (old-k8s-version-910000) Calling .GetConfigRaw
	I0311 04:10:45.092626   40696 main.go:141] libmachine: Creating machine...
	I0311 04:10:45.092641   40696 main.go:141] libmachine: (old-k8s-version-910000) Calling .Create
	I0311 04:10:45.092796   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:45.093011   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | I0311 04:10:45.092766   40826 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:45.093102   40696 main.go:141] libmachine: (old-k8s-version-910000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:10:45.276588   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | I0311 04:10:45.276493   40826 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000/id_rsa...
	I0311 04:10:45.487661   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | I0311 04:10:45.487608   40826 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000/old-k8s-version-910000.rawdisk...
	I0311 04:10:45.487677   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | Writing magic tar header
	I0311 04:10:45.487709   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | Writing SSH key tar header
	I0311 04:10:45.488843   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | I0311 04:10:45.488792   40826 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000 ...
	I0311 04:10:45.850510   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:45.850531   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000/hyperkit.pid
	I0311 04:10:45.850582   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | Using UUID d6dce8fe-08f2-4a45-9050-f4deb7afe4c5
	I0311 04:10:45.870220   40696 main.go:141] libmachine: (old-k8s-version-910000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:45.870337   40696 client.go:171] duration metric: took 786.411975ms to LocalClient.Create
	I0311 04:10:47.872108   40696 start.go:128] duration metric: took 2.82851868s to createHost
	I0311 04:10:47.872136   40696 start.go:83] releasing machines lock for "old-k8s-version-910000", held for 2.828731063s
	W0311 04:10:47.872298   40696 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-910000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-910000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:47.916839   40696 out.go:177] 
	W0311 04:10:47.939077   40696 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:10:47.939161   40696 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:10:47.939174   40696 out.go:239] * Related issues:
	* Related issues:
	W0311 04:10:47.939201   40696 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:10:47.939230   40696 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:10:47.960682   40696 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-910000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000: exit status 7 (74.405354ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-910000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (11.93s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (11.49s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p no-preload-027000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p no-preload-027000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (11.412147091s)

                                                
                                                
-- stdout --
	* [no-preload-027000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "no-preload-027000" primary control-plane node in "no-preload-027000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "no-preload-027000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:10:40.419803   40786 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:10:40.419971   40786 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:40.419976   40786 out.go:304] Setting ErrFile to fd 2...
	I0311 04:10:40.419980   40786 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:40.420164   40786 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:10:40.421685   40786 out.go:298] Setting JSON to false
	I0311 04:10:40.444064   40786 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11410,"bootTime":1710144030,"procs":529,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:10:40.444191   40786 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:10:40.467940   40786 out.go:177] * [no-preload-027000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:10:40.512035   40786 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:10:40.512093   40786 notify.go:220] Checking for updates...
	I0311 04:10:40.556670   40786 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:10:40.578044   40786 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:10:40.599996   40786 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:10:40.621926   40786 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:40.642967   40786 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:10:40.666701   40786 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:10:40.666897   40786 config.go:182] Loaded profile config "old-k8s-version-910000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0311 04:10:40.667103   40786 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:10:40.696778   40786 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:10:40.718049   40786 start.go:297] selected driver: hyperkit
	I0311 04:10:40.718081   40786 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:10:40.718103   40786 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:10:40.722845   40786 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:40.722998   40786 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:10:40.730738   40786 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:10:40.734646   40786 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:40.734679   40786 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:10:40.734715   40786 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:10:40.734929   40786 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:10:40.734990   40786 cni.go:84] Creating CNI manager for ""
	I0311 04:10:40.735005   40786 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:10:40.735023   40786 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0311 04:10:40.735096   40786 start.go:340] cluster config:
	{Name:no-preload-027000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-027000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:
SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:10:40.735194   40786 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:40.777947   40786 out.go:177] * Starting "no-preload-027000" primary control-plane node in "no-preload-027000" cluster
	I0311 04:10:40.800000   40786 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0311 04:10:40.800191   40786 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/no-preload-027000/config.json ...
	I0311 04:10:40.800251   40786 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/no-preload-027000/config.json: {Name:mk8334e5db25a4c124650b394976f8048fca4d11 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:10:40.800377   40786 cache.go:107] acquiring lock: {Name:mk575988cb62127dcd9267ea1f2f82284485bac4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:40.800422   40786 cache.go:107] acquiring lock: {Name:mk7aeff5c0da58c9b5a6b185728dc00caefa60fe Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:40.800456   40786 cache.go:107] acquiring lock: {Name:mkaf4adebbb9674ffd1ee50d9f330b6245666099 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:40.800378   40786 cache.go:107] acquiring lock: {Name:mk845b56ed86c6e0c2c9fa7cea61456710fe6197 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:40.800531   40786 cache.go:107] acquiring lock: {Name:mk389813f522f561433fa823a321432e45a33bdc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:40.800618   40786 cache.go:115] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0311 04:10:40.800656   40786 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 291.14µs
	I0311 04:10:40.800678   40786 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0311 04:10:40.800679   40786 cache.go:107] acquiring lock: {Name:mkd3feb7e398d63afedbf04a49fc890d9807563d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:40.800734   40786 cache.go:107] acquiring lock: {Name:mk49dd38af6415614587a4fc967f40c1ade7811f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:40.800861   40786 cache.go:107] acquiring lock: {Name:mk3bcaf5cca9f3a1e7d9c4ec2f598b6830094aa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:40.800885   40786 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.10-0
	I0311 04:10:40.801049   40786 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
	I0311 04:10:40.801187   40786 start.go:360] acquireMachinesLock for no-preload-027000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:40.801305   40786 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.11.1
	I0311 04:10:40.801355   40786 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
	I0311 04:10:40.801363   40786 start.go:364] duration metric: took 147.297µs to acquireMachinesLock for "no-preload-027000"
	I0311 04:10:40.801420   40786 image.go:134] retrieving image: registry.k8s.io/pause:3.9
	I0311 04:10:40.801427   40786 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
	I0311 04:10:40.801513   40786 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
	I0311 04:10:40.801429   40786 start.go:93] Provisioning new machine with config: &{Name:no-preload-027000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-027000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptio
ns:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:10:40.801636   40786 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:10:40.823813   40786 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:10:40.824070   40786 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:40.824140   40786 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:40.827487   40786 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
	I0311 04:10:40.827498   40786 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.11.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.11.1
	I0311 04:10:40.827488   40786 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
	I0311 04:10:40.827492   40786 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.10-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.10-0
	I0311 04:10:40.827491   40786 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
	I0311 04:10:40.827487   40786 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
	I0311 04:10:40.827626   40786 image.go:177] daemon lookup for registry.k8s.io/pause:3.9: Error response from daemon: No such image: registry.k8s.io/pause:3.9
	I0311 04:10:40.834085   40786 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63942
	I0311 04:10:40.834480   40786 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:40.834929   40786 main.go:141] libmachine: Using API Version  1
	I0311 04:10:40.834939   40786 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:40.835176   40786 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:40.835337   40786 main.go:141] libmachine: (no-preload-027000) Calling .GetMachineName
	I0311 04:10:40.835433   40786 main.go:141] libmachine: (no-preload-027000) Calling .DriverName
	I0311 04:10:40.835545   40786 start.go:159] libmachine.API.Create for "no-preload-027000" (driver="hyperkit")
	I0311 04:10:40.835578   40786 client.go:168] LocalClient.Create starting
	I0311 04:10:40.835610   40786 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:10:40.835658   40786 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:40.835674   40786 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:40.835729   40786 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:10:40.835764   40786 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:40.835775   40786 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:40.835788   40786 main.go:141] libmachine: Running pre-create checks...
	I0311 04:10:40.835800   40786 main.go:141] libmachine: (no-preload-027000) Calling .PreCreateCheck
	I0311 04:10:40.835885   40786 main.go:141] libmachine: (no-preload-027000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:40.836053   40786 main.go:141] libmachine: (no-preload-027000) Calling .GetConfigRaw
	I0311 04:10:40.836500   40786 main.go:141] libmachine: Creating machine...
	I0311 04:10:40.836507   40786 main.go:141] libmachine: (no-preload-027000) Calling .Create
	I0311 04:10:40.836585   40786 main.go:141] libmachine: (no-preload-027000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:40.836707   40786 main.go:141] libmachine: (no-preload-027000) DBG | I0311 04:10:40.836577   40794 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:40.836763   40786 main.go:141] libmachine: (no-preload-027000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:10:41.028382   40786 main.go:141] libmachine: (no-preload-027000) DBG | I0311 04:10:41.028264   40794 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000/id_rsa...
	I0311 04:10:41.334625   40786 main.go:141] libmachine: (no-preload-027000) DBG | I0311 04:10:41.334561   40794 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000/no-preload-027000.rawdisk...
	I0311 04:10:41.334674   40786 main.go:141] libmachine: (no-preload-027000) DBG | Writing magic tar header
	I0311 04:10:41.334684   40786 main.go:141] libmachine: (no-preload-027000) DBG | Writing SSH key tar header
	I0311 04:10:41.335213   40786 main.go:141] libmachine: (no-preload-027000) DBG | I0311 04:10:41.335154   40794 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000 ...
	I0311 04:10:41.704261   40786 main.go:141] libmachine: (no-preload-027000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:41.704278   40786 main.go:141] libmachine: (no-preload-027000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000/hyperkit.pid
	I0311 04:10:41.704289   40786 main.go:141] libmachine: (no-preload-027000) DBG | Using UUID f856f47d-ae9f-455b-8ae6-1c13427d4668
	I0311 04:10:41.726141   40786 main.go:141] libmachine: (no-preload-027000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:41.726275   40786 client.go:171] duration metric: took 890.674161ms to LocalClient.Create
	I0311 04:10:42.715079   40786 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2
	I0311 04:10:42.840303   40786 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1
	I0311 04:10:42.848457   40786 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2
	I0311 04:10:42.851020   40786 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0
	I0311 04:10:42.853467   40786 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9
	I0311 04:10:42.856432   40786 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2
	I0311 04:10:42.869960   40786 cache.go:162] opening:  /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2
	I0311 04:10:42.952456   40786 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 exists
	I0311 04:10:42.952472   40786 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9" took 2.151856864s
	I0311 04:10:42.952487   40786 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 succeeded
	I0311 04:10:43.571102   40786 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 exists
	I0311 04:10:43.571127   40786 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2" took 2.770728337s
	I0311 04:10:43.571141   40786 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 succeeded
	I0311 04:10:43.694051   40786 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 exists
	I0311 04:10:43.694067   40786 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1" took 2.893558284s
	I0311 04:10:43.694075   40786 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
	I0311 04:10:43.727358   40786 start.go:128] duration metric: took 2.925637572s to createHost
	I0311 04:10:43.727385   40786 start.go:83] releasing machines lock for "no-preload-027000", held for 2.925963616s
	W0311 04:10:43.727419   40786 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:10:43.727950   40786 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:43.727982   40786 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:43.740556   40786 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63957
	I0311 04:10:43.740917   40786 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:43.741272   40786 main.go:141] libmachine: Using API Version  1
	I0311 04:10:43.741286   40786 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:43.741484   40786 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:43.741941   40786 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:43.741977   40786 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:43.750995   40786 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63959
	I0311 04:10:43.751439   40786 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:43.751880   40786 main.go:141] libmachine: Using API Version  1
	I0311 04:10:43.751919   40786 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:43.752111   40786 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:43.752275   40786 main.go:141] libmachine: (no-preload-027000) Calling .GetState
	I0311 04:10:43.752368   40786 main.go:141] libmachine: (no-preload-027000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:43.752468   40786 main.go:141] libmachine: (no-preload-027000) DBG | hyperkit pid from json: 0
	I0311 04:10:43.752490   40786 main.go:141] libmachine: (no-preload-027000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000/hyperkit.json: no such file or directory
	I0311 04:10:43.752504   40786 main.go:141] libmachine: (no-preload-027000) Calling .DriverName
	I0311 04:10:43.798971   40786 out.go:177] * Deleting "no-preload-027000" in hyperkit ...
	I0311 04:10:43.819987   40786 main.go:141] libmachine: (no-preload-027000) Calling .Remove
	I0311 04:10:43.820240   40786 main.go:141] libmachine: (no-preload-027000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:43.820257   40786 main.go:141] libmachine: (no-preload-027000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:43.820275   40786 main.go:141] libmachine: (no-preload-027000) DBG | hyperkit pid from json: 0
	I0311 04:10:43.820289   40786 main.go:141] libmachine: (no-preload-027000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000/hyperkit.json: no such file or directory
	W0311 04:10:43.840687   40786 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:43.840723   40786 start.go:728] Will try again in 5 seconds ...
	I0311 04:10:43.875147   40786 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 exists
	I0311 04:10:43.875171   40786 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2" took 3.074399906s
	I0311 04:10:43.875183   40786 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 succeeded
	I0311 04:10:44.157246   40786 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 exists
	I0311 04:10:44.157262   40786 cache.go:96] cache image "registry.k8s.io/etcd:3.5.10-0" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0" took 3.356837294s
	I0311 04:10:44.157271   40786 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.10-0 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 succeeded
	I0311 04:10:44.309876   40786 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 exists
	I0311 04:10:44.309895   40786 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2" took 3.509217204s
	I0311 04:10:44.309903   40786 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 succeeded
	I0311 04:10:44.355304   40786 cache.go:157] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 exists
	I0311 04:10:44.355320   40786 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2" took 3.554815798s
	I0311 04:10:44.355333   40786 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 succeeded
	I0311 04:10:44.355350   40786 cache.go:87] Successfully saved all images to host disk.
	I0311 04:10:48.842965   40786 start.go:360] acquireMachinesLock for no-preload-027000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:48.843133   40786 start.go:364] duration metric: took 104.812µs to acquireMachinesLock for "no-preload-027000"
	I0311 04:10:48.843169   40786 start.go:93] Provisioning new machine with config: &{Name:no-preload-027000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-027000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptio
ns:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:10:48.843266   40786 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:10:48.887028   40786 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:10:48.887135   40786 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:48.887157   40786 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:48.895922   40786 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63984
	I0311 04:10:48.896334   40786 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:48.896674   40786 main.go:141] libmachine: Using API Version  1
	I0311 04:10:48.896684   40786 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:48.896885   40786 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:48.896984   40786 main.go:141] libmachine: (no-preload-027000) Calling .GetMachineName
	I0311 04:10:48.897072   40786 main.go:141] libmachine: (no-preload-027000) Calling .DriverName
	I0311 04:10:48.897181   40786 start.go:159] libmachine.API.Create for "no-preload-027000" (driver="hyperkit")
	I0311 04:10:48.897212   40786 client.go:168] LocalClient.Create starting
	I0311 04:10:48.897239   40786 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:10:48.897276   40786 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:48.897285   40786 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:48.897330   40786 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:10:48.897355   40786 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:48.897368   40786 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:48.897388   40786 main.go:141] libmachine: Running pre-create checks...
	I0311 04:10:48.897394   40786 main.go:141] libmachine: (no-preload-027000) Calling .PreCreateCheck
	I0311 04:10:48.897474   40786 main.go:141] libmachine: (no-preload-027000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:48.897518   40786 main.go:141] libmachine: (no-preload-027000) Calling .GetConfigRaw
	I0311 04:10:48.897970   40786 main.go:141] libmachine: Creating machine...
	I0311 04:10:48.897978   40786 main.go:141] libmachine: (no-preload-027000) Calling .Create
	I0311 04:10:48.898053   40786 main.go:141] libmachine: (no-preload-027000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:48.898166   40786 main.go:141] libmachine: (no-preload-027000) DBG | I0311 04:10:48.898046   40852 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:48.898217   40786 main.go:141] libmachine: (no-preload-027000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:10:49.089644   40786 main.go:141] libmachine: (no-preload-027000) DBG | I0311 04:10:49.089564   40852 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000/id_rsa...
	I0311 04:10:49.145073   40786 main.go:141] libmachine: (no-preload-027000) DBG | I0311 04:10:49.144980   40852 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000/no-preload-027000.rawdisk...
	I0311 04:10:49.145085   40786 main.go:141] libmachine: (no-preload-027000) DBG | Writing magic tar header
	I0311 04:10:49.145095   40786 main.go:141] libmachine: (no-preload-027000) DBG | Writing SSH key tar header
	I0311 04:10:49.145882   40786 main.go:141] libmachine: (no-preload-027000) DBG | I0311 04:10:49.145854   40852 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000 ...
	I0311 04:10:49.516363   40786 main.go:141] libmachine: (no-preload-027000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:49.516387   40786 main.go:141] libmachine: (no-preload-027000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000/hyperkit.pid
	I0311 04:10:49.516456   40786 main.go:141] libmachine: (no-preload-027000) DBG | Using UUID 938f649f-22c3-41e7-943e-2ad20153933a
	I0311 04:10:49.535008   40786 main.go:141] libmachine: (no-preload-027000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:49.535135   40786 client.go:171] duration metric: took 637.906186ms to LocalClient.Create
	I0311 04:10:51.537383   40786 start.go:128] duration metric: took 2.694042893s to createHost
	I0311 04:10:51.537414   40786 start.go:83] releasing machines lock for "no-preload-027000", held for 2.694227131s
	W0311 04:10:51.537574   40786 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p no-preload-027000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p no-preload-027000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:51.580300   40786 out.go:177] 
	W0311 04:10:51.643666   40786 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:10:51.643753   40786 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:10:51.643769   40786 out.go:239] * Related issues:
	* Related issues:
	W0311 04:10:51.643800   40786 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:10:51.643825   40786 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:10:51.687332   40786 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p no-preload-027000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000: exit status 7 (73.351673ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-027000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/FirstStart (11.49s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-910000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context old-k8s-version-910000 create -f testdata/busybox.yaml: exit status 1 (37.504001ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-910000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context old-k8s-version-910000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000: exit status 7 (74.362253ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-910000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000: exit status 7 (75.319414ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-910000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/DeployApp (0.19s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.33s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p old-k8s-version-910000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-910000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context old-k8s-version-910000 describe deploy/metrics-server -n kube-system: exit status 1 (37.597695ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-910000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context old-k8s-version-910000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000: exit status 7 (74.227183ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-910000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.33s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (6.25s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p old-k8s-version-910000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-910000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0: exit status 60 (6.176005169s)

                                                
                                                
-- stdout --
	* [old-k8s-version-910000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
	* Using the hyperkit driver based on existing profile
	* Starting "old-k8s-version-910000" primary control-plane node in "old-k8s-version-910000" cluster
	* Restarting existing hyperkit VM for "old-k8s-version-910000" ...
	* Restarting existing hyperkit VM for "old-k8s-version-910000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:10:51.007227   40870 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:10:51.007482   40870 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:51.007488   40870 out.go:304] Setting ErrFile to fd 2...
	I0311 04:10:51.007492   40870 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:51.007672   40870 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:10:51.009150   40870 out.go:298] Setting JSON to false
	I0311 04:10:51.031563   40870 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11421,"bootTime":1710144030,"procs":473,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:10:51.031651   40870 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:10:51.053700   40870 out.go:177] * [old-k8s-version-910000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:10:51.096208   40870 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:10:51.096263   40870 notify.go:220] Checking for updates...
	I0311 04:10:51.140472   40870 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:10:51.162209   40870 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:10:51.183429   40870 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:10:51.227232   40870 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:51.269294   40870 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:10:51.290977   40870 config.go:182] Loaded profile config "old-k8s-version-910000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0311 04:10:51.291605   40870 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:51.291679   40870 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:51.300472   40870 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64000
	I0311 04:10:51.300864   40870 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:51.301343   40870 main.go:141] libmachine: Using API Version  1
	I0311 04:10:51.301352   40870 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:51.301606   40870 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:51.301730   40870 main.go:141] libmachine: (old-k8s-version-910000) Calling .DriverName
	I0311 04:10:51.323325   40870 out.go:177] * Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
	I0311 04:10:51.344540   40870 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:10:51.345064   40870 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:51.345114   40870 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:51.354319   40870 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64002
	I0311 04:10:51.354681   40870 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:51.355048   40870 main.go:141] libmachine: Using API Version  1
	I0311 04:10:51.355066   40870 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:51.355329   40870 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:51.355458   40870 main.go:141] libmachine: (old-k8s-version-910000) Calling .DriverName
	I0311 04:10:51.384113   40870 out.go:177] * Using the hyperkit driver based on existing profile
	I0311 04:10:51.426303   40870 start.go:297] selected driver: hyperkit
	I0311 04:10:51.426335   40870 start.go:901] validating driver "hyperkit" against &{Name:old-k8s-version-910000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-910000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 Cert
Expiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:10:51.426540   40870 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:10:51.430789   40870 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:51.430885   40870 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:10:51.438601   40870 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:10:51.442358   40870 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:51.442379   40870 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:10:51.442515   40870 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:10:51.442577   40870 cni.go:84] Creating CNI manager for ""
	I0311 04:10:51.442589   40870 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0311 04:10:51.442649   40870 start.go:340] cluster config:
	{Name:old-k8s-version-910000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-910000 Namespace:defa
ult APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion
:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:10:51.442748   40870 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:51.485343   40870 out.go:177] * Starting "old-k8s-version-910000" primary control-plane node in "old-k8s-version-910000" cluster
	I0311 04:10:51.506368   40870 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0311 04:10:51.506440   40870 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0311 04:10:51.506486   40870 cache.go:56] Caching tarball of preloaded images
	I0311 04:10:51.506671   40870 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:10:51.506690   40870 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0311 04:10:51.506829   40870 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/old-k8s-version-910000/config.json ...
	I0311 04:10:51.507793   40870 start.go:360] acquireMachinesLock for old-k8s-version-910000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:51.537536   40870 start.go:364] duration metric: took 29.693955ms to acquireMachinesLock for "old-k8s-version-910000"
	I0311 04:10:51.537611   40870 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:10:51.537632   40870 fix.go:54] fixHost starting: 
	I0311 04:10:51.538156   40870 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:51.538212   40870 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:51.547561   40870 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64004
	I0311 04:10:51.547965   40870 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:51.548314   40870 main.go:141] libmachine: Using API Version  1
	I0311 04:10:51.548323   40870 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:51.548537   40870 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:51.548676   40870 main.go:141] libmachine: (old-k8s-version-910000) Calling .DriverName
	I0311 04:10:51.548772   40870 main.go:141] libmachine: (old-k8s-version-910000) Calling .GetState
	I0311 04:10:51.548852   40870 main.go:141] libmachine: (old-k8s-version-910000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:51.548872   40870 main.go:141] libmachine: (old-k8s-version-910000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000/hyperkit.json: no such file or directory
	I0311 04:10:51.548879   40870 main.go:141] libmachine: (old-k8s-version-910000) DBG | hyperkit pid from json: 0
	I0311 04:10:51.548928   40870 fix.go:112] recreateIfNeeded on old-k8s-version-910000: state=Stopped err=<nil>
	I0311 04:10:51.548963   40870 main.go:141] libmachine: (old-k8s-version-910000) Calling .DriverName
	W0311 04:10:51.549054   40870 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:10:51.622320   40870 out.go:177] * Restarting existing hyperkit VM for "old-k8s-version-910000" ...
	I0311 04:10:51.665342   40870 main.go:141] libmachine: (old-k8s-version-910000) Calling .Start
	I0311 04:10:51.665638   40870 main.go:141] libmachine: (old-k8s-version-910000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:51.665719   40870 main.go:141] libmachine: (old-k8s-version-910000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000/hyperkit.pid
	I0311 04:10:51.665747   40870 main.go:141] libmachine: (old-k8s-version-910000) DBG | Using UUID d6dce8fe-08f2-4a45-9050-f4deb7afe4c5
	I0311 04:10:51.667852   40870 main.go:141] libmachine: (old-k8s-version-910000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:51.667928   40870 fix.go:56] duration metric: took 130.29859ms for fixHost
	I0311 04:10:51.667940   40870 start.go:83] releasing machines lock for "old-k8s-version-910000", held for 130.38143ms
	W0311 04:10:51.667960   40870 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0311 04:10:51.668030   40870 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:51.668039   40870 start.go:728] Will try again in 5 seconds ...
	I0311 04:10:56.669669   40870 start.go:360] acquireMachinesLock for old-k8s-version-910000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:56.669866   40870 start.go:364] duration metric: took 158.633µs to acquireMachinesLock for "old-k8s-version-910000"
	I0311 04:10:56.669900   40870 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:10:56.669907   40870 fix.go:54] fixHost starting: 
	I0311 04:10:56.670327   40870 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:56.670368   40870 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:56.679572   40870 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64049
	I0311 04:10:56.679957   40870 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:56.680322   40870 main.go:141] libmachine: Using API Version  1
	I0311 04:10:56.680339   40870 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:56.680549   40870 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:56.680654   40870 main.go:141] libmachine: (old-k8s-version-910000) Calling .DriverName
	I0311 04:10:56.680738   40870 main.go:141] libmachine: (old-k8s-version-910000) Calling .GetState
	I0311 04:10:56.680826   40870 main.go:141] libmachine: (old-k8s-version-910000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:56.680839   40870 main.go:141] libmachine: (old-k8s-version-910000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000/hyperkit.json: no such file or directory
	I0311 04:10:56.680859   40870 main.go:141] libmachine: (old-k8s-version-910000) DBG | hyperkit pid from json: 0
	I0311 04:10:56.680916   40870 fix.go:112] recreateIfNeeded on old-k8s-version-910000: state=Stopped err=<nil>
	I0311 04:10:56.680926   40870 main.go:141] libmachine: (old-k8s-version-910000) Calling .DriverName
	W0311 04:10:56.681016   40870 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:10:56.758205   40870 out.go:177] * Restarting existing hyperkit VM for "old-k8s-version-910000" ...
	I0311 04:10:56.822048   40870 main.go:141] libmachine: (old-k8s-version-910000) Calling .Start
	I0311 04:10:56.822311   40870 main.go:141] libmachine: (old-k8s-version-910000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:56.822428   40870 main.go:141] libmachine: (old-k8s-version-910000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000/hyperkit.pid
	I0311 04:10:56.822487   40870 main.go:141] libmachine: (old-k8s-version-910000) DBG | Using UUID d6dce8fe-08f2-4a45-9050-f4deb7afe4c5
	I0311 04:10:56.866200   40870 main.go:141] libmachine: (old-k8s-version-910000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:56.866337   40870 fix.go:56] duration metric: took 196.425632ms for fixHost
	I0311 04:10:56.866351   40870 start.go:83] releasing machines lock for "old-k8s-version-910000", held for 196.468023ms
	W0311 04:10:56.866442   40870 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-910000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-910000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:56.909907   40870 out.go:177] 
	W0311 04:10:56.974143   40870 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:10:56.974214   40870 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:10:56.974237   40870 out.go:239] * Related issues:
	* Related issues:
	W0311 04:10:56.974259   40870 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:10:56.974334   40870 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:10:57.037896   40870 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p old-k8s-version-910000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000: exit status 7 (73.807183ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-910000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (6.25s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-027000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context no-preload-027000 create -f testdata/busybox.yaml: exit status 1 (37.44682ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-027000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context no-preload-027000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000: exit status 7 (74.431136ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-027000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000: exit status 7 (73.334435ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-027000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/DeployApp (0.19s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p no-preload-027000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-027000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context no-preload-027000 describe deploy/metrics-server -n kube-system: exit status 1 (36.988478ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-027000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context no-preload-027000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000: exit status 7 (74.015171ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-027000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.32s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (5.99s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p no-preload-027000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p no-preload-027000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (5.918015862s)

                                                
                                                
-- stdout --
	* [no-preload-027000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "no-preload-027000" primary control-plane node in "no-preload-027000" cluster
	* Restarting existing hyperkit VM for "no-preload-027000" ...
	* Restarting existing hyperkit VM for "no-preload-027000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:10:56.388038   40929 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:10:56.388288   40929 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:56.388294   40929 out.go:304] Setting ErrFile to fd 2...
	I0311 04:10:56.388297   40929 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:56.388476   40929 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:10:56.389872   40929 out.go:298] Setting JSON to false
	I0311 04:10:56.412041   40929 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11426,"bootTime":1710144030,"procs":478,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:10:56.412137   40929 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:10:56.433530   40929 out.go:177] * [no-preload-027000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:10:56.476458   40929 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:10:56.476517   40929 notify.go:220] Checking for updates...
	I0311 04:10:56.519015   40929 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:10:56.540068   40929 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:10:56.561125   40929 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:10:56.582143   40929 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:56.603273   40929 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:10:56.625595   40929 config.go:182] Loaded profile config "no-preload-027000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0311 04:10:56.626071   40929 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:56.626136   40929 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:56.634580   40929 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64045
	I0311 04:10:56.634961   40929 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:56.635392   40929 main.go:141] libmachine: Using API Version  1
	I0311 04:10:56.635403   40929 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:56.635594   40929 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:56.635688   40929 main.go:141] libmachine: (no-preload-027000) Calling .DriverName
	I0311 04:10:56.635893   40929 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:10:56.636132   40929 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:56.636159   40929 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:56.644033   40929 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64047
	I0311 04:10:56.644361   40929 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:56.644747   40929 main.go:141] libmachine: Using API Version  1
	I0311 04:10:56.644771   40929 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:56.644987   40929 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:56.645091   40929 main.go:141] libmachine: (no-preload-027000) Calling .DriverName
	I0311 04:10:56.673973   40929 out.go:177] * Using the hyperkit driver based on existing profile
	I0311 04:10:56.716050   40929 start.go:297] selected driver: hyperkit
	I0311 04:10:56.716082   40929 start.go:901] validating driver "hyperkit" against &{Name:no-preload-027000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-027000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0
CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:10:56.716267   40929 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:10:56.720699   40929 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:56.720793   40929 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:10:56.728707   40929 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:10:56.732598   40929 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:56.732621   40929 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:10:56.732753   40929 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:10:56.732825   40929 cni.go:84] Creating CNI manager for ""
	I0311 04:10:56.732838   40929 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:10:56.732880   40929 start.go:340] cluster config:
	{Name:no-preload-027000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-027000 Namespace:default
APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVer
sion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:10:56.732962   40929 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:56.801232   40929 out.go:177] * Starting "no-preload-027000" primary control-plane node in "no-preload-027000" cluster
	I0311 04:10:56.842831   40929 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0311 04:10:56.842989   40929 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/no-preload-027000/config.json ...
	I0311 04:10:56.843022   40929 cache.go:107] acquiring lock: {Name:mk575988cb62127dcd9267ea1f2f82284485bac4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:56.843083   40929 cache.go:107] acquiring lock: {Name:mk845b56ed86c6e0c2c9fa7cea61456710fe6197 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:56.843093   40929 cache.go:107] acquiring lock: {Name:mk7aeff5c0da58c9b5a6b185728dc00caefa60fe Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:56.843136   40929 cache.go:115] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0311 04:10:56.843152   40929 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 135.16µs
	I0311 04:10:56.843162   40929 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0311 04:10:56.843223   40929 cache.go:115] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 exists
	I0311 04:10:56.843235   40929 cache.go:96] cache image "registry.k8s.io/etcd:3.5.10-0" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0" took 161.44µs
	I0311 04:10:56.843241   40929 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.10-0 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 succeeded
	I0311 04:10:56.843213   40929 cache.go:107] acquiring lock: {Name:mk49dd38af6415614587a4fc967f40c1ade7811f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:56.843193   40929 cache.go:107] acquiring lock: {Name:mkd3feb7e398d63afedbf04a49fc890d9807563d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:56.843280   40929 cache.go:115] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 exists
	I0311 04:10:56.843207   40929 cache.go:107] acquiring lock: {Name:mk389813f522f561433fa823a321432e45a33bdc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:56.843296   40929 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2" took 228.146µs
	I0311 04:10:56.843278   40929 cache.go:107] acquiring lock: {Name:mk3bcaf5cca9f3a1e7d9c4ec2f598b6830094aa3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:56.843306   40929 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 succeeded
	I0311 04:10:56.843301   40929 cache.go:107] acquiring lock: {Name:mkaf4adebbb9674ffd1ee50d9f330b6245666099 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:56.843410   40929 cache.go:115] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 exists
	I0311 04:10:56.843431   40929 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2" took 274.8µs
	I0311 04:10:56.843434   40929 cache.go:115] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 exists
	I0311 04:10:56.843440   40929 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 succeeded
	I0311 04:10:56.843452   40929 cache.go:115] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 exists
	I0311 04:10:56.843450   40929 cache.go:115] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 exists
	I0311 04:10:56.843451   40929 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2" took 267.786µs
	I0311 04:10:56.843466   40929 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 succeeded
	I0311 04:10:56.843462   40929 cache.go:115] /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 exists
	I0311 04:10:56.843468   40929 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9" took 330.463µs
	I0311 04:10:56.843476   40929 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2" took 277.201µs
	I0311 04:10:56.843472   40929 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1" took 332.01µs
	I0311 04:10:56.843484   40929 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 succeeded
	I0311 04:10:56.843489   40929 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
	I0311 04:10:56.843487   40929 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 succeeded
	I0311 04:10:56.843497   40929 cache.go:87] Successfully saved all images to host disk.
	I0311 04:10:56.843513   40929 start.go:360] acquireMachinesLock for no-preload-027000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:56.866397   40929 start.go:364] duration metric: took 22.85867ms to acquireMachinesLock for "no-preload-027000"
	I0311 04:10:56.866451   40929 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:10:56.866467   40929 fix.go:54] fixHost starting: 
	I0311 04:10:56.866854   40929 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:56.866886   40929 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:56.876322   40929 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64051
	I0311 04:10:56.876895   40929 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:56.877364   40929 main.go:141] libmachine: Using API Version  1
	I0311 04:10:56.877388   40929 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:56.877681   40929 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:56.877835   40929 main.go:141] libmachine: (no-preload-027000) Calling .DriverName
	I0311 04:10:56.877964   40929 main.go:141] libmachine: (no-preload-027000) Calling .GetState
	I0311 04:10:56.878071   40929 main.go:141] libmachine: (no-preload-027000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:56.878113   40929 main.go:141] libmachine: (no-preload-027000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000/hyperkit.json: no such file or directory
	I0311 04:10:56.878129   40929 main.go:141] libmachine: (no-preload-027000) DBG | hyperkit pid from json: 0
	I0311 04:10:56.878197   40929 fix.go:112] recreateIfNeeded on no-preload-027000: state=Stopped err=<nil>
	I0311 04:10:56.878247   40929 main.go:141] libmachine: (no-preload-027000) Calling .DriverName
	W0311 04:10:56.878357   40929 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:10:56.953093   40929 out.go:177] * Restarting existing hyperkit VM for "no-preload-027000" ...
	I0311 04:10:56.995092   40929 main.go:141] libmachine: (no-preload-027000) Calling .Start
	I0311 04:10:56.995491   40929 main.go:141] libmachine: (no-preload-027000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:56.995539   40929 main.go:141] libmachine: (no-preload-027000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000/hyperkit.pid
	I0311 04:10:56.995611   40929 main.go:141] libmachine: (no-preload-027000) DBG | Using UUID 938f649f-22c3-41e7-943e-2ad20153933a
	I0311 04:10:56.997636   40929 main.go:141] libmachine: (no-preload-027000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:56.997742   40929 fix.go:56] duration metric: took 131.274831ms for fixHost
	I0311 04:10:56.997752   40929 start.go:83] releasing machines lock for "no-preload-027000", held for 131.329982ms
	W0311 04:10:56.997772   40929 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0311 04:10:56.997832   40929 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:10:56.997840   40929 start.go:728] Will try again in 5 seconds ...
	I0311 04:11:01.998836   40929 start.go:360] acquireMachinesLock for no-preload-027000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:11:01.999035   40929 start.go:364] duration metric: took 143.826µs to acquireMachinesLock for "no-preload-027000"
	I0311 04:11:01.999087   40929 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:11:01.999095   40929 fix.go:54] fixHost starting: 
	I0311 04:11:01.999566   40929 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:01.999614   40929 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:02.008353   40929 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64086
	I0311 04:11:02.008731   40929 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:02.009097   40929 main.go:141] libmachine: Using API Version  1
	I0311 04:11:02.009114   40929 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:02.009345   40929 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:02.009446   40929 main.go:141] libmachine: (no-preload-027000) Calling .DriverName
	I0311 04:11:02.009550   40929 main.go:141] libmachine: (no-preload-027000) Calling .GetState
	I0311 04:11:02.009643   40929 main.go:141] libmachine: (no-preload-027000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:02.009659   40929 main.go:141] libmachine: (no-preload-027000) DBG | hyperkit pid from json: 0
	I0311 04:11:02.009687   40929 main.go:141] libmachine: (no-preload-027000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000/hyperkit.json: no such file or directory
	I0311 04:11:02.009707   40929 fix.go:112] recreateIfNeeded on no-preload-027000: state=Stopped err=<nil>
	I0311 04:11:02.009730   40929 main.go:141] libmachine: (no-preload-027000) Calling .DriverName
	W0311 04:11:02.009812   40929 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:11:02.053603   40929 out.go:177] * Restarting existing hyperkit VM for "no-preload-027000" ...
	I0311 04:11:02.078667   40929 main.go:141] libmachine: (no-preload-027000) Calling .Start
	I0311 04:11:02.078810   40929 main.go:141] libmachine: (no-preload-027000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:02.078866   40929 main.go:141] libmachine: (no-preload-027000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000/hyperkit.pid
	I0311 04:11:02.078887   40929 main.go:141] libmachine: (no-preload-027000) DBG | Using UUID 938f649f-22c3-41e7-943e-2ad20153933a
	I0311 04:11:02.096570   40929 main.go:141] libmachine: (no-preload-027000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:11:02.096655   40929 fix.go:56] duration metric: took 97.557591ms for fixHost
	I0311 04:11:02.096662   40929 start.go:83] releasing machines lock for "no-preload-027000", held for 97.603581ms
	W0311 04:11:02.096735   40929 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p no-preload-027000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p no-preload-027000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:11:02.139710   40929 out.go:177] 
	W0311 04:11:02.161796   40929 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:11:02.161859   40929 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:11:02.161873   40929 out.go:239] * Related issues:
	* Related issues:
	W0311 04:11:02.161907   40929 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:11:02.161947   40929 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:11:02.183633   40929 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p no-preload-027000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000: exit status 7 (74.429364ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-027000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/SecondStart (5.99s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.08s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-910000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000: exit status 7 (75.606222ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-910000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.08s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-910000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-910000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context old-k8s-version-910000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (37.373259ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-910000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context old-k8s-version-910000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000: exit status 7 (72.696856ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-910000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.11s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p old-k8s-version-910000 image list --format=json
start_stop_delete_test.go:304: v1.20.0 images missing (-want +got):
[]string{
- 	"k8s.gcr.io/coredns:1.7.0",
- 	"k8s.gcr.io/etcd:3.4.13-0",
- 	"k8s.gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"k8s.gcr.io/kube-apiserver:v1.20.0",
- 	"k8s.gcr.io/kube-controller-manager:v1.20.0",
- 	"k8s.gcr.io/kube-proxy:v1.20.0",
- 	"k8s.gcr.io/kube-scheduler:v1.20.0",
- 	"k8s.gcr.io/pause:3.2",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000: exit status 7 (73.526457ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-910000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p old-k8s-version-910000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p old-k8s-version-910000 --alsologtostderr -v=1: exit status 83 (138.560522ms)

                                                
                                                
-- stdout --
	* The control-plane node old-k8s-version-910000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p old-k8s-version-910000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:10:57.626561   40958 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:10:57.626839   40958 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:57.626844   40958 out.go:304] Setting ErrFile to fd 2...
	I0311 04:10:57.626848   40958 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:57.627034   40958 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:10:57.627354   40958 out.go:298] Setting JSON to false
	I0311 04:10:57.627372   40958 mustload.go:65] Loading cluster: old-k8s-version-910000
	I0311 04:10:57.627674   40958 config.go:182] Loaded profile config "old-k8s-version-910000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0311 04:10:57.628003   40958 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:57.628053   40958 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:57.636220   40958 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64067
	I0311 04:10:57.636747   40958 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:57.637189   40958 main.go:141] libmachine: Using API Version  1
	I0311 04:10:57.637219   40958 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:57.637472   40958 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:57.637581   40958 main.go:141] libmachine: (old-k8s-version-910000) Calling .GetState
	I0311 04:10:57.637669   40958 main.go:141] libmachine: (old-k8s-version-910000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:57.637690   40958 main.go:141] libmachine: (old-k8s-version-910000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/old-k8s-version-910000/hyperkit.json: no such file or directory
	I0311 04:10:57.637700   40958 main.go:141] libmachine: (old-k8s-version-910000) DBG | hyperkit pid from json: 0
	I0311 04:10:57.659055   40958 out.go:177] * The control-plane node old-k8s-version-910000 host is not running: state=Stopped
	I0311 04:10:57.680518   40958 out.go:177]   To start a cluster, run: "minikube start -p old-k8s-version-910000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p old-k8s-version-910000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000: exit status 7 (75.6736ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-910000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000: exit status 7 (73.644644ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-910000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/Pause (0.29s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (12.02s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p embed-certs-136000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p embed-certs-136000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (11.937821228s)

                                                
                                                
-- stdout --
	* [embed-certs-136000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "embed-certs-136000" primary control-plane node in "embed-certs-136000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "embed-certs-136000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:10:58.624581   40986 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:10:58.624936   40986 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:58.624942   40986 out.go:304] Setting ErrFile to fd 2...
	I0311 04:10:58.624946   40986 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:10:58.625109   40986 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:10:58.626614   40986 out.go:298] Setting JSON to false
	I0311 04:10:58.649825   40986 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11428,"bootTime":1710144030,"procs":484,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:10:58.649918   40986 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:10:58.671993   40986 out.go:177] * [embed-certs-136000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:10:58.736775   40986 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:10:58.714979   40986 notify.go:220] Checking for updates...
	I0311 04:10:58.779707   40986 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:10:58.800809   40986 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:10:58.823907   40986 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:10:58.846757   40986 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:58.867490   40986 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:10:58.889215   40986 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:10:58.889306   40986 config.go:182] Loaded profile config "no-preload-027000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0311 04:10:58.889388   40986 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:10:58.918796   40986 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:10:58.960942   40986 start.go:297] selected driver: hyperkit
	I0311 04:10:58.960971   40986 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:10:58.960994   40986 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:10:58.965526   40986 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:58.965649   40986 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:10:58.974173   40986 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:10:58.978072   40986 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:58.978098   40986 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:10:58.978128   40986 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:10:58.978346   40986 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:10:58.978404   40986 cni.go:84] Creating CNI manager for ""
	I0311 04:10:58.978422   40986 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:10:58.978429   40986 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0311 04:10:58.978503   40986 start.go:340] cluster config:
	{Name:embed-certs-136000 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-136000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Conta
inerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthS
ock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:10:58.978587   40986 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:10:58.999954   40986 out.go:177] * Starting "embed-certs-136000" primary control-plane node in "embed-certs-136000" cluster
	I0311 04:10:59.021655   40986 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:10:59.021715   40986 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:10:59.021738   40986 cache.go:56] Caching tarball of preloaded images
	I0311 04:10:59.021893   40986 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:10:59.021908   40986 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:10:59.022010   40986 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/embed-certs-136000/config.json ...
	I0311 04:10:59.022035   40986 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/embed-certs-136000/config.json: {Name:mk46f760db463aa1f67b9bf257e8e285db8bb755 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:10:59.022464   40986 start.go:360] acquireMachinesLock for embed-certs-136000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:10:59.022556   40986 start.go:364] duration metric: took 70.467µs to acquireMachinesLock for "embed-certs-136000"
	I0311 04:10:59.022593   40986 start.go:93] Provisioning new machine with config: &{Name:embed-certs-136000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-136000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou
ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:10:59.022668   40986 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:10:59.043711   40986 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:10:59.043872   40986 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:10:59.043917   40986 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:10:59.051725   40986 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64080
	I0311 04:10:59.052084   40986 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:10:59.052485   40986 main.go:141] libmachine: Using API Version  1
	I0311 04:10:59.052502   40986 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:10:59.052695   40986 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:10:59.052788   40986 main.go:141] libmachine: (embed-certs-136000) Calling .GetMachineName
	I0311 04:10:59.052879   40986 main.go:141] libmachine: (embed-certs-136000) Calling .DriverName
	I0311 04:10:59.052982   40986 start.go:159] libmachine.API.Create for "embed-certs-136000" (driver="hyperkit")
	I0311 04:10:59.053003   40986 client.go:168] LocalClient.Create starting
	I0311 04:10:59.053033   40986 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:10:59.053078   40986 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:59.053093   40986 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:59.053157   40986 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:10:59.053195   40986 main.go:141] libmachine: Decoding PEM data...
	I0311 04:10:59.053207   40986 main.go:141] libmachine: Parsing certificate...
	I0311 04:10:59.053220   40986 main.go:141] libmachine: Running pre-create checks...
	I0311 04:10:59.053227   40986 main.go:141] libmachine: (embed-certs-136000) Calling .PreCreateCheck
	I0311 04:10:59.053302   40986 main.go:141] libmachine: (embed-certs-136000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:59.053474   40986 main.go:141] libmachine: (embed-certs-136000) Calling .GetConfigRaw
	I0311 04:10:59.065291   40986 main.go:141] libmachine: Creating machine...
	I0311 04:10:59.065326   40986 main.go:141] libmachine: (embed-certs-136000) Calling .Create
	I0311 04:10:59.065509   40986 main.go:141] libmachine: (embed-certs-136000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:59.065695   40986 main.go:141] libmachine: (embed-certs-136000) DBG | I0311 04:10:59.065481   40994 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:10:59.065753   40986 main.go:141] libmachine: (embed-certs-136000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:10:59.245547   40986 main.go:141] libmachine: (embed-certs-136000) DBG | I0311 04:10:59.245491   40994 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000/id_rsa...
	I0311 04:10:59.365303   40986 main.go:141] libmachine: (embed-certs-136000) DBG | I0311 04:10:59.365250   40994 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000/embed-certs-136000.rawdisk...
	I0311 04:10:59.365349   40986 main.go:141] libmachine: (embed-certs-136000) DBG | Writing magic tar header
	I0311 04:10:59.365359   40986 main.go:141] libmachine: (embed-certs-136000) DBG | Writing SSH key tar header
	I0311 04:10:59.366023   40986 main.go:141] libmachine: (embed-certs-136000) DBG | I0311 04:10:59.365939   40994 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000 ...
	I0311 04:10:59.734339   40986 main.go:141] libmachine: (embed-certs-136000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:10:59.734359   40986 main.go:141] libmachine: (embed-certs-136000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000/hyperkit.pid
	I0311 04:10:59.734405   40986 main.go:141] libmachine: (embed-certs-136000) DBG | Using UUID 777c666c-c76e-4b04-8870-bb06beb8e104
	I0311 04:10:59.750501   40986 main.go:141] libmachine: (embed-certs-136000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:10:59.750585   40986 client.go:171] duration metric: took 697.562383ms to LocalClient.Create
	I0311 04:11:01.752201   40986 start.go:128] duration metric: took 2.729475583s to createHost
	I0311 04:11:01.752225   40986 start.go:83] releasing machines lock for "embed-certs-136000", held for 2.729617565s
	W0311 04:11:01.752255   40986 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:11:01.752784   40986 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:01.752827   40986 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:01.761495   40986 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64082
	I0311 04:11:01.761859   40986 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:01.762237   40986 main.go:141] libmachine: Using API Version  1
	I0311 04:11:01.762251   40986 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:01.762451   40986 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:01.762792   40986 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:01.762823   40986 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:01.770552   40986 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64084
	I0311 04:11:01.770923   40986 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:01.771241   40986 main.go:141] libmachine: Using API Version  1
	I0311 04:11:01.771252   40986 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:01.771483   40986 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:01.771597   40986 main.go:141] libmachine: (embed-certs-136000) Calling .GetState
	I0311 04:11:01.771685   40986 main.go:141] libmachine: (embed-certs-136000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:01.771708   40986 main.go:141] libmachine: (embed-certs-136000) DBG | hyperkit pid from json: 0
	I0311 04:11:01.771720   40986 main.go:141] libmachine: (embed-certs-136000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000/hyperkit.json: no such file or directory
	I0311 04:11:01.771772   40986 main.go:141] libmachine: (embed-certs-136000) Calling .DriverName
	I0311 04:11:01.817450   40986 out.go:177] * Deleting "embed-certs-136000" in hyperkit ...
	I0311 04:11:01.840444   40986 main.go:141] libmachine: (embed-certs-136000) Calling .Remove
	I0311 04:11:01.840733   40986 main.go:141] libmachine: (embed-certs-136000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:01.840752   40986 main.go:141] libmachine: (embed-certs-136000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:01.840805   40986 main.go:141] libmachine: (embed-certs-136000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000/hyperkit.json: no such file or directory
	I0311 04:11:01.840819   40986 main.go:141] libmachine: (embed-certs-136000) DBG | hyperkit pid from json: 0
	W0311 04:11:01.858849   40986 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:11:01.858863   40986 start.go:728] Will try again in 5 seconds ...
	I0311 04:11:06.861024   40986 start.go:360] acquireMachinesLock for embed-certs-136000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:11:07.341578   40986 start.go:364] duration metric: took 480.49292ms to acquireMachinesLock for "embed-certs-136000"
	I0311 04:11:07.341628   40986 start.go:93] Provisioning new machine with config: &{Name:embed-certs-136000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-136000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou
ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:11:07.341796   40986 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:11:07.377149   40986 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:11:07.377296   40986 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:07.377395   40986 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:07.386718   40986 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64121
	I0311 04:11:07.387064   40986 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:07.387433   40986 main.go:141] libmachine: Using API Version  1
	I0311 04:11:07.387446   40986 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:07.387657   40986 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:07.387764   40986 main.go:141] libmachine: (embed-certs-136000) Calling .GetMachineName
	I0311 04:11:07.387846   40986 main.go:141] libmachine: (embed-certs-136000) Calling .DriverName
	I0311 04:11:07.387960   40986 start.go:159] libmachine.API.Create for "embed-certs-136000" (driver="hyperkit")
	I0311 04:11:07.387979   40986 client.go:168] LocalClient.Create starting
	I0311 04:11:07.388005   40986 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:11:07.388041   40986 main.go:141] libmachine: Decoding PEM data...
	I0311 04:11:07.388052   40986 main.go:141] libmachine: Parsing certificate...
	I0311 04:11:07.388108   40986 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:11:07.388139   40986 main.go:141] libmachine: Decoding PEM data...
	I0311 04:11:07.388152   40986 main.go:141] libmachine: Parsing certificate...
	I0311 04:11:07.388166   40986 main.go:141] libmachine: Running pre-create checks...
	I0311 04:11:07.388172   40986 main.go:141] libmachine: (embed-certs-136000) Calling .PreCreateCheck
	I0311 04:11:07.388243   40986 main.go:141] libmachine: (embed-certs-136000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:07.388269   40986 main.go:141] libmachine: (embed-certs-136000) Calling .GetConfigRaw
	I0311 04:11:07.419785   40986 main.go:141] libmachine: Creating machine...
	I0311 04:11:07.419834   40986 main.go:141] libmachine: (embed-certs-136000) Calling .Create
	I0311 04:11:07.420099   40986 main.go:141] libmachine: (embed-certs-136000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:07.420418   40986 main.go:141] libmachine: (embed-certs-136000) DBG | I0311 04:11:07.420057   41068 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:11:07.420472   40986 main.go:141] libmachine: (embed-certs-136000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:11:07.725741   40986 main.go:141] libmachine: (embed-certs-136000) DBG | I0311 04:11:07.725643   41068 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000/id_rsa...
	I0311 04:11:07.922544   40986 main.go:141] libmachine: (embed-certs-136000) DBG | I0311 04:11:07.922450   41068 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000/embed-certs-136000.rawdisk...
	I0311 04:11:07.922578   40986 main.go:141] libmachine: (embed-certs-136000) DBG | Writing magic tar header
	I0311 04:11:07.922591   40986 main.go:141] libmachine: (embed-certs-136000) DBG | Writing SSH key tar header
	I0311 04:11:07.923457   40986 main.go:141] libmachine: (embed-certs-136000) DBG | I0311 04:11:07.923363   41068 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000 ...
	I0311 04:11:08.284529   40986 main.go:141] libmachine: (embed-certs-136000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:08.284561   40986 main.go:141] libmachine: (embed-certs-136000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000/hyperkit.pid
	I0311 04:11:08.284584   40986 main.go:141] libmachine: (embed-certs-136000) DBG | Using UUID f8b74d25-74bd-4863-8ed6-766a51582796
	I0311 04:11:08.303921   40986 main.go:141] libmachine: (embed-certs-136000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:11:08.304006   40986 client.go:171] duration metric: took 916.005577ms to LocalClient.Create
	I0311 04:11:10.304577   40986 start.go:128] duration metric: took 2.962698713s to createHost
	I0311 04:11:10.304598   40986 start.go:83] releasing machines lock for "embed-certs-136000", held for 2.962957051s
	W0311 04:11:10.304698   40986 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p embed-certs-136000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p embed-certs-136000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:11:10.350417   40986 out.go:177] 
	W0311 04:11:10.372354   40986 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:11:10.372408   40986 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:11:10.372422   40986 out.go:239] * Related issues:
	* Related issues:
	W0311 04:11:10.372442   40986 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:11:10.372457   40986 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:11:10.436091   40986 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p embed-certs-136000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000: exit status 7 (78.473878ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-136000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/FirstStart (12.02s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-027000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000: exit status 7 (72.996717ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-027000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.14s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-027000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-027000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context no-preload-027000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (37.559028ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-027000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context no-preload-027000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000: exit status 7 (105.998896ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-027000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.14s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p no-preload-027000 image list --format=json
start_stop_delete_test.go:304: v1.29.0-rc.2 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.1",
- 	"registry.k8s.io/etcd:3.5.10-0",
- 	"registry.k8s.io/kube-apiserver:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-controller-manager:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-proxy:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-scheduler:v1.29.0-rc.2",
- 	"registry.k8s.io/pause:3.9",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000: exit status 7 (73.551011ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-027000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p no-preload-027000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p no-preload-027000 --alsologtostderr -v=1: exit status 83 (140.260836ms)

                                                
                                                
-- stdout --
	* The control-plane node no-preload-027000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p no-preload-027000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:11:02.779844   41016 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:11:02.780495   41016 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:02.780504   41016 out.go:304] Setting ErrFile to fd 2...
	I0311 04:11:02.780510   41016 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:02.781169   41016 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:11:02.781505   41016 out.go:298] Setting JSON to false
	I0311 04:11:02.781527   41016 mustload.go:65] Loading cluster: no-preload-027000
	I0311 04:11:02.781780   41016 config.go:182] Loaded profile config "no-preload-027000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0311 04:11:02.782084   41016 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:02.782146   41016 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:02.789828   41016 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64102
	I0311 04:11:02.790269   41016 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:02.790716   41016 main.go:141] libmachine: Using API Version  1
	I0311 04:11:02.790726   41016 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:02.790939   41016 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:02.791036   41016 main.go:141] libmachine: (no-preload-027000) Calling .GetState
	I0311 04:11:02.791121   41016 main.go:141] libmachine: (no-preload-027000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:02.791141   41016 main.go:141] libmachine: (no-preload-027000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/no-preload-027000/hyperkit.json: no such file or directory
	I0311 04:11:02.791146   41016 main.go:141] libmachine: (no-preload-027000) DBG | hyperkit pid from json: 0
	I0311 04:11:02.813119   41016 out.go:177] * The control-plane node no-preload-027000 host is not running: state=Stopped
	I0311 04:11:02.834871   41016 out.go:177]   To start a cluster, run: "minikube start -p no-preload-027000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p no-preload-027000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000: exit status 7 (74.156192ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-027000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000: exit status 7 (73.362622ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-027000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/Pause (0.29s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (11.45s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p default-k8s-diff-port-345000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p default-k8s-diff-port-345000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (11.370276068s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-345000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "default-k8s-diff-port-345000" primary control-plane node in "default-k8s-diff-port-345000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "default-k8s-diff-port-345000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:11:04.188680   41056 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:11:04.189384   41056 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:04.189394   41056 out.go:304] Setting ErrFile to fd 2...
	I0311 04:11:04.189400   41056 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:04.189928   41056 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:11:04.191612   41056 out.go:298] Setting JSON to false
	I0311 04:11:04.214168   41056 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11434,"bootTime":1710144030,"procs":486,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:11:04.214259   41056 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:11:04.236175   41056 out.go:177] * [default-k8s-diff-port-345000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:11:04.278867   41056 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:11:04.278928   41056 notify.go:220] Checking for updates...
	I0311 04:11:04.300782   41056 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:11:04.321752   41056 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:11:04.342533   41056 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:11:04.363864   41056 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:11:04.384648   41056 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:11:04.406539   41056 config.go:182] Loaded profile config "embed-certs-136000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:11:04.406749   41056 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:11:04.406916   41056 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:11:04.436753   41056 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:11:04.478576   41056 start.go:297] selected driver: hyperkit
	I0311 04:11:04.478629   41056 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:11:04.478650   41056 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:11:04.482973   41056 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:11:04.483106   41056 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:11:04.490883   41056 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:11:04.494670   41056 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:04.494693   41056 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:11:04.494720   41056 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 04:11:04.494924   41056 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:11:04.494983   41056 cni.go:84] Creating CNI manager for ""
	I0311 04:11:04.494999   41056 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:11:04.495006   41056 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0311 04:11:04.495083   41056 start.go:340] cluster config:
	{Name:default-k8s-diff-port-345000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-345000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomai
n:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPat
h: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:11:04.495171   41056 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:11:04.516702   41056 out.go:177] * Starting "default-k8s-diff-port-345000" primary control-plane node in "default-k8s-diff-port-345000" cluster
	I0311 04:11:04.537737   41056 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:11:04.537831   41056 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:11:04.537881   41056 cache.go:56] Caching tarball of preloaded images
	I0311 04:11:04.538090   41056 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:11:04.538108   41056 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:11:04.538280   41056 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/default-k8s-diff-port-345000/config.json ...
	I0311 04:11:04.538320   41056 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/default-k8s-diff-port-345000/config.json: {Name:mk4101d172032e241b1c98a2b683b10f52ceae49 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:11:04.539009   41056 start.go:360] acquireMachinesLock for default-k8s-diff-port-345000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:11:04.539143   41056 start.go:364] duration metric: took 97.974µs to acquireMachinesLock for "default-k8s-diff-port-345000"
	I0311 04:11:04.539210   41056 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-345000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-345000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:11:04.539299   41056 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:11:04.560654   41056 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:11:04.560993   41056 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:04.561076   41056 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:04.570408   41056 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64115
	I0311 04:11:04.570785   41056 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:04.571241   41056 main.go:141] libmachine: Using API Version  1
	I0311 04:11:04.571253   41056 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:04.571476   41056 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:04.571589   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .GetMachineName
	I0311 04:11:04.571686   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .DriverName
	I0311 04:11:04.571794   41056 start.go:159] libmachine.API.Create for "default-k8s-diff-port-345000" (driver="hyperkit")
	I0311 04:11:04.571820   41056 client.go:168] LocalClient.Create starting
	I0311 04:11:04.571852   41056 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:11:04.571917   41056 main.go:141] libmachine: Decoding PEM data...
	I0311 04:11:04.571934   41056 main.go:141] libmachine: Parsing certificate...
	I0311 04:11:04.572015   41056 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:11:04.572051   41056 main.go:141] libmachine: Decoding PEM data...
	I0311 04:11:04.572059   41056 main.go:141] libmachine: Parsing certificate...
	I0311 04:11:04.572078   41056 main.go:141] libmachine: Running pre-create checks...
	I0311 04:11:04.572088   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .PreCreateCheck
	I0311 04:11:04.572170   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:04.572394   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .GetConfigRaw
	I0311 04:11:04.581844   41056 main.go:141] libmachine: Creating machine...
	I0311 04:11:04.581852   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .Create
	I0311 04:11:04.581936   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:04.582060   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | I0311 04:11:04.581926   41064 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:11:04.582105   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:11:04.760503   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | I0311 04:11:04.760369   41064 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000/id_rsa...
	I0311 04:11:04.957874   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | I0311 04:11:04.957795   41064 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000/default-k8s-diff-port-345000.rawdisk...
	I0311 04:11:04.957889   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | Writing magic tar header
	I0311 04:11:04.957969   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | Writing SSH key tar header
	I0311 04:11:04.958745   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | I0311 04:11:04.958647   41064 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000 ...
	I0311 04:11:05.324557   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:05.324583   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000/hyperkit.pid
	I0311 04:11:05.324616   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | Using UUID 7421723f-69aa-4d2c-9a3a-bb051d3337e6
	I0311 04:11:05.341159   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:11:05.341274   41056 client.go:171] duration metric: took 769.43277ms to LocalClient.Create
	I0311 04:11:07.341451   41056 start.go:128] duration metric: took 2.802091909s to createHost
	I0311 04:11:07.341476   41056 start.go:83] releasing machines lock for "default-k8s-diff-port-345000", held for 2.802278563s
	W0311 04:11:07.341507   41056 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:11:07.342067   41056 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:07.342106   41056 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:07.351412   41056 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64117
	I0311 04:11:07.351765   41056 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:07.352107   41056 main.go:141] libmachine: Using API Version  1
	I0311 04:11:07.352121   41056 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:07.352320   41056 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:07.352652   41056 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:07.352675   41056 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:07.360618   41056 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64119
	I0311 04:11:07.360973   41056 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:07.361363   41056 main.go:141] libmachine: Using API Version  1
	I0311 04:11:07.361381   41056 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:07.361615   41056 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:07.361719   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .GetState
	I0311 04:11:07.361798   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:07.361821   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | hyperkit pid from json: 0
	I0311 04:11:07.361838   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000/hyperkit.json: no such file or directory
	I0311 04:11:07.361877   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .DriverName
	I0311 04:11:07.419603   41056 out.go:177] * Deleting "default-k8s-diff-port-345000" in hyperkit ...
	I0311 04:11:07.443593   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .Remove
	I0311 04:11:07.443915   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:07.443970   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:07.444015   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000/hyperkit.json: no such file or directory
	I0311 04:11:07.444036   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | hyperkit pid from json: 0
	W0311 04:11:07.463168   41056 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:11:07.463202   41056 start.go:728] Will try again in 5 seconds ...
	I0311 04:11:12.463952   41056 start.go:360] acquireMachinesLock for default-k8s-diff-port-345000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:11:12.464089   41056 start.go:364] duration metric: took 105.855µs to acquireMachinesLock for "default-k8s-diff-port-345000"
	I0311 04:11:12.464118   41056 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-345000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-345000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:11:12.464192   41056 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:11:12.485990   41056 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:11:12.486137   41056 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:12.486185   41056 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:12.495388   41056 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64146
	I0311 04:11:12.495754   41056 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:12.496114   41056 main.go:141] libmachine: Using API Version  1
	I0311 04:11:12.496125   41056 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:12.496344   41056 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:12.496451   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .GetMachineName
	I0311 04:11:12.496541   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .DriverName
	I0311 04:11:12.496672   41056 start.go:159] libmachine.API.Create for "default-k8s-diff-port-345000" (driver="hyperkit")
	I0311 04:11:12.496694   41056 client.go:168] LocalClient.Create starting
	I0311 04:11:12.496724   41056 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:11:12.496774   41056 main.go:141] libmachine: Decoding PEM data...
	I0311 04:11:12.496786   41056 main.go:141] libmachine: Parsing certificate...
	I0311 04:11:12.496835   41056 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:11:12.496870   41056 main.go:141] libmachine: Decoding PEM data...
	I0311 04:11:12.496884   41056 main.go:141] libmachine: Parsing certificate...
	I0311 04:11:12.496896   41056 main.go:141] libmachine: Running pre-create checks...
	I0311 04:11:12.496902   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .PreCreateCheck
	I0311 04:11:12.496995   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:12.497021   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .GetConfigRaw
	I0311 04:11:12.508075   41056 main.go:141] libmachine: Creating machine...
	I0311 04:11:12.508092   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .Create
	I0311 04:11:12.508276   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:12.508497   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | I0311 04:11:12.508255   41098 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:11:12.508602   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:11:12.769765   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | I0311 04:11:12.769673   41098 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000/id_rsa...
	I0311 04:11:12.877328   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | I0311 04:11:12.877236   41098 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000/default-k8s-diff-port-345000.rawdisk...
	I0311 04:11:12.877343   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | Writing magic tar header
	I0311 04:11:12.877354   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | Writing SSH key tar header
	I0311 04:11:12.878205   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | I0311 04:11:12.878120   41098 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000 ...
	I0311 04:11:13.244464   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:13.244486   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000/hyperkit.pid
	I0311 04:11:13.244522   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | Using UUID 45dc923d-cb9f-4efa-b7b8-1dd3b0beaf38
	I0311 04:11:13.263393   41056 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:11:13.263499   41056 client.go:171] duration metric: took 766.785924ms to LocalClient.Create
	I0311 04:11:15.264882   41056 start.go:128] duration metric: took 2.800619588s to createHost
	I0311 04:11:15.264925   41056 start.go:83] releasing machines lock for "default-k8s-diff-port-345000", held for 2.800782817s
	W0311 04:11:15.265082   41056 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-345000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-345000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:11:15.286892   41056 out.go:177] 
	W0311 04:11:15.350744   41056 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:11:15.350824   41056 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:11:15.350843   41056 out.go:239] * Related issues:
	* Related issues:
	W0311 04:11:15.350867   41056 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:11:15.350900   41056 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:11:15.413787   41056 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p default-k8s-diff-port-345000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000: exit status 7 (75.134804ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-345000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (11.45s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-136000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context embed-certs-136000 create -f testdata/busybox.yaml: exit status 1 (37.65969ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-136000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context embed-certs-136000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000: exit status 7 (73.952335ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-136000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000: exit status 7 (73.620479ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-136000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/DeployApp (0.19s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p embed-certs-136000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-136000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context embed-certs-136000 describe deploy/metrics-server -n kube-system: exit status 1 (37.489223ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-136000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context embed-certs-136000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000: exit status 7 (72.810452ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-136000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.32s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (6.01s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p embed-certs-136000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p embed-certs-136000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (5.932510429s)

                                                
                                                
-- stdout --
	* [embed-certs-136000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "embed-certs-136000" primary control-plane node in "embed-certs-136000" cluster
	* Restarting existing hyperkit VM for "embed-certs-136000" ...
	* Restarting existing hyperkit VM for "embed-certs-136000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:11:14.839139   41118 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:11:14.839319   41118 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:14.839325   41118 out.go:304] Setting ErrFile to fd 2...
	I0311 04:11:14.839329   41118 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:14.840232   41118 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:11:14.841914   41118 out.go:298] Setting JSON to false
	I0311 04:11:14.864350   41118 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11444,"bootTime":1710144030,"procs":473,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:11:14.864448   41118 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:11:14.886272   41118 out.go:177] * [embed-certs-136000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:11:14.929415   41118 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:11:14.929490   41118 notify.go:220] Checking for updates...
	I0311 04:11:14.951175   41118 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:11:14.972100   41118 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:11:14.993224   41118 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:11:15.015934   41118 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:11:15.037337   41118 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:11:15.059657   41118 config.go:182] Loaded profile config "embed-certs-136000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:11:15.060060   41118 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:15.060114   41118 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:15.068358   41118 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64163
	I0311 04:11:15.068755   41118 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:15.069215   41118 main.go:141] libmachine: Using API Version  1
	I0311 04:11:15.069225   41118 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:15.069438   41118 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:15.069545   41118 main.go:141] libmachine: (embed-certs-136000) Calling .DriverName
	I0311 04:11:15.069755   41118 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:11:15.069988   41118 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:15.070020   41118 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:15.077591   41118 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64165
	I0311 04:11:15.077938   41118 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:15.078454   41118 main.go:141] libmachine: Using API Version  1
	I0311 04:11:15.078467   41118 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:15.078670   41118 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:15.078784   41118 main.go:141] libmachine: (embed-certs-136000) Calling .DriverName
	I0311 04:11:15.107025   41118 out.go:177] * Using the hyperkit driver based on existing profile
	I0311 04:11:15.128314   41118 start.go:297] selected driver: hyperkit
	I0311 04:11:15.128344   41118 start.go:901] validating driver "hyperkit" against &{Name:embed-certs-136000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-136000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpir
ation:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:11:15.128549   41118 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:11:15.132232   41118 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:11:15.132328   41118 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:11:15.140194   41118 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:11:15.144236   41118 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:15.144257   41118 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:11:15.144389   41118 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:11:15.144451   41118 cni.go:84] Creating CNI manager for ""
	I0311 04:11:15.144465   41118 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:11:15.144508   41118 start.go:340] cluster config:
	{Name:embed-certs-136000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-136000 Namespace:default APIS
erverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p20
00.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:11:15.144591   41118 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:11:15.186967   41118 out.go:177] * Starting "embed-certs-136000" primary control-plane node in "embed-certs-136000" cluster
	I0311 04:11:15.208111   41118 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:11:15.208178   41118 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:11:15.208206   41118 cache.go:56] Caching tarball of preloaded images
	I0311 04:11:15.208388   41118 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:11:15.208407   41118 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:11:15.208551   41118 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/embed-certs-136000/config.json ...
	I0311 04:11:15.209332   41118 start.go:360] acquireMachinesLock for embed-certs-136000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:11:15.265012   41118 start.go:364] duration metric: took 55.62496ms to acquireMachinesLock for "embed-certs-136000"
	I0311 04:11:15.265077   41118 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:11:15.265098   41118 fix.go:54] fixHost starting: 
	I0311 04:11:15.265540   41118 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:15.265585   41118 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:15.274991   41118 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64167
	I0311 04:11:15.275353   41118 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:15.275703   41118 main.go:141] libmachine: Using API Version  1
	I0311 04:11:15.275713   41118 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:15.275913   41118 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:15.276027   41118 main.go:141] libmachine: (embed-certs-136000) Calling .DriverName
	I0311 04:11:15.276114   41118 main.go:141] libmachine: (embed-certs-136000) Calling .GetState
	I0311 04:11:15.276194   41118 main.go:141] libmachine: (embed-certs-136000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:15.276207   41118 main.go:141] libmachine: (embed-certs-136000) DBG | hyperkit pid from json: 0
	I0311 04:11:15.276223   41118 main.go:141] libmachine: (embed-certs-136000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000/hyperkit.json: no such file or directory
	I0311 04:11:15.276288   41118 fix.go:112] recreateIfNeeded on embed-certs-136000: state=Stopped err=<nil>
	I0311 04:11:15.276327   41118 main.go:141] libmachine: (embed-certs-136000) Calling .DriverName
	W0311 04:11:15.276414   41118 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:11:15.328680   41118 out.go:177] * Restarting existing hyperkit VM for "embed-certs-136000" ...
	I0311 04:11:15.371401   41118 main.go:141] libmachine: (embed-certs-136000) Calling .Start
	I0311 04:11:15.371671   41118 main.go:141] libmachine: (embed-certs-136000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:15.371698   41118 main.go:141] libmachine: (embed-certs-136000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000/hyperkit.pid
	I0311 04:11:15.371791   41118 main.go:141] libmachine: (embed-certs-136000) DBG | Using UUID f8b74d25-74bd-4863-8ed6-766a51582796
	I0311 04:11:15.373911   41118 main.go:141] libmachine: (embed-certs-136000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:11:15.374025   41118 fix.go:56] duration metric: took 108.929183ms for fixHost
	I0311 04:11:15.374036   41118 start.go:83] releasing machines lock for "embed-certs-136000", held for 109.002799ms
	W0311 04:11:15.374055   41118 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0311 04:11:15.374118   41118 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:11:15.374126   41118 start.go:728] Will try again in 5 seconds ...
	I0311 04:11:20.374403   41118 start.go:360] acquireMachinesLock for embed-certs-136000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:11:20.440018   41118 start.go:364] duration metric: took 65.590571ms to acquireMachinesLock for "embed-certs-136000"
	I0311 04:11:20.440072   41118 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:11:20.440079   41118 fix.go:54] fixHost starting: 
	I0311 04:11:20.440393   41118 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:20.440423   41118 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:20.448641   41118 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64213
	I0311 04:11:20.449022   41118 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:20.449393   41118 main.go:141] libmachine: Using API Version  1
	I0311 04:11:20.449414   41118 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:20.449609   41118 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:20.449719   41118 main.go:141] libmachine: (embed-certs-136000) Calling .DriverName
	I0311 04:11:20.449801   41118 main.go:141] libmachine: (embed-certs-136000) Calling .GetState
	I0311 04:11:20.449885   41118 main.go:141] libmachine: (embed-certs-136000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:20.449898   41118 main.go:141] libmachine: (embed-certs-136000) DBG | hyperkit pid from json: 0
	I0311 04:11:20.449920   41118 main.go:141] libmachine: (embed-certs-136000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000/hyperkit.json: no such file or directory
	I0311 04:11:20.449939   41118 fix.go:112] recreateIfNeeded on embed-certs-136000: state=Stopped err=<nil>
	I0311 04:11:20.449949   41118 main.go:141] libmachine: (embed-certs-136000) Calling .DriverName
	W0311 04:11:20.450035   41118 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:11:20.482065   41118 out.go:177] * Restarting existing hyperkit VM for "embed-certs-136000" ...
	I0311 04:11:20.524125   41118 main.go:141] libmachine: (embed-certs-136000) Calling .Start
	I0311 04:11:20.524303   41118 main.go:141] libmachine: (embed-certs-136000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:20.524322   41118 main.go:141] libmachine: (embed-certs-136000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000/hyperkit.pid
	I0311 04:11:20.524378   41118 main.go:141] libmachine: (embed-certs-136000) DBG | Using UUID f8b74d25-74bd-4863-8ed6-766a51582796
	I0311 04:11:20.543426   41118 main.go:141] libmachine: (embed-certs-136000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:11:20.543541   41118 fix.go:56] duration metric: took 103.460389ms for fixHost
	I0311 04:11:20.543550   41118 start.go:83] releasing machines lock for "embed-certs-136000", held for 103.499852ms
	W0311 04:11:20.543633   41118 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p embed-certs-136000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p embed-certs-136000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:11:20.586044   41118 out.go:177] 
	W0311 04:11:20.607345   41118 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:11:20.607432   41118 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:11:20.607450   41118 out.go:239] * Related issues:
	* Related issues:
	W0311 04:11:20.607482   41118 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:11:20.607554   41118 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:11:20.650150   41118 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p embed-certs-136000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000: exit status 7 (73.923888ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-136000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/SecondStart (6.01s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-345000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-345000 create -f testdata/busybox.yaml: exit status 1 (37.16587ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-345000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context default-k8s-diff-port-345000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000: exit status 7 (81.25452ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-345000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000: exit status 7 (79.476958ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-345000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.20s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p default-k8s-diff-port-345000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-345000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-345000 describe deploy/metrics-server -n kube-system: exit status 1 (37.455821ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-345000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context default-k8s-diff-port-345000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000: exit status 7 (74.254169ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-345000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.32s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (5.98s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p default-k8s-diff-port-345000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p default-k8s-diff-port-345000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (5.907138736s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-345000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "default-k8s-diff-port-345000" primary control-plane node in "default-k8s-diff-port-345000" cluster
	* Restarting existing hyperkit VM for "default-k8s-diff-port-345000" ...
	* Restarting existing hyperkit VM for "default-k8s-diff-port-345000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:11:19.966185   41175 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:11:19.966456   41175 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:19.966462   41175 out.go:304] Setting ErrFile to fd 2...
	I0311 04:11:19.966466   41175 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:19.967193   41175 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:11:19.968873   41175 out.go:298] Setting JSON to false
	I0311 04:11:19.991276   41175 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11449,"bootTime":1710144030,"procs":475,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:11:19.991370   41175 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:11:20.013544   41175 out.go:177] * [default-k8s-diff-port-345000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:11:20.056126   41175 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:11:20.056169   41175 notify.go:220] Checking for updates...
	I0311 04:11:20.078189   41175 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:11:20.099921   41175 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:11:20.121127   41175 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:11:20.142114   41175 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:11:20.163040   41175 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:11:20.184928   41175 config.go:182] Loaded profile config "default-k8s-diff-port-345000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:11:20.185645   41175 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:20.185722   41175 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:20.194810   41175 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64207
	I0311 04:11:20.195462   41175 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:20.195896   41175 main.go:141] libmachine: Using API Version  1
	I0311 04:11:20.195904   41175 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:20.196101   41175 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:20.196198   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .DriverName
	I0311 04:11:20.196394   41175 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:11:20.196625   41175 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:20.196650   41175 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:20.204627   41175 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64209
	I0311 04:11:20.204997   41175 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:20.205372   41175 main.go:141] libmachine: Using API Version  1
	I0311 04:11:20.205393   41175 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:20.205645   41175 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:20.205753   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .DriverName
	I0311 04:11:20.234187   41175 out.go:177] * Using the hyperkit driver based on existing profile
	I0311 04:11:20.275926   41175 start.go:297] selected driver: hyperkit
	I0311 04:11:20.275959   41175 start.go:901] validating driver "hyperkit" against &{Name:default-k8s-diff-port-345000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-345000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false E
xtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:11:20.276184   41175 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:11:20.280436   41175 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:11:20.280532   41175 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:11:20.288357   41175 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:11:20.292168   41175 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:20.292192   41175 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:11:20.292332   41175 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0311 04:11:20.292401   41175 cni.go:84] Creating CNI manager for ""
	I0311 04:11:20.292414   41175 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:11:20.292450   41175 start.go:340] cluster config:
	{Name:default-k8s-diff-port-345000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-345000 N
amespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-hos
t Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:11:20.292551   41175 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:11:20.334909   41175 out.go:177] * Starting "default-k8s-diff-port-345000" primary control-plane node in "default-k8s-diff-port-345000" cluster
	I0311 04:11:20.356188   41175 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 04:11:20.356268   41175 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 04:11:20.356300   41175 cache.go:56] Caching tarball of preloaded images
	I0311 04:11:20.356449   41175 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:11:20.356466   41175 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0311 04:11:20.356599   41175 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/default-k8s-diff-port-345000/config.json ...
	I0311 04:11:20.357445   41175 start.go:360] acquireMachinesLock for default-k8s-diff-port-345000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:11:20.357535   41175 start.go:364] duration metric: took 65.409µs to acquireMachinesLock for "default-k8s-diff-port-345000"
	I0311 04:11:20.357575   41175 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:11:20.357594   41175 fix.go:54] fixHost starting: 
	I0311 04:11:20.358011   41175 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:20.358053   41175 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:20.372587   41175 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64211
	I0311 04:11:20.372967   41175 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:20.373315   41175 main.go:141] libmachine: Using API Version  1
	I0311 04:11:20.373324   41175 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:20.373522   41175 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:20.373632   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .DriverName
	I0311 04:11:20.373722   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .GetState
	I0311 04:11:20.373796   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:20.373817   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | hyperkit pid from json: 0
	I0311 04:11:20.373832   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000/hyperkit.json: no such file or directory
	I0311 04:11:20.373856   41175 fix.go:112] recreateIfNeeded on default-k8s-diff-port-345000: state=Stopped err=<nil>
	I0311 04:11:20.373868   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .DriverName
	W0311 04:11:20.373940   41175 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:11:20.415806   41175 out.go:177] * Restarting existing hyperkit VM for "default-k8s-diff-port-345000" ...
	I0311 04:11:20.437148   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .Start
	I0311 04:11:20.437433   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:20.437481   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000/hyperkit.pid
	I0311 04:11:20.437537   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | Using UUID 45dc923d-cb9f-4efa-b7b8-1dd3b0beaf38
	I0311 04:11:20.439807   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:11:20.439929   41175 fix.go:56] duration metric: took 82.335544ms for fixHost
	I0311 04:11:20.439940   41175 start.go:83] releasing machines lock for "default-k8s-diff-port-345000", held for 82.394278ms
	W0311 04:11:20.439960   41175 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0311 04:11:20.440018   41175 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:11:20.440026   41175 start.go:728] Will try again in 5 seconds ...
	I0311 04:11:25.442323   41175 start.go:360] acquireMachinesLock for default-k8s-diff-port-345000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:11:25.456271   41175 start.go:364] duration metric: took 13.882427ms to acquireMachinesLock for "default-k8s-diff-port-345000"
	I0311 04:11:25.456312   41175 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:11:25.456318   41175 fix.go:54] fixHost starting: 
	I0311 04:11:25.456576   41175 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:25.456599   41175 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:25.465049   41175 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64245
	I0311 04:11:25.465434   41175 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:25.465784   41175 main.go:141] libmachine: Using API Version  1
	I0311 04:11:25.465795   41175 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:25.466023   41175 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:25.466139   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .DriverName
	I0311 04:11:25.466225   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .GetState
	I0311 04:11:25.466316   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:25.466335   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | hyperkit pid from json: 0
	I0311 04:11:25.466351   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000/hyperkit.json: no such file or directory
	I0311 04:11:25.466386   41175 fix.go:112] recreateIfNeeded on default-k8s-diff-port-345000: state=Stopped err=<nil>
	I0311 04:11:25.466409   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .DriverName
	W0311 04:11:25.466501   41175 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:11:25.509098   41175 out.go:177] * Restarting existing hyperkit VM for "default-k8s-diff-port-345000" ...
	I0311 04:11:25.575955   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .Start
	I0311 04:11:25.576241   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:25.576278   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000/hyperkit.pid
	I0311 04:11:25.576365   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | Using UUID 45dc923d-cb9f-4efa-b7b8-1dd3b0beaf38
	I0311 04:11:25.617522   41175 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:11:25.617638   41175 fix.go:56] duration metric: took 161.315345ms for fixHost
	I0311 04:11:25.617649   41175 start.go:83] releasing machines lock for "default-k8s-diff-port-345000", held for 161.364808ms
	W0311 04:11:25.617711   41175 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-345000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-345000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:11:25.661101   41175 out.go:177] 
	W0311 04:11:25.708436   41175 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:11:25.708587   41175 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:11:25.708615   41175 out.go:239] * Related issues:
	* Related issues:
	W0311 04:11:25.708645   41175 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:11:25.708674   41175 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:11:25.751858   41175 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p default-k8s-diff-port-345000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000: exit status 7 (73.849942ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-345000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (5.98s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.08s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-136000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000: exit status 7 (74.842026ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-136000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.08s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-136000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-136000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context embed-certs-136000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (37.784067ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-136000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context embed-certs-136000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000: exit status 7 (74.250577ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-136000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.11s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p embed-certs-136000 image list --format=json
start_stop_delete_test.go:304: v1.28.4 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.4",
- 	"registry.k8s.io/kube-controller-manager:v1.28.4",
- 	"registry.k8s.io/kube-proxy:v1.28.4",
- 	"registry.k8s.io/kube-scheduler:v1.28.4",
- 	"registry.k8s.io/pause:3.9",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000: exit status 7 (74.022649ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-136000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p embed-certs-136000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p embed-certs-136000 --alsologtostderr -v=1: exit status 83 (140.086475ms)

                                                
                                                
-- stdout --
	* The control-plane node embed-certs-136000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p embed-certs-136000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:11:21.217722   41204 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:11:21.217917   41204 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:21.217922   41204 out.go:304] Setting ErrFile to fd 2...
	I0311 04:11:21.217926   41204 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:21.218102   41204 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:11:21.218410   41204 out.go:298] Setting JSON to false
	I0311 04:11:21.218429   41204 mustload.go:65] Loading cluster: embed-certs-136000
	I0311 04:11:21.218698   41204 config.go:182] Loaded profile config "embed-certs-136000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:11:21.219042   41204 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:21.219097   41204 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:21.227046   41204 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64229
	I0311 04:11:21.227467   41204 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:21.227912   41204 main.go:141] libmachine: Using API Version  1
	I0311 04:11:21.227942   41204 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:21.228126   41204 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:21.228227   41204 main.go:141] libmachine: (embed-certs-136000) Calling .GetState
	I0311 04:11:21.228317   41204 main.go:141] libmachine: (embed-certs-136000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:21.228335   41204 main.go:141] libmachine: (embed-certs-136000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/embed-certs-136000/hyperkit.json: no such file or directory
	I0311 04:11:21.228342   41204 main.go:141] libmachine: (embed-certs-136000) DBG | hyperkit pid from json: 0
	I0311 04:11:21.250261   41204 out.go:177] * The control-plane node embed-certs-136000 host is not running: state=Stopped
	I0311 04:11:21.271830   41204 out.go:177]   To start a cluster, run: "minikube start -p embed-certs-136000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p embed-certs-136000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000: exit status 7 (73.567193ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-136000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000: exit status 7 (72.642664ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-136000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/Pause (0.29s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (11.42s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p newest-cni-295000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p newest-cni-295000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (11.34481451s)

                                                
                                                
-- stdout --
	* [newest-cni-295000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "newest-cni-295000" primary control-plane node in "newest-cni-295000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "newest-cni-295000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:11:22.204298   41232 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:11:22.204563   41232 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:22.204568   41232 out.go:304] Setting ErrFile to fd 2...
	I0311 04:11:22.204571   41232 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:22.204738   41232 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:11:22.206307   41232 out.go:298] Setting JSON to false
	I0311 04:11:22.228676   41232 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11452,"bootTime":1710144030,"procs":482,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:11:22.228798   41232 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:11:22.250787   41232 out.go:177] * [newest-cni-295000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:11:22.294651   41232 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:11:22.294700   41232 notify.go:220] Checking for updates...
	I0311 04:11:22.338365   41232 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:11:22.359632   41232 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:11:22.380287   41232 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:11:22.401716   41232 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:11:22.423650   41232 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:11:22.446125   41232 config.go:182] Loaded profile config "default-k8s-diff-port-345000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:11:22.446304   41232 config.go:182] Loaded profile config "multinode-496000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:11:22.446479   41232 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:11:22.476413   41232 out.go:177] * Using the hyperkit driver based on user configuration
	I0311 04:11:22.518200   41232 start.go:297] selected driver: hyperkit
	I0311 04:11:22.518221   41232 start.go:901] validating driver "hyperkit" against <nil>
	I0311 04:11:22.518263   41232 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:11:22.521327   41232 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:11:22.521440   41232 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:11:22.529184   41232 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:11:22.532927   41232 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:22.532950   41232 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:11:22.532979   41232 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	W0311 04:11:22.533016   41232 out.go:239] ! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	I0311 04:11:22.533223   41232 start_flags.go:966] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I0311 04:11:22.533288   41232 cni.go:84] Creating CNI manager for ""
	I0311 04:11:22.533304   41232 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:11:22.533310   41232 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0311 04:11:22.533376   41232 start.go:340] cluster config:
	{Name:newest-cni-295000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-295000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetr
ics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:11:22.533464   41232 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:11:22.604398   41232 out.go:177] * Starting "newest-cni-295000" primary control-plane node in "newest-cni-295000" cluster
	I0311 04:11:22.647477   41232 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0311 04:11:22.647571   41232 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0311 04:11:22.647603   41232 cache.go:56] Caching tarball of preloaded images
	I0311 04:11:22.647816   41232 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:11:22.647835   41232 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0311 04:11:22.647975   41232 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/newest-cni-295000/config.json ...
	I0311 04:11:22.648012   41232 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/newest-cni-295000/config.json: {Name:mk82224007594ec2adc3c047a5a03ed055cb82a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 04:11:22.648703   41232 start.go:360] acquireMachinesLock for newest-cni-295000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:11:22.648823   41232 start.go:364] duration metric: took 95.963µs to acquireMachinesLock for "newest-cni-295000"
	I0311 04:11:22.648873   41232 start.go:93] Provisioning new machine with config: &{Name:newest-cni-295000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-295000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube
-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:11:22.648960   41232 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:11:22.670577   41232 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:11:22.670840   41232 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:22.670915   41232 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:22.679726   41232 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64242
	I0311 04:11:22.680131   41232 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:22.680577   41232 main.go:141] libmachine: Using API Version  1
	I0311 04:11:22.680589   41232 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:22.680794   41232 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:22.680899   41232 main.go:141] libmachine: (newest-cni-295000) Calling .GetMachineName
	I0311 04:11:22.680994   41232 main.go:141] libmachine: (newest-cni-295000) Calling .DriverName
	I0311 04:11:22.681098   41232 start.go:159] libmachine.API.Create for "newest-cni-295000" (driver="hyperkit")
	I0311 04:11:22.681121   41232 client.go:168] LocalClient.Create starting
	I0311 04:11:22.681155   41232 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:11:22.681205   41232 main.go:141] libmachine: Decoding PEM data...
	I0311 04:11:22.681220   41232 main.go:141] libmachine: Parsing certificate...
	I0311 04:11:22.681278   41232 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:11:22.681314   41232 main.go:141] libmachine: Decoding PEM data...
	I0311 04:11:22.681328   41232 main.go:141] libmachine: Parsing certificate...
	I0311 04:11:22.681341   41232 main.go:141] libmachine: Running pre-create checks...
	I0311 04:11:22.681351   41232 main.go:141] libmachine: (newest-cni-295000) Calling .PreCreateCheck
	I0311 04:11:22.681426   41232 main.go:141] libmachine: (newest-cni-295000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:22.681591   41232 main.go:141] libmachine: (newest-cni-295000) Calling .GetConfigRaw
	I0311 04:11:22.692659   41232 main.go:141] libmachine: Creating machine...
	I0311 04:11:22.692668   41232 main.go:141] libmachine: (newest-cni-295000) Calling .Create
	I0311 04:11:22.692757   41232 main.go:141] libmachine: (newest-cni-295000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:22.692910   41232 main.go:141] libmachine: (newest-cni-295000) DBG | I0311 04:11:22.692749   41240 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:11:22.692943   41232 main.go:141] libmachine: (newest-cni-295000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:11:22.870895   41232 main.go:141] libmachine: (newest-cni-295000) DBG | I0311 04:11:22.870786   41240 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000/id_rsa...
	I0311 04:11:23.073133   41232 main.go:141] libmachine: (newest-cni-295000) DBG | I0311 04:11:23.073054   41240 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000/newest-cni-295000.rawdisk...
	I0311 04:11:23.073146   41232 main.go:141] libmachine: (newest-cni-295000) DBG | Writing magic tar header
	I0311 04:11:23.073155   41232 main.go:141] libmachine: (newest-cni-295000) DBG | Writing SSH key tar header
	I0311 04:11:23.073973   41232 main.go:141] libmachine: (newest-cni-295000) DBG | I0311 04:11:23.073865   41240 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000 ...
	I0311 04:11:23.437848   41232 main.go:141] libmachine: (newest-cni-295000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:23.437920   41232 main.go:141] libmachine: (newest-cni-295000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000/hyperkit.pid
	I0311 04:11:23.437942   41232 main.go:141] libmachine: (newest-cni-295000) DBG | Using UUID 765a2834-70c0-4098-b655-020f3c111066
	I0311 04:11:23.454601   41232 main.go:141] libmachine: (newest-cni-295000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:11:23.454693   41232 client.go:171] duration metric: took 773.549319ms to LocalClient.Create
	I0311 04:11:25.456217   41232 start.go:128] duration metric: took 2.807193127s to createHost
	I0311 04:11:25.456234   41232 start.go:83] releasing machines lock for "newest-cni-295000", held for 2.807357866s
	W0311 04:11:25.456251   41232 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0311 04:11:25.456566   41232 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:25.456592   41232 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:25.465042   41232 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64244
	I0311 04:11:25.465446   41232 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:25.465811   41232 main.go:141] libmachine: Using API Version  1
	I0311 04:11:25.465825   41232 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:25.466046   41232 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:25.466420   41232 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:25.466442   41232 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:25.474426   41232 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64248
	I0311 04:11:25.474765   41232 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:25.475095   41232 main.go:141] libmachine: Using API Version  1
	I0311 04:11:25.475104   41232 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:25.475296   41232 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:25.475399   41232 main.go:141] libmachine: (newest-cni-295000) Calling .GetState
	I0311 04:11:25.475481   41232 main.go:141] libmachine: (newest-cni-295000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:25.475492   41232 main.go:141] libmachine: (newest-cni-295000) DBG | hyperkit pid from json: 0
	I0311 04:11:25.475509   41232 main.go:141] libmachine: (newest-cni-295000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000/hyperkit.json: no such file or directory
	I0311 04:11:25.475548   41232 main.go:141] libmachine: (newest-cni-295000) Calling .DriverName
	I0311 04:11:25.554807   41232 out.go:177] * Deleting "newest-cni-295000" in hyperkit ...
	I0311 04:11:25.597002   41232 main.go:141] libmachine: (newest-cni-295000) Calling .Remove
	I0311 04:11:25.597256   41232 main.go:141] libmachine: (newest-cni-295000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:25.597275   41232 main.go:141] libmachine: (newest-cni-295000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:25.597288   41232 main.go:141] libmachine: (newest-cni-295000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000/hyperkit.json: no such file or directory
	I0311 04:11:25.597305   41232 main.go:141] libmachine: (newest-cni-295000) DBG | hyperkit pid from json: 0
	W0311 04:11:25.641724   41232 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:11:25.641746   41232 start.go:728] Will try again in 5 seconds ...
	I0311 04:11:30.642266   41232 start.go:360] acquireMachinesLock for newest-cni-295000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:11:30.642464   41232 start.go:364] duration metric: took 157.678µs to acquireMachinesLock for "newest-cni-295000"
	I0311 04:11:30.642511   41232 start.go:93] Provisioning new machine with config: &{Name:newest-cni-295000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-295000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube
-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0311 04:11:30.642665   41232 start.go:125] createHost starting for "" (driver="hyperkit")
	I0311 04:11:30.664726   41232 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0311 04:11:30.664866   41232 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:30.664931   41232 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:30.674834   41232 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64276
	I0311 04:11:30.675367   41232 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:30.675852   41232 main.go:141] libmachine: Using API Version  1
	I0311 04:11:30.675869   41232 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:30.676170   41232 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:30.676272   41232 main.go:141] libmachine: (newest-cni-295000) Calling .GetMachineName
	I0311 04:11:30.676358   41232 main.go:141] libmachine: (newest-cni-295000) Calling .DriverName
	I0311 04:11:30.676461   41232 start.go:159] libmachine.API.Create for "newest-cni-295000" (driver="hyperkit")
	I0311 04:11:30.676478   41232 client.go:168] LocalClient.Create starting
	I0311 04:11:30.676507   41232 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/ca.pem
	I0311 04:11:30.676553   41232 main.go:141] libmachine: Decoding PEM data...
	I0311 04:11:30.676567   41232 main.go:141] libmachine: Parsing certificate...
	I0311 04:11:30.676608   41232 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18350-36214/.minikube/certs/cert.pem
	I0311 04:11:30.676646   41232 main.go:141] libmachine: Decoding PEM data...
	I0311 04:11:30.676659   41232 main.go:141] libmachine: Parsing certificate...
	I0311 04:11:30.676671   41232 main.go:141] libmachine: Running pre-create checks...
	I0311 04:11:30.676676   41232 main.go:141] libmachine: (newest-cni-295000) Calling .PreCreateCheck
	I0311 04:11:30.676757   41232 main.go:141] libmachine: (newest-cni-295000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:30.676773   41232 main.go:141] libmachine: (newest-cni-295000) Calling .GetConfigRaw
	I0311 04:11:30.677183   41232 main.go:141] libmachine: Creating machine...
	I0311 04:11:30.677191   41232 main.go:141] libmachine: (newest-cni-295000) Calling .Create
	I0311 04:11:30.677262   41232 main.go:141] libmachine: (newest-cni-295000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:30.677382   41232 main.go:141] libmachine: (newest-cni-295000) DBG | I0311 04:11:30.677252   41293 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:11:30.677433   41232 main.go:141] libmachine: (newest-cni-295000) Downloading /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0311 04:11:30.853284   41232 main.go:141] libmachine: (newest-cni-295000) DBG | I0311 04:11:30.853189   41293 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000/id_rsa...
	I0311 04:11:30.951395   41232 main.go:141] libmachine: (newest-cni-295000) DBG | I0311 04:11:30.951307   41293 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000/newest-cni-295000.rawdisk...
	I0311 04:11:30.951410   41232 main.go:141] libmachine: (newest-cni-295000) DBG | Writing magic tar header
	I0311 04:11:30.951419   41232 main.go:141] libmachine: (newest-cni-295000) DBG | Writing SSH key tar header
	I0311 04:11:30.952151   41232 main.go:141] libmachine: (newest-cni-295000) DBG | I0311 04:11:30.952069   41293 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000 ...
	I0311 04:11:31.317132   41232 main.go:141] libmachine: (newest-cni-295000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:31.317178   41232 main.go:141] libmachine: (newest-cni-295000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000/hyperkit.pid
	I0311 04:11:31.317224   41232 main.go:141] libmachine: (newest-cni-295000) DBG | Using UUID cc5e509d-be38-4e2c-aa20-3c6ec2dedb56
	I0311 04:11:31.336550   41232 main.go:141] libmachine: (newest-cni-295000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:11:31.336637   41232 client.go:171] duration metric: took 660.142233ms to LocalClient.Create
	I0311 04:11:33.337319   41232 start.go:128] duration metric: took 2.694591076s to createHost
	I0311 04:11:33.337361   41232 start.go:83] releasing machines lock for "newest-cni-295000", held for 2.694841158s
	W0311 04:11:33.337487   41232 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p newest-cni-295000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p newest-cni-295000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:11:33.359595   41232 out.go:177] 
	W0311 04:11:33.381247   41232 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:11:33.381308   41232 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:11:33.381326   41232 out.go:239] * Related issues:
	* Related issues:
	W0311 04:11:33.381382   41232 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:11:33.381429   41232 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:11:33.424309   41232 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p newest-cni-295000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-295000 -n newest-cni-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-295000 -n newest-cni-295000: exit status 7 (75.376703ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-295000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/FirstStart (11.42s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-345000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000: exit status 7 (73.330101ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-345000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-345000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-345000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-345000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (37.679484ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-345000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context default-k8s-diff-port-345000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000: exit status 7 (74.153741ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-345000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.11s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p default-k8s-diff-port-345000 image list --format=json
start_stop_delete_test.go:304: v1.28.4 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.4",
- 	"registry.k8s.io/kube-controller-manager:v1.28.4",
- 	"registry.k8s.io/kube-proxy:v1.28.4",
- 	"registry.k8s.io/kube-scheduler:v1.28.4",
- 	"registry.k8s.io/pause:3.9",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000: exit status 7 (72.925856ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-345000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p default-k8s-diff-port-345000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p default-k8s-diff-port-345000 --alsologtostderr -v=1: exit status 83 (141.970142ms)

                                                
                                                
-- stdout --
	* The control-plane node default-k8s-diff-port-345000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p default-k8s-diff-port-345000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:11:26.319909   41262 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:11:26.320122   41262 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:26.320127   41262 out.go:304] Setting ErrFile to fd 2...
	I0311 04:11:26.320131   41262 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:26.320329   41262 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:11:26.320637   41262 out.go:298] Setting JSON to false
	I0311 04:11:26.320656   41262 mustload.go:65] Loading cluster: default-k8s-diff-port-345000
	I0311 04:11:26.320920   41262 config.go:182] Loaded profile config "default-k8s-diff-port-345000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 04:11:26.321271   41262 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:26.321316   41262 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:26.328999   41262 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64264
	I0311 04:11:26.329499   41262 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:26.329973   41262 main.go:141] libmachine: Using API Version  1
	I0311 04:11:26.329982   41262 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:26.330263   41262 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:26.330378   41262 main.go:141] libmachine: (default-k8s-diff-port-345000) Calling .GetState
	I0311 04:11:26.330482   41262 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:26.330497   41262 main.go:141] libmachine: (default-k8s-diff-port-345000) DBG | hyperkit pid from json: 0
	I0311 04:11:26.330508   41262 main.go:141] libmachine: (default-k8s-diff-port-345000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/default-k8s-diff-port-345000/hyperkit.json: no such file or directory
	I0311 04:11:26.352096   41262 out.go:177] * The control-plane node default-k8s-diff-port-345000 host is not running: state=Stopped
	I0311 04:11:26.373879   41262 out.go:177]   To start a cluster, run: "minikube start -p default-k8s-diff-port-345000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p default-k8s-diff-port-345000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000: exit status 7 (75.16269ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-345000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000: exit status 7 (73.095394ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-345000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/Pause (0.29s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (5.83s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p newest-cni-295000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p newest-cni-295000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (5.753419224s)

                                                
                                                
-- stdout --
	* [newest-cni-295000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "newest-cni-295000" primary control-plane node in "newest-cni-295000" cluster
	* Restarting existing hyperkit VM for "newest-cni-295000" ...
	* Restarting existing hyperkit VM for "newest-cni-295000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:11:37.936874   41330 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:11:37.937661   41330 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:37.937670   41330 out.go:304] Setting ErrFile to fd 2...
	I0311 04:11:37.937676   41330 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:37.938286   41330 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:11:37.939800   41330 out.go:298] Setting JSON to false
	I0311 04:11:37.962376   41330 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":11467,"bootTime":1710144030,"procs":466,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 04:11:37.962488   41330 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 04:11:37.984239   41330 out.go:177] * [newest-cni-295000] minikube v1.32.0 on Darwin 14.3.1
	I0311 04:11:38.026072   41330 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 04:11:38.026153   41330 notify.go:220] Checking for updates...
	I0311 04:11:38.068872   41330 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 04:11:38.090202   41330 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 04:11:38.111978   41330 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 04:11:38.133099   41330 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 04:11:38.154082   41330 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 04:11:38.175739   41330 config.go:182] Loaded profile config "newest-cni-295000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0311 04:11:38.176543   41330 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:38.176628   41330 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:38.185621   41330 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64307
	I0311 04:11:38.186003   41330 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:38.186447   41330 main.go:141] libmachine: Using API Version  1
	I0311 04:11:38.186457   41330 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:38.186657   41330 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:38.186789   41330 main.go:141] libmachine: (newest-cni-295000) Calling .DriverName
	I0311 04:11:38.186983   41330 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 04:11:38.187254   41330 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:38.187282   41330 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:38.194851   41330 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64309
	I0311 04:11:38.195173   41330 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:38.195486   41330 main.go:141] libmachine: Using API Version  1
	I0311 04:11:38.195496   41330 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:38.195703   41330 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:38.195802   41330 main.go:141] libmachine: (newest-cni-295000) Calling .DriverName
	I0311 04:11:38.224021   41330 out.go:177] * Using the hyperkit driver based on existing profile
	I0311 04:11:38.245011   41330 start.go:297] selected driver: hyperkit
	I0311 04:11:38.245040   41330 start.go:901] validating driver "hyperkit" against &{Name:newest-cni-295000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-295000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> Exp
osedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:11:38.245246   41330 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 04:11:38.249519   41330 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:11:38.249618   41330 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 04:11:38.257347   41330 install.go:137] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0311 04:11:38.261223   41330 install.go:79] stdout: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:38.261243   41330 install.go:81] /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0311 04:11:38.261400   41330 start_flags.go:966] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I0311 04:11:38.261460   41330 cni.go:84] Creating CNI manager for ""
	I0311 04:11:38.261474   41330 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 04:11:38.261518   41330 start.go:340] cluster config:
	{Name:newest-cni-295000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-295000 Namespace:default
APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0
CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 04:11:38.261603   41330 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 04:11:38.303812   41330 out.go:177] * Starting "newest-cni-295000" primary control-plane node in "newest-cni-295000" cluster
	I0311 04:11:38.325041   41330 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0311 04:11:38.325113   41330 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0311 04:11:38.325142   41330 cache.go:56] Caching tarball of preloaded images
	I0311 04:11:38.325329   41330 preload.go:173] Found /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0311 04:11:38.325349   41330 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0311 04:11:38.325497   41330 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/newest-cni-295000/config.json ...
	I0311 04:11:38.326393   41330 start.go:360] acquireMachinesLock for newest-cni-295000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:11:38.326493   41330 start.go:364] duration metric: took 75.037µs to acquireMachinesLock for "newest-cni-295000"
	I0311 04:11:38.326533   41330 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:11:38.326550   41330 fix.go:54] fixHost starting: 
	I0311 04:11:38.326980   41330 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:38.327030   41330 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:38.337375   41330 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64311
	I0311 04:11:38.337747   41330 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:38.338102   41330 main.go:141] libmachine: Using API Version  1
	I0311 04:11:38.338111   41330 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:38.338300   41330 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:38.338451   41330 main.go:141] libmachine: (newest-cni-295000) Calling .DriverName
	I0311 04:11:38.338550   41330 main.go:141] libmachine: (newest-cni-295000) Calling .GetState
	I0311 04:11:38.338624   41330 main.go:141] libmachine: (newest-cni-295000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:38.338638   41330 main.go:141] libmachine: (newest-cni-295000) DBG | hyperkit pid from json: 0
	I0311 04:11:38.338648   41330 main.go:141] libmachine: (newest-cni-295000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000/hyperkit.json: no such file or directory
	I0311 04:11:38.338684   41330 fix.go:112] recreateIfNeeded on newest-cni-295000: state=Stopped err=<nil>
	I0311 04:11:38.338699   41330 main.go:141] libmachine: (newest-cni-295000) Calling .DriverName
	W0311 04:11:38.338770   41330 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:11:38.382035   41330 out.go:177] * Restarting existing hyperkit VM for "newest-cni-295000" ...
	I0311 04:11:38.402975   41330 main.go:141] libmachine: (newest-cni-295000) Calling .Start
	I0311 04:11:38.403263   41330 main.go:141] libmachine: (newest-cni-295000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:38.403305   41330 main.go:141] libmachine: (newest-cni-295000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000/hyperkit.pid
	I0311 04:11:38.403383   41330 main.go:141] libmachine: (newest-cni-295000) DBG | Using UUID cc5e509d-be38-4e2c-aa20-3c6ec2dedb56
	I0311 04:11:38.405680   41330 main.go:141] libmachine: (newest-cni-295000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:11:38.405812   41330 fix.go:56] duration metric: took 79.262882ms for fixHost
	I0311 04:11:38.405824   41330 start.go:83] releasing machines lock for "newest-cni-295000", held for 79.316613ms
	W0311 04:11:38.405843   41330 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0311 04:11:38.405922   41330 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:11:38.405930   41330 start.go:728] Will try again in 5 seconds ...
	I0311 04:11:43.406460   41330 start.go:360] acquireMachinesLock for newest-cni-295000: {Name:mk3fdaa9645a09fcb3d527b7c1a7202b0acbbf61 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0311 04:11:43.406674   41330 start.go:364] duration metric: took 111.7µs to acquireMachinesLock for "newest-cni-295000"
	I0311 04:11:43.406711   41330 start.go:96] Skipping create...Using existing machine configuration
	I0311 04:11:43.406719   41330 fix.go:54] fixHost starting: 
	I0311 04:11:43.407139   41330 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:43.407179   41330 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:43.416494   41330 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64313
	I0311 04:11:43.416877   41330 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:43.417264   41330 main.go:141] libmachine: Using API Version  1
	I0311 04:11:43.417281   41330 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:43.417506   41330 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:43.417614   41330 main.go:141] libmachine: (newest-cni-295000) Calling .DriverName
	I0311 04:11:43.417700   41330 main.go:141] libmachine: (newest-cni-295000) Calling .GetState
	I0311 04:11:43.417775   41330 main.go:141] libmachine: (newest-cni-295000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:43.417788   41330 main.go:141] libmachine: (newest-cni-295000) DBG | hyperkit pid from json: 0
	I0311 04:11:43.417797   41330 main.go:141] libmachine: (newest-cni-295000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000/hyperkit.json: no such file or directory
	I0311 04:11:43.417841   41330 fix.go:112] recreateIfNeeded on newest-cni-295000: state=Stopped err=<nil>
	I0311 04:11:43.417852   41330 main.go:141] libmachine: (newest-cni-295000) Calling .DriverName
	W0311 04:11:43.417937   41330 fix.go:138] unexpected machine state, will restart: <nil>
	I0311 04:11:43.439629   41330 out.go:177] * Restarting existing hyperkit VM for "newest-cni-295000" ...
	I0311 04:11:43.483424   41330 main.go:141] libmachine: (newest-cni-295000) Calling .Start
	I0311 04:11:43.483679   41330 main.go:141] libmachine: (newest-cni-295000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:43.483718   41330 main.go:141] libmachine: (newest-cni-295000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000/hyperkit.pid
	I0311 04:11:43.483827   41330 main.go:141] libmachine: (newest-cni-295000) DBG | Using UUID cc5e509d-be38-4e2c-aa20-3c6ec2dedb56
	I0311 04:11:43.501658   41330 main.go:141] libmachine: (newest-cni-295000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0311 04:11:43.501756   41330 fix.go:56] duration metric: took 95.035133ms for fixHost
	I0311 04:11:43.501764   41330 start.go:83] releasing machines lock for "newest-cni-295000", held for 95.074691ms
	W0311 04:11:43.501828   41330 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p newest-cni-295000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p newest-cni-295000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0311 04:11:43.523534   41330 out.go:177] 
	W0311 04:11:43.544321   41330 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0311 04:11:43.544381   41330 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0311 04:11:43.544396   41330 out.go:239] * Related issues:
	* Related issues:
	W0311 04:11:43.544413   41330 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0311 04:11:43.544447   41330 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0311 04:11:43.565445   41330 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p newest-cni-295000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-295000 -n newest-cni-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-295000 -n newest-cni-295000: exit status 7 (75.258162ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-295000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/SecondStart (5.83s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p newest-cni-295000 image list --format=json
start_stop_delete_test.go:304: v1.29.0-rc.2 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.1",
- 	"registry.k8s.io/etcd:3.5.10-0",
- 	"registry.k8s.io/kube-apiserver:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-controller-manager:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-proxy:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-scheduler:v1.29.0-rc.2",
- 	"registry.k8s.io/pause:3.9",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-295000 -n newest-cni-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-295000 -n newest-cni-295000: exit status 7 (75.141652ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-295000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p newest-cni-295000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p newest-cni-295000 --alsologtostderr -v=1: exit status 83 (140.233669ms)

                                                
                                                
-- stdout --
	* The control-plane node newest-cni-295000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p newest-cni-295000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 04:11:43.949779   41352 out.go:291] Setting OutFile to fd 1 ...
	I0311 04:11:43.949980   41352 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:43.949985   41352 out.go:304] Setting ErrFile to fd 2...
	I0311 04:11:43.949989   41352 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 04:11:43.950169   41352 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 04:11:43.950470   41352 out.go:298] Setting JSON to false
	I0311 04:11:43.950488   41352 mustload.go:65] Loading cluster: newest-cni-295000
	I0311 04:11:43.950759   41352 config.go:182] Loaded profile config "newest-cni-295000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0311 04:11:43.951106   41352 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit
	I0311 04:11:43.951160   41352 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 04:11:43.958864   41352 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64323
	I0311 04:11:43.959259   41352 main.go:141] libmachine: () Calling .GetVersion
	I0311 04:11:43.959703   41352 main.go:141] libmachine: Using API Version  1
	I0311 04:11:43.959712   41352 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 04:11:43.959960   41352 main.go:141] libmachine: () Calling .GetMachineName
	I0311 04:11:43.960069   41352 main.go:141] libmachine: (newest-cni-295000) Calling .GetState
	I0311 04:11:43.960166   41352 main.go:141] libmachine: (newest-cni-295000) DBG | exe=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0311 04:11:43.960179   41352 main.go:141] libmachine: (newest-cni-295000) DBG | hyperkit pid from json: 0
	I0311 04:11:43.960191   41352 main.go:141] libmachine: (newest-cni-295000) Error reading pid file: open /Users/jenkins/minikube-integration/18350-36214/.minikube/machines/newest-cni-295000/hyperkit.json: no such file or directory
	I0311 04:11:43.981987   41352 out.go:177] * The control-plane node newest-cni-295000 host is not running: state=Stopped
	I0311 04:11:44.004125   41352 out.go:177]   To start a cluster, run: "minikube start -p newest-cni-295000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p newest-cni-295000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-295000 -n newest-cni-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-295000 -n newest-cni-295000: exit status 7 (75.427482ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-295000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-295000 -n newest-cni-295000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-295000 -n newest-cni-295000: exit status 7 (76.293896ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-295000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/Pause (0.29s)

                                                
                                    

Test pass (101/280)

Order passed test Duration
3 TestDownloadOnly/v1.20.0/json-events 43.73
4 TestDownloadOnly/v1.20.0/preload-exists 0
7 TestDownloadOnly/v1.20.0/kubectl 0
8 TestDownloadOnly/v1.20.0/LogsDuration 0.33
9 TestDownloadOnly/v1.20.0/DeleteAll 0.41
10 TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds 0.38
12 TestDownloadOnly/v1.28.4/json-events 19.75
13 TestDownloadOnly/v1.28.4/preload-exists 0
16 TestDownloadOnly/v1.28.4/kubectl 0
17 TestDownloadOnly/v1.28.4/LogsDuration 0.32
18 TestDownloadOnly/v1.28.4/DeleteAll 0.4
19 TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds 0.38
21 TestDownloadOnly/v1.29.0-rc.2/json-events 22.94
22 TestDownloadOnly/v1.29.0-rc.2/preload-exists 0
25 TestDownloadOnly/v1.29.0-rc.2/kubectl 0
26 TestDownloadOnly/v1.29.0-rc.2/LogsDuration 0.37
27 TestDownloadOnly/v1.29.0-rc.2/DeleteAll 0.4
28 TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds 0.38
30 TestBinaryMirror 1.06
34 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.2
35 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.22
36 TestAddons/Setup 205.17
38 TestAddons/parallel/Registry 18.95
39 TestAddons/parallel/Ingress 19.65
40 TestAddons/parallel/InspektorGadget 10.58
41 TestAddons/parallel/MetricsServer 6.52
42 TestAddons/parallel/HelmTiller 13.87
44 TestAddons/parallel/CSI 66.3
45 TestAddons/parallel/Headlamp 13.37
46 TestAddons/parallel/CloudSpanner 6.39
47 TestAddons/parallel/LocalPath 10.86
48 TestAddons/parallel/NvidiaDevicePlugin 5.38
49 TestAddons/parallel/Yakd 5
52 TestAddons/serial/GCPAuth/Namespaces 0.1
53 TestAddons/StoppedEnableDisable 5.95
61 TestHyperKitDriverInstallOrUpdate 10.96
65 TestErrorSpam/start 1.39
66 TestErrorSpam/status 0.23
67 TestErrorSpam/pause 0.44
68 TestErrorSpam/unpause 0.44
69 TestErrorSpam/stop 8.7
72 TestFunctional/serial/CopySyncFile 0
74 TestFunctional/serial/AuditLog 0
80 TestFunctional/serial/CacheCmd/cache/add_remote 6.03
81 TestFunctional/serial/CacheCmd/cache/add_local 1.36
82 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.09
83 TestFunctional/serial/CacheCmd/cache/list 0.09
86 TestFunctional/serial/CacheCmd/cache/delete 0.18
95 TestFunctional/parallel/ConfigCmd 0.63
97 TestFunctional/parallel/DryRun 0.99
98 TestFunctional/parallel/InternationalLanguage 0.5
104 TestFunctional/parallel/AddonsCmd 0.28
119 TestFunctional/parallel/License 1.39
120 TestFunctional/parallel/Version/short 0.11
127 TestFunctional/parallel/ImageCommands/Setup 5.28
140 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0.02
148 TestFunctional/parallel/ImageCommands/ImageRemove 0.2
150 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.21
151 TestFunctional/parallel/ProfileCmd/profile_not_create 0.27
152 TestFunctional/parallel/ProfileCmd/profile_list 0.24
153 TestFunctional/parallel/ProfileCmd/profile_json_output 0.24
158 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil 10.02
160 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.13
161 TestFunctional/delete_addon-resizer_images 0.13
162 TestFunctional/delete_my-image_image 0.05
163 TestFunctional/delete_minikube_cached_images 0.05
192 TestJSONOutput/start/Audit 0
198 TestJSONOutput/pause/Audit 0
200 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
201 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
204 TestJSONOutput/unpause/Audit 0
206 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
207 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
209 TestJSONOutput/stop/Command 1.96
210 TestJSONOutput/stop/Audit 0
212 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
213 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
214 TestErrorJSONOutput 0.78
219 TestMainNoArgs 0.09
264 TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current 2.67
265 TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current 6.11
266 TestStoppedBinaryUpgrade/Setup 4.54
279 TestNoKubernetes/serial/StartNoK8sWithVersion 0.4
283 TestNoKubernetes/serial/VerifyK8sNotRunning 0.14
284 TestNoKubernetes/serial/ProfileList 0.33
285 TestNoKubernetes/serial/Stop 3.68
287 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.14
303 TestStartStop/group/old-k8s-version/serial/Stop 2
304 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.33
308 TestStartStop/group/no-preload/serial/Stop 3.64
309 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.33
325 TestStartStop/group/embed-certs/serial/Stop 3.36
326 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.33
330 TestStartStop/group/default-k8s-diff-port/serial/Stop 3.46
331 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.34
343 TestStartStop/group/newest-cni/serial/DeployApp 0
344 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 0.21
345 TestStartStop/group/newest-cni/serial/Stop 3.76
346 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.34
348 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
349 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
x
+
TestDownloadOnly/v1.20.0/json-events (43.73s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-563000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=hyperkit 
aaa_download_only_test.go:81: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-563000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=hyperkit : (43.72553649s)
--- PASS: TestDownloadOnly/v1.20.0/json-events (43.73s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/preload-exists
--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/kubectl
--- PASS: TestDownloadOnly/v1.20.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/LogsDuration (0.33s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-563000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-563000: exit status 85 (330.296259ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-563000 | jenkins | v1.32.0 | 11 Mar 24 03:46 PDT |          |
	|         | -p download-only-563000        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=hyperkit              |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/11 03:46:13
	Running on machine: MacOS-Agent-1
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0311 03:46:13.767170   36665 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:46:13.767427   36665 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:46:13.767433   36665 out.go:304] Setting ErrFile to fd 2...
	I0311 03:46:13.767436   36665 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:46:13.767624   36665 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	W0311 03:46:13.767726   36665 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/18350-36214/.minikube/config/config.json: open /Users/jenkins/minikube-integration/18350-36214/.minikube/config/config.json: no such file or directory
	I0311 03:46:13.769515   36665 out.go:298] Setting JSON to true
	I0311 03:46:13.792430   36665 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":9943,"bootTime":1710144030,"procs":465,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 03:46:13.792595   36665 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 03:46:13.814796   36665 out.go:97] [download-only-563000] minikube v1.32.0 on Darwin 14.3.1
	I0311 03:46:13.836354   36665 out.go:169] MINIKUBE_LOCATION=18350
	I0311 03:46:13.815003   36665 notify.go:220] Checking for updates...
	W0311 03:46:13.815002   36665 preload.go:294] Failed to list preload files: open /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball: no such file or directory
	I0311 03:46:13.879508   36665 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 03:46:13.900640   36665 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 03:46:13.921675   36665 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 03:46:13.964681   36665 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	W0311 03:46:14.007538   36665 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0311 03:46:14.008169   36665 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 03:46:14.038687   36665 out.go:97] Using the hyperkit driver based on user configuration
	I0311 03:46:14.038748   36665 start.go:297] selected driver: hyperkit
	I0311 03:46:14.038766   36665 start.go:901] validating driver "hyperkit" against <nil>
	I0311 03:46:14.038958   36665 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 03:46:14.039223   36665 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 03:46:14.185624   36665 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0311 03:46:14.189796   36665 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:46:14.189825   36665 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0311 03:46:14.189858   36665 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 03:46:14.193237   36665 start_flags.go:393] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB
	I0311 03:46:14.193380   36665 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0311 03:46:14.193437   36665 cni.go:84] Creating CNI manager for ""
	I0311 03:46:14.193452   36665 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0311 03:46:14.193522   36665 start.go:340] cluster config:
	{Name:download-only-563000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:6000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-563000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 03:46:14.193747   36665 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 03:46:14.215207   36665 out.go:97] Downloading VM boot image ...
	I0311 03:46:14.215312   36665 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso.sha256 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso
	I0311 03:46:29.187080   36665 out.go:97] Starting "download-only-563000" primary control-plane node in "download-only-563000" cluster
	I0311 03:46:29.187118   36665 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0311 03:46:29.478581   36665 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0311 03:46:29.478633   36665 cache.go:56] Caching tarball of preloaded images
	I0311 03:46:29.478976   36665 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0311 03:46:29.500882   36665 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I0311 03:46:29.500911   36665 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...
	I0311 03:46:30.060819   36665 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4?checksum=md5:9a82241e9b8b4ad2b5cca73108f2c7a3 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0311 03:46:46.454575   36665 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...
	I0311 03:46:46.454746   36665 preload.go:255] verifying checksum of /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...
	I0311 03:46:47.009517   36665 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0311 03:46:47.009775   36665 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/download-only-563000/config.json ...
	I0311 03:46:47.009799   36665 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/download-only-563000/config.json: {Name:mk84e8fcbb72cfdd1df3f4862133fac4516d5c32 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 03:46:47.010087   36665 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0311 03:46:47.010445   36665 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/amd64/kubectl.sha256 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/darwin/amd64/v1.20.0/kubectl
	
	
	* The control-plane node download-only-563000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-563000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.33s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAll (0.41s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-amd64 delete --all
--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (0.41s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.38s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-563000
--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.38s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/json-events (19.75s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-767000 --force --alsologtostderr --kubernetes-version=v1.28.4 --container-runtime=docker --driver=hyperkit 
aaa_download_only_test.go:81: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-767000 --force --alsologtostderr --kubernetes-version=v1.28.4 --container-runtime=docker --driver=hyperkit : (19.746774723s)
--- PASS: TestDownloadOnly/v1.28.4/json-events (19.75s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/preload-exists
--- PASS: TestDownloadOnly/v1.28.4/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/kubectl
--- PASS: TestDownloadOnly/v1.28.4/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/LogsDuration (0.32s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-767000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-767000: exit status 85 (320.3659ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-563000 | jenkins | v1.32.0 | 11 Mar 24 03:46 PDT |                     |
	|         | -p download-only-563000        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |                     |
	|         | --container-runtime=docker     |                      |         |         |                     |                     |
	|         | --driver=hyperkit              |                      |         |         |                     |                     |
	| delete  | --all                          | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:46 PDT | 11 Mar 24 03:46 PDT |
	| delete  | -p download-only-563000        | download-only-563000 | jenkins | v1.32.0 | 11 Mar 24 03:46 PDT | 11 Mar 24 03:46 PDT |
	| start   | -o=json --download-only        | download-only-767000 | jenkins | v1.32.0 | 11 Mar 24 03:46 PDT |                     |
	|         | -p download-only-767000        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.28.4   |                      |         |         |                     |                     |
	|         | --container-runtime=docker     |                      |         |         |                     |                     |
	|         | --driver=hyperkit              |                      |         |         |                     |                     |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/11 03:46:58
	Running on machine: MacOS-Agent-1
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0311 03:46:58.614809   36708 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:46:58.615065   36708 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:46:58.615070   36708 out.go:304] Setting ErrFile to fd 2...
	I0311 03:46:58.615074   36708 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:46:58.615250   36708 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:46:58.616594   36708 out.go:298] Setting JSON to true
	I0311 03:46:58.638802   36708 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":9988,"bootTime":1710144030,"procs":453,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 03:46:58.638895   36708 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 03:46:58.660723   36708 out.go:97] [download-only-767000] minikube v1.32.0 on Darwin 14.3.1
	I0311 03:46:58.681562   36708 out.go:169] MINIKUBE_LOCATION=18350
	I0311 03:46:58.660885   36708 notify.go:220] Checking for updates...
	I0311 03:46:58.725393   36708 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 03:46:58.746578   36708 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 03:46:58.767644   36708 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 03:46:58.788463   36708 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	W0311 03:46:58.830588   36708 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0311 03:46:58.831122   36708 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 03:46:58.860359   36708 out.go:97] Using the hyperkit driver based on user configuration
	I0311 03:46:58.860423   36708 start.go:297] selected driver: hyperkit
	I0311 03:46:58.860440   36708 start.go:901] validating driver "hyperkit" against <nil>
	I0311 03:46:58.860623   36708 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 03:46:58.860836   36708 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 03:46:58.869909   36708 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0311 03:46:58.873795   36708 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:46:58.873817   36708 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0311 03:46:58.873842   36708 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 03:46:58.876442   36708 start_flags.go:393] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB
	I0311 03:46:58.876631   36708 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0311 03:46:58.876692   36708 cni.go:84] Creating CNI manager for ""
	I0311 03:46:58.876707   36708 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 03:46:58.876716   36708 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0311 03:46:58.876789   36708 start.go:340] cluster config:
	{Name:download-only-767000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:6000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:download-only-767000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 03:46:58.876876   36708 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 03:46:58.897594   36708 out.go:97] Starting "download-only-767000" primary control-plane node in "download-only-767000" cluster
	I0311 03:46:58.897626   36708 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 03:46:59.335680   36708 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.4/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0311 03:46:59.335711   36708 cache.go:56] Caching tarball of preloaded images
	I0311 03:46:59.335906   36708 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0311 03:46:59.359686   36708 out.go:97] Downloading Kubernetes v1.28.4 preload ...
	I0311 03:46:59.359720   36708 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 ...
	I0311 03:46:59.909893   36708 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.4/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4?checksum=md5:7ebdea7754e21f51b865dbfc36b53b7d -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	
	
	* The control-plane node download-only-767000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-767000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.4/LogsDuration (0.32s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/DeleteAll (0.4s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-amd64 delete --all
--- PASS: TestDownloadOnly/v1.28.4/DeleteAll (0.40s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds (0.38s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-767000
--- PASS: TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds (0.38s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/json-events (22.94s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-023000 --force --alsologtostderr --kubernetes-version=v1.29.0-rc.2 --container-runtime=docker --driver=hyperkit 
aaa_download_only_test.go:81: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-023000 --force --alsologtostderr --kubernetes-version=v1.29.0-rc.2 --container-runtime=docker --driver=hyperkit : (22.93671302s)
--- PASS: TestDownloadOnly/v1.29.0-rc.2/json-events (22.94s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/preload-exists
--- PASS: TestDownloadOnly/v1.29.0-rc.2/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/kubectl
--- PASS: TestDownloadOnly/v1.29.0-rc.2/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/LogsDuration (0.37s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-023000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-023000: exit status 85 (365.791492ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |               Args                |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only           | download-only-563000 | jenkins | v1.32.0 | 11 Mar 24 03:46 PDT |                     |
	|         | -p download-only-563000           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0      |                      |         |         |                     |                     |
	|         | --container-runtime=docker        |                      |         |         |                     |                     |
	|         | --driver=hyperkit                 |                      |         |         |                     |                     |
	| delete  | --all                             | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:46 PDT | 11 Mar 24 03:46 PDT |
	| delete  | -p download-only-563000           | download-only-563000 | jenkins | v1.32.0 | 11 Mar 24 03:46 PDT | 11 Mar 24 03:46 PDT |
	| start   | -o=json --download-only           | download-only-767000 | jenkins | v1.32.0 | 11 Mar 24 03:46 PDT |                     |
	|         | -p download-only-767000           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.28.4      |                      |         |         |                     |                     |
	|         | --container-runtime=docker        |                      |         |         |                     |                     |
	|         | --driver=hyperkit                 |                      |         |         |                     |                     |
	| delete  | --all                             | minikube             | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT | 11 Mar 24 03:47 PDT |
	| delete  | -p download-only-767000           | download-only-767000 | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT | 11 Mar 24 03:47 PDT |
	| start   | -o=json --download-only           | download-only-023000 | jenkins | v1.32.0 | 11 Mar 24 03:47 PDT |                     |
	|         | -p download-only-023000           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.29.0-rc.2 |                      |         |         |                     |                     |
	|         | --container-runtime=docker        |                      |         |         |                     |                     |
	|         | --driver=hyperkit                 |                      |         |         |                     |                     |
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/11 03:47:19
	Running on machine: MacOS-Agent-1
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0311 03:47:19.470753   36744 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:47:19.471039   36744 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:47:19.471046   36744 out.go:304] Setting ErrFile to fd 2...
	I0311 03:47:19.471052   36744 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:47:19.471404   36744 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:47:19.472999   36744 out.go:298] Setting JSON to true
	I0311 03:47:19.495920   36744 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":10009,"bootTime":1710144030,"procs":453,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 03:47:19.496018   36744 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 03:47:19.517541   36744 out.go:97] [download-only-023000] minikube v1.32.0 on Darwin 14.3.1
	I0311 03:47:19.517761   36744 notify.go:220] Checking for updates...
	I0311 03:47:19.539248   36744 out.go:169] MINIKUBE_LOCATION=18350
	I0311 03:47:19.560246   36744 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 03:47:19.582485   36744 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 03:47:19.624929   36744 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 03:47:19.646451   36744 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	W0311 03:47:19.690057   36744 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0311 03:47:19.690693   36744 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 03:47:19.721089   36744 out.go:97] Using the hyperkit driver based on user configuration
	I0311 03:47:19.721140   36744 start.go:297] selected driver: hyperkit
	I0311 03:47:19.721155   36744 start.go:901] validating driver "hyperkit" against <nil>
	I0311 03:47:19.721360   36744 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 03:47:19.721620   36744 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18350-36214/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0311 03:47:19.730573   36744 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0311 03:47:19.734336   36744 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:47:19.734356   36744 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0311 03:47:19.734383   36744 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0311 03:47:19.736972   36744 start_flags.go:393] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB
	I0311 03:47:19.737139   36744 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0311 03:47:19.737205   36744 cni.go:84] Creating CNI manager for ""
	I0311 03:47:19.737220   36744 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0311 03:47:19.737231   36744 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0311 03:47:19.737306   36744 start.go:340] cluster config:
	{Name:download-only-023000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:6000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:download-only-023000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l
ocal ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 03:47:19.737401   36744 iso.go:125] acquiring lock: {Name:mkba9becba312b7fbb311a74b6252f9961860037 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0311 03:47:19.759207   36744 out.go:97] Starting "download-only-023000" primary control-plane node in "download-only-023000" cluster
	I0311 03:47:19.759240   36744 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0311 03:47:20.213923   36744 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.29.0-rc.2/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0311 03:47:20.213962   36744 cache.go:56] Caching tarball of preloaded images
	I0311 03:47:20.214313   36744 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0311 03:47:20.236075   36744 out.go:97] Downloading Kubernetes v1.29.0-rc.2 preload ...
	I0311 03:47:20.236105   36744 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 ...
	I0311 03:47:20.793901   36744 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.29.0-rc.2/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4?checksum=md5:47acda482c3add5b56147c92b8d7f468 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0311 03:47:35.955947   36744 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 ...
	I0311 03:47:35.956169   36744 preload.go:255] verifying checksum of /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 ...
	I0311 03:47:36.462167   36744 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0311 03:47:36.462412   36744 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/download-only-023000/config.json ...
	I0311 03:47:36.462437   36744 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/download-only-023000/config.json: {Name:mkdd6ba12972fa9444e97cc92cf1839c72aa8efc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0311 03:47:36.462763   36744 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0311 03:47:36.463017   36744 download.go:107] Downloading: https://dl.k8s.io/release/v1.29.0-rc.2/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.29.0-rc.2/bin/darwin/amd64/kubectl.sha256 -> /Users/jenkins/minikube-integration/18350-36214/.minikube/cache/darwin/amd64/v1.29.0-rc.2/kubectl
	
	
	* The control-plane node download-only-023000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-023000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.29.0-rc.2/LogsDuration (0.37s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/DeleteAll (0.4s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-amd64 delete --all
--- PASS: TestDownloadOnly/v1.29.0-rc.2/DeleteAll (0.40s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds (0.38s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-023000
--- PASS: TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds (0.38s)

                                                
                                    
x
+
TestBinaryMirror (1.06s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-darwin-amd64 start --download-only -p binary-mirror-399000 --alsologtostderr --binary-mirror http://127.0.0.1:61560 --driver=hyperkit 
helpers_test.go:175: Cleaning up "binary-mirror-399000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p binary-mirror-399000
--- PASS: TestBinaryMirror (1.06s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.2s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:928: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p addons-725000
addons_test.go:928: (dbg) Non-zero exit: out/minikube-darwin-amd64 addons enable dashboard -p addons-725000: exit status 85 (201.738956ms)

                                                
                                                
-- stdout --
	* Profile "addons-725000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-725000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.20s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.22s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:939: (dbg) Run:  out/minikube-darwin-amd64 addons disable dashboard -p addons-725000
addons_test.go:939: (dbg) Non-zero exit: out/minikube-darwin-amd64 addons disable dashboard -p addons-725000: exit status 85 (222.103736ms)

                                                
                                                
-- stdout --
	* Profile "addons-725000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-725000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.22s)

                                                
                                    
x
+
TestAddons/Setup (205.17s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:109: (dbg) Run:  out/minikube-darwin-amd64 start -p addons-725000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller
addons_test.go:109: (dbg) Done: out/minikube-darwin-amd64 start -p addons-725000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller: (3m25.173072957s)
--- PASS: TestAddons/Setup (205.17s)

                                                
                                    
x
+
TestAddons/parallel/Registry (18.95s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:330: registry stabilized in 11.820561ms
addons_test.go:332: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-6rbxh" [19a0b0d9-c0e2-417e-b0f7-6fcedbab7a1c] Running
addons_test.go:332: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.005759975s
addons_test.go:335: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-hwv2s" [6fec7a29-c6d4-4deb-b473-3a5654abb70c] Running
addons_test.go:335: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.004477364s
addons_test.go:340: (dbg) Run:  kubectl --context addons-725000 delete po -l run=registry-test --now
addons_test.go:345: (dbg) Run:  kubectl --context addons-725000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:345: (dbg) Done: kubectl --context addons-725000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (8.142999668s)
addons_test.go:359: (dbg) Run:  out/minikube-darwin-amd64 -p addons-725000 ip
2024/03/11 03:51:29 [DEBUG] GET http://192.169.0.5:5000
addons_test.go:388: (dbg) Run:  out/minikube-darwin-amd64 -p addons-725000 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (18.95s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (19.65s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:207: (dbg) Run:  kubectl --context addons-725000 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:232: (dbg) Run:  kubectl --context addons-725000 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:245: (dbg) Run:  kubectl --context addons-725000 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [95a532fb-e0d6-4295-aa6c-a023dbd39540] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [95a532fb-e0d6-4295-aa6c-a023dbd39540] Running
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 10.005720025s
addons_test.go:262: (dbg) Run:  out/minikube-darwin-amd64 -p addons-725000 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:286: (dbg) Run:  kubectl --context addons-725000 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:291: (dbg) Run:  out/minikube-darwin-amd64 -p addons-725000 ip
addons_test.go:297: (dbg) Run:  nslookup hello-john.test 192.169.0.5
addons_test.go:306: (dbg) Run:  out/minikube-darwin-amd64 -p addons-725000 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:306: (dbg) Done: out/minikube-darwin-amd64 -p addons-725000 addons disable ingress-dns --alsologtostderr -v=1: (1.177277731s)
addons_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 -p addons-725000 addons disable ingress --alsologtostderr -v=1
addons_test.go:311: (dbg) Done: out/minikube-darwin-amd64 -p addons-725000 addons disable ingress --alsologtostderr -v=1: (7.50986228s)
--- PASS: TestAddons/parallel/Ingress (19.65s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.58s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:838: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-lr9k6" [90fde7d3-5f6b-4aeb-aa2d-118d918c546a] Running / Ready:ContainersNotReady (containers with unready status: [gadget]) / ContainersReady:ContainersNotReady (containers with unready status: [gadget])
addons_test.go:838: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.003426887s
addons_test.go:841: (dbg) Run:  out/minikube-darwin-amd64 addons disable inspektor-gadget -p addons-725000
addons_test.go:841: (dbg) Done: out/minikube-darwin-amd64 addons disable inspektor-gadget -p addons-725000: (5.579025541s)
--- PASS: TestAddons/parallel/InspektorGadget (10.58s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (6.52s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:407: metrics-server stabilized in 2.847704ms
addons_test.go:409: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-69cf46c98-2c8r7" [ff5d3010-f09c-400a-875a-1669bedc3797] Running
addons_test.go:409: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 6.002899474s
addons_test.go:415: (dbg) Run:  kubectl --context addons-725000 top pods -n kube-system
addons_test.go:432: (dbg) Run:  out/minikube-darwin-amd64 -p addons-725000 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (6.52s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (13.87s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:456: tiller-deploy stabilized in 6.624054ms
addons_test.go:458: (dbg) TestAddons/parallel/HelmTiller: waiting 6m0s for pods matching "app=helm" in namespace "kube-system" ...
helpers_test.go:344: "tiller-deploy-7b677967b9-nkv6q" [5352d221-9354-460e-b3fd-fd5083fce5a5] Running
addons_test.go:458: (dbg) TestAddons/parallel/HelmTiller: app=helm healthy within 5.005799995s
addons_test.go:473: (dbg) Run:  kubectl --context addons-725000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version
addons_test.go:473: (dbg) Done: kubectl --context addons-725000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version: (5.347590389s)
addons_test.go:478: kubectl --context addons-725000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version: unexpected stderr: Unable to use a TTY - input is not a terminal or the right kind of file
If you don't see a command prompt, try pressing enter.
warning: couldn't attach to pod/helm-test, falling back to streaming logs: 
addons_test.go:473: (dbg) Run:  kubectl --context addons-725000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version
addons_test.go:473: (dbg) Done: kubectl --context addons-725000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version: (2.438337339s)
addons_test.go:490: (dbg) Run:  out/minikube-darwin-amd64 -p addons-725000 addons disable helm-tiller --alsologtostderr -v=1
--- PASS: TestAddons/parallel/HelmTiller (13.87s)

                                                
                                    
x
+
TestAddons/parallel/CSI (66.3s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:561: csi-hostpath-driver pods stabilized in 12.359218ms
addons_test.go:564: (dbg) Run:  kubectl --context addons-725000 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:569: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:574: (dbg) Run:  kubectl --context addons-725000 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:579: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [f0b3a47e-a227-49b2-974f-346d97d079c2] Pending
helpers_test.go:344: "task-pv-pod" [f0b3a47e-a227-49b2-974f-346d97d079c2] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [f0b3a47e-a227-49b2-974f-346d97d079c2] Running
addons_test.go:579: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 16.002893932s
addons_test.go:584: (dbg) Run:  kubectl --context addons-725000 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:589: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-725000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-725000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:594: (dbg) Run:  kubectl --context addons-725000 delete pod task-pv-pod
addons_test.go:600: (dbg) Run:  kubectl --context addons-725000 delete pvc hpvc
addons_test.go:606: (dbg) Run:  kubectl --context addons-725000 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:611: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:616: (dbg) Run:  kubectl --context addons-725000 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:621: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [7ed2b86b-584d-4166-9194-81473bbe6dd4] Pending
helpers_test.go:344: "task-pv-pod-restore" [7ed2b86b-584d-4166-9194-81473bbe6dd4] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [7ed2b86b-584d-4166-9194-81473bbe6dd4] Running
addons_test.go:621: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 8.003039178s
addons_test.go:626: (dbg) Run:  kubectl --context addons-725000 delete pod task-pv-pod-restore
addons_test.go:626: (dbg) Done: kubectl --context addons-725000 delete pod task-pv-pod-restore: (1.118563891s)
addons_test.go:630: (dbg) Run:  kubectl --context addons-725000 delete pvc hpvc-restore
addons_test.go:634: (dbg) Run:  kubectl --context addons-725000 delete volumesnapshot new-snapshot-demo
addons_test.go:638: (dbg) Run:  out/minikube-darwin-amd64 -p addons-725000 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:638: (dbg) Done: out/minikube-darwin-amd64 -p addons-725000 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.516138081s)
addons_test.go:642: (dbg) Run:  out/minikube-darwin-amd64 -p addons-725000 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (66.30s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (13.37s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:824: (dbg) Run:  out/minikube-darwin-amd64 addons enable headlamp -p addons-725000 --alsologtostderr -v=1
addons_test.go:824: (dbg) Done: out/minikube-darwin-amd64 addons enable headlamp -p addons-725000 --alsologtostderr -v=1: (1.36188186s)
addons_test.go:829: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-5485c556b-hnpns" [6ea3494d-ae4a-46bf-afc9-906140672520] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-5485c556b-hnpns" [6ea3494d-ae4a-46bf-afc9-906140672520] Running / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-5485c556b-hnpns" [6ea3494d-ae4a-46bf-afc9-906140672520] Running
addons_test.go:829: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 12.004189015s
--- PASS: TestAddons/parallel/Headlamp (13.37s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (6.39s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:857: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-6548d5df46-tfhqv" [9f1eccf3-7ddb-44e7-8a38-52c8843824ed] Running
addons_test.go:857: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 6.004845037s
addons_test.go:860: (dbg) Run:  out/minikube-darwin-amd64 addons disable cloud-spanner -p addons-725000
--- PASS: TestAddons/parallel/CloudSpanner (6.39s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (10.86s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:873: (dbg) Run:  kubectl --context addons-725000 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:879: (dbg) Run:  kubectl --context addons-725000 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:883: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-725000 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:886: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [53b211c8-8da5-4384-aa87-ff6915832f90] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [53b211c8-8da5-4384-aa87-ff6915832f90] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [53b211c8-8da5-4384-aa87-ff6915832f90] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:886: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 4.004724435s
addons_test.go:891: (dbg) Run:  kubectl --context addons-725000 get pvc test-pvc -o=json
addons_test.go:900: (dbg) Run:  out/minikube-darwin-amd64 -p addons-725000 ssh "cat /opt/local-path-provisioner/pvc-1e753a32-583c-4106-8a48-b945667fce5e_default_test-pvc/file1"
addons_test.go:912: (dbg) Run:  kubectl --context addons-725000 delete pod test-local-path
addons_test.go:916: (dbg) Run:  kubectl --context addons-725000 delete pvc test-pvc
addons_test.go:920: (dbg) Run:  out/minikube-darwin-amd64 -p addons-725000 addons disable storage-provisioner-rancher --alsologtostderr -v=1
--- PASS: TestAddons/parallel/LocalPath (10.86s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (5.38s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:952: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-4wbvk" [24d0776a-ee67-47c0-aa48-5853d5a94109] Running
addons_test.go:952: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 5.004345402s
addons_test.go:955: (dbg) Run:  out/minikube-darwin-amd64 addons disable nvidia-device-plugin -p addons-725000
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (5.38s)

                                                
                                    
x
+
TestAddons/parallel/Yakd (5s)

                                                
                                                
=== RUN   TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Yakd
addons_test.go:963: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:344: "yakd-dashboard-9947fc6bf-4cmm2" [bbc2c909-862d-4ba2-ad4b-43fcdea9a7ca] Running
addons_test.go:963: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 5.00427476s
--- PASS: TestAddons/parallel/Yakd (5.00s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.1s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:650: (dbg) Run:  kubectl --context addons-725000 create ns new-namespace
addons_test.go:664: (dbg) Run:  kubectl --context addons-725000 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.10s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (5.95s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:172: (dbg) Run:  out/minikube-darwin-amd64 stop -p addons-725000
addons_test.go:172: (dbg) Done: out/minikube-darwin-amd64 stop -p addons-725000: (5.390544311s)
addons_test.go:176: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p addons-725000
addons_test.go:180: (dbg) Run:  out/minikube-darwin-amd64 addons disable dashboard -p addons-725000
addons_test.go:185: (dbg) Run:  out/minikube-darwin-amd64 addons disable gvisor -p addons-725000
--- PASS: TestAddons/StoppedEnableDisable (5.95s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (10.96s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
=== PAUSE TestHyperKitDriverInstallOrUpdate

                                                
                                                

                                                
                                                
=== CONT  TestHyperKitDriverInstallOrUpdate
* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:

                                                
                                                
$ sudo chown root:wheel /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current3923528259/001/.minikube/bin/docker-machine-driver-hyperkit 
$ sudo chmod u+s /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current3923528259/001/.minikube/bin/docker-machine-driver-hyperkit 

                                                
                                                

                                                
                                                
! Unable to update hyperkit driver: [sudo chown root:wheel /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current3923528259/001/.minikube/bin/docker-machine-driver-hyperkit] requires a password, and --interactive=false
* Starting "minikube" primary control-plane node in "minikube" cluster
* Download complete!
--- PASS: TestHyperKitDriverInstallOrUpdate (10.96s)

                                                
                                    
x
+
TestErrorSpam/start (1.39s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 start --dry-run
--- PASS: TestErrorSpam/start (1.39s)

                                                
                                    
x
+
TestErrorSpam/status (0.23s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 status
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 status: exit status 7 (74.751624ms)

                                                
                                                
-- stdout --
	nospam-191000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 status" failed: exit status 7
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 status
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 status: exit status 7 (74.421772ms)

                                                
                                                
-- stdout --
	nospam-191000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 status" failed: exit status 7
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 status
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 status: exit status 7 (75.164862ms)

                                                
                                                
-- stdout --
	nospam-191000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 status" failed: exit status 7
--- PASS: TestErrorSpam/status (0.23s)

                                                
                                    
x
+
TestErrorSpam/pause (0.44s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 pause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 pause: exit status 83 (164.766002ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-191000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-191000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 pause" failed: exit status 83
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 pause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 pause: exit status 83 (139.825214ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-191000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-191000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 pause" failed: exit status 83
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 pause
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 pause: exit status 83 (138.671155ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-191000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-191000"

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 pause" failed: exit status 83
--- PASS: TestErrorSpam/pause (0.44s)

                                                
                                    
x
+
TestErrorSpam/unpause (0.44s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 unpause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 unpause: exit status 83 (140.756152ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-191000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-191000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 unpause" failed: exit status 83
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 unpause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 unpause: exit status 83 (159.307947ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-191000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-191000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 unpause" failed: exit status 83
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 unpause
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 unpause: exit status 83 (138.184696ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-191000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-191000"

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 unpause" failed: exit status 83
--- PASS: TestErrorSpam/unpause (0.44s)

                                                
                                    
x
+
TestErrorSpam/stop (8.7s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 stop
error_spam_test.go:159: (dbg) Done: out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 stop: (3.039296386s)
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 stop
error_spam_test.go:159: (dbg) Done: out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 stop: (2.230257988s)
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 stop
error_spam_test.go:182: (dbg) Done: out/minikube-darwin-amd64 -p nospam-191000 --log_dir /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/nospam-191000 stop: (3.425857088s)
--- PASS: TestErrorSpam/stop (8.70s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /Users/jenkins/minikube-integration/18350-36214/.minikube/files/etc/test/nested/copy/36663/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (6.03s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Done: out/minikube-darwin-amd64 -p functional-196000 cache add registry.k8s.io/pause:3.1: (2.12519285s)
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Done: out/minikube-darwin-amd64 -p functional-196000 cache add registry.k8s.io/pause:3.3: (2.104814982s)
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 cache add registry.k8s.io/pause:latest
functional_test.go:1045: (dbg) Done: out/minikube-darwin-amd64 -p functional-196000 cache add registry.k8s.io/pause:latest: (1.798203455s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (6.03s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.36s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-196000 /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalserialCacheCmdcacheadd_local2683571477/001
functional_test.go:1085: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 cache add minikube-local-cache-test:functional-196000
functional_test.go:1090: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 cache delete minikube-local-cache-test:functional-196000
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-196000
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.36s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-darwin-amd64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.18s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.63s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 config get cpus: exit status 14 (63.1905ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 config get cpus: exit status 14 (117.904744ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.63s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.99s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-196000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit 
functional_test.go:970: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-196000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit : exit status 23 (534.372433ms)

                                                
                                                
-- stdout --
	* [functional-196000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:55:04.881115   37776 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:55:04.881281   37776 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:55:04.881286   37776 out.go:304] Setting ErrFile to fd 2...
	I0311 03:55:04.881290   37776 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:55:04.881478   37776 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:55:04.882837   37776 out.go:298] Setting JSON to false
	I0311 03:55:04.905508   37776 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":10474,"bootTime":1710144030,"procs":468,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 03:55:04.905599   37776 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 03:55:04.927557   37776 out.go:177] * [functional-196000] minikube v1.32.0 on Darwin 14.3.1
	I0311 03:55:04.992454   37776 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 03:55:04.970351   37776 notify.go:220] Checking for updates...
	I0311 03:55:05.035456   37776 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 03:55:05.079309   37776 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 03:55:05.107748   37776 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 03:55:05.128139   37776 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 03:55:05.149077   37776 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 03:55:05.170779   37776 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:55:05.171403   37776 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:55:05.171462   37776 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:55:05.180412   37776 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62271
	I0311 03:55:05.180783   37776 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:55:05.181223   37776 main.go:141] libmachine: Using API Version  1
	I0311 03:55:05.181234   37776 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:55:05.181472   37776 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:55:05.181585   37776 main.go:141] libmachine: (functional-196000) Calling .DriverName
	I0311 03:55:05.181777   37776 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 03:55:05.182030   37776 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:55:05.182068   37776 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:55:05.190011   37776 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62273
	I0311 03:55:05.190347   37776 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:55:05.190670   37776 main.go:141] libmachine: Using API Version  1
	I0311 03:55:05.190681   37776 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:55:05.190874   37776 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:55:05.190988   37776 main.go:141] libmachine: (functional-196000) Calling .DriverName
	I0311 03:55:05.219237   37776 out.go:177] * Using the hyperkit driver based on existing profile
	I0311 03:55:05.260824   37776 start.go:297] selected driver: hyperkit
	I0311 03:55:05.260860   37776 start.go:901] validating driver "hyperkit" against &{Name:functional-196000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-196000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PV
ersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 03:55:05.261098   37776 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 03:55:05.286033   37776 out.go:177] 
	W0311 03:55:05.308771   37776 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0311 03:55:05.329941   37776 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-196000 --dry-run --alsologtostderr -v=1 --driver=hyperkit 
--- PASS: TestFunctional/parallel/DryRun (0.99s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.5s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-196000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit 
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-196000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit : exit status 23 (498.410837ms)

                                                
                                                
-- stdout --
	* [functional-196000] minikube v1.32.0 sur Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote hyperkit basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0311 03:55:05.867916   37792 out.go:291] Setting OutFile to fd 1 ...
	I0311 03:55:05.868160   37792 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:55:05.868165   37792 out.go:304] Setting ErrFile to fd 2...
	I0311 03:55:05.868169   37792 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0311 03:55:05.868393   37792 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18350-36214/.minikube/bin
	I0311 03:55:05.869966   37792 out.go:298] Setting JSON to false
	I0311 03:55:05.892617   37792 start.go:129] hostinfo: {"hostname":"MacOS-Agent-1.local","uptime":10475,"bootTime":1710144030,"procs":471,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"b7610dcb-1435-5842-8d5a-b2388403fea3"}
	W0311 03:55:05.892716   37792 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0311 03:55:05.914373   37792 out.go:177] * [functional-196000] minikube v1.32.0 sur Darwin 14.3.1
	I0311 03:55:05.977959   37792 out.go:177]   - MINIKUBE_LOCATION=18350
	I0311 03:55:05.957217   37792 notify.go:220] Checking for updates...
	I0311 03:55:05.999135   37792 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	I0311 03:55:06.020183   37792 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0311 03:55:06.043391   37792 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0311 03:55:06.065105   37792 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	I0311 03:55:06.086105   37792 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0311 03:55:06.108106   37792 config.go:182] Loaded profile config "functional-196000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0311 03:55:06.108774   37792 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:55:06.108862   37792 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:55:06.118020   37792 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62281
	I0311 03:55:06.118448   37792 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:55:06.118884   37792 main.go:141] libmachine: Using API Version  1
	I0311 03:55:06.118894   37792 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:55:06.119100   37792 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:55:06.119209   37792 main.go:141] libmachine: (functional-196000) Calling .DriverName
	I0311 03:55:06.119437   37792 driver.go:392] Setting default libvirt URI to qemu:///system
	I0311 03:55:06.119685   37792 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0311 03:55:06.119706   37792 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0311 03:55:06.127724   37792 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:62283
	I0311 03:55:06.128039   37792 main.go:141] libmachine: () Calling .GetVersion
	I0311 03:55:06.128362   37792 main.go:141] libmachine: Using API Version  1
	I0311 03:55:06.128374   37792 main.go:141] libmachine: () Calling .SetConfigRaw
	I0311 03:55:06.128556   37792 main.go:141] libmachine: () Calling .GetMachineName
	I0311 03:55:06.128655   37792 main.go:141] libmachine: (functional-196000) Calling .DriverName
	I0311 03:55:06.157061   37792 out.go:177] * Utilisation du pilote hyperkit basé sur le profil existant
	I0311 03:55:06.199413   37792 start.go:297] selected driver: hyperkit
	I0311 03:55:06.199443   37792 start.go:901] validating driver "hyperkit" against &{Name:functional-196000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-196000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PV
ersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0311 03:55:06.199650   37792 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0311 03:55:06.224967   37792 out.go:177] 
	W0311 03:55:06.246387   37792 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0311 03:55:06.267040   37792 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.50s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1686: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 addons list
functional_test.go:1698: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/License (1.39s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-darwin-amd64 license
functional_test.go:2284: (dbg) Done: out/minikube-darwin-amd64 license: (1.393870273s)
--- PASS: TestFunctional/parallel/License (1.39s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 version --short
--- PASS: TestFunctional/parallel/Version/short (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (5.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (5.227063852s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-196000
--- PASS: TestFunctional/parallel/ImageCommands/Setup (5.28s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-196000 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.02s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image rm gcr.io/google-containers/addon-resizer:functional-196000 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-196000
functional_test.go:423: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 image save --daemon gcr.io/google-containers/addon-resizer:functional-196000 --alsologtostderr
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-196000
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1266: (dbg) Run:  out/minikube-darwin-amd64 profile lis
functional_test.go:1271: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1306: (dbg) Run:  out/minikube-darwin-amd64 profile list
functional_test.go:1311: Took "149.311328ms" to run "out/minikube-darwin-amd64 profile list"
functional_test.go:1320: (dbg) Run:  out/minikube-darwin-amd64 profile list -l
functional_test.go:1325: Took "88.022044ms" to run "out/minikube-darwin-amd64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1357: (dbg) Run:  out/minikube-darwin-amd64 profile list -o json
functional_test.go:1362: Took "146.98454ms" to run "out/minikube-darwin-amd64 profile list -o json"
functional_test.go:1370: (dbg) Run:  out/minikube-darwin-amd64 profile list -o json --light
functional_test.go:1375: Took "88.595258ms" to run "out/minikube-darwin-amd64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (10.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:351: (dbg) Run:  dscacheutil -q host -a name nginx-svc.default.svc.cluster.local.
E0311 03:56:11.149607   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
E0311 03:56:11.158263   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
E0311 03:56:11.169094   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
E0311 03:56:11.190283   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
E0311 03:56:11.230455   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
E0311 03:56:11.312563   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
E0311 03:56:11.474237   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
E0311 03:56:11.795613   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
E0311 03:56:12.436026   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
E0311 03:56:13.717015   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
functional_test_tunnel_test.go:351: (dbg) Done: dscacheutil -q host -a name nginx-svc.default.svc.cluster.local.: (10.006401929s)
functional_test_tunnel_test.go:359: DNS resolution by dscacheutil for nginx-svc.default.svc.cluster.local. is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (10.02s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-darwin-amd64 -p functional-196000 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.13s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.13s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-196000
--- PASS: TestFunctional/delete_addon-resizer_images (0.13s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.05s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-196000
--- PASS: TestFunctional/delete_my-image_image (0.05s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.05s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-196000
--- PASS: TestFunctional/delete_minikube_cached_images (0.05s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (1.96s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 stop -p json-output-994000 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-darwin-amd64 stop -p json-output-994000 --output=json --user=testUser: (1.956630089s)
--- PASS: TestJSONOutput/stop/Command (1.96s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.78s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-darwin-amd64 start -p json-output-error-897000 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p json-output-error-897000 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (391.180938ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"290482ac-968e-48f3-a03c-ee12c3078019","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-897000] minikube v1.32.0 on Darwin 14.3.1","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"fdc85599-5079-48e7-ba63-260e857e2080","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=18350"}}
	{"specversion":"1.0","id":"cd79aebe-89db-4f05-8d57-0bb7c5b94d2b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig"}}
	{"specversion":"1.0","id":"d946c032-42a0-43b6-9f51-305b40b42059","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-amd64"}}
	{"specversion":"1.0","id":"877049b2-6062-4efa-8e08-c973eeb9f296","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"f9683abd-b070-4442-8cb4-5ab356ba23c9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube"}}
	{"specversion":"1.0","id":"c1b384b9-4dbc-43d9-b186-2dc511c816ef","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"0beede43-26b8-412a-a982-fbcab2d6c932","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on darwin/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-897000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p json-output-error-897000
--- PASS: TestErrorJSONOutput (0.78s)

                                                
                                    
x
+
TestMainNoArgs (0.09s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-darwin-amd64
--- PASS: TestMainNoArgs (0.09s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (2.67s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current
* minikube v1.32.0 on darwin
- MINIKUBE_LOCATION=18350
- KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current3281075434/001
* Using the hyperkit driver based on user configuration
* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:

                                                
                                                
$ sudo chown root:wheel /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current3281075434/001/.minikube/bin/docker-machine-driver-hyperkit 
$ sudo chmod u+s /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current3281075434/001/.minikube/bin/docker-machine-driver-hyperkit 

                                                
                                                

                                                
                                                
! Unable to update hyperkit driver: [sudo chown root:wheel /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current3281075434/001/.minikube/bin/docker-machine-driver-hyperkit] requires a password, and --interactive=false
* Starting "minikube" primary control-plane node in "minikube" cluster
* Download complete!
--- PASS: TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (2.67s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (6.11s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current
* minikube v1.32.0 on darwin
- MINIKUBE_LOCATION=18350
- KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current3923528259/001
* Using the hyperkit driver based on user configuration
* Downloading driver docker-machine-driver-hyperkit:
--- PASS: TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (6.11s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (4.54s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (4.54s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.4s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-686000 --no-kubernetes --kubernetes-version=1.20 --driver=hyperkit 
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-686000 --no-kubernetes --kubernetes-version=1.20 --driver=hyperkit : exit status 14 (401.961005ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-686000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18350
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18350-36214/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18350-36214/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.40s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.14s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-amd64 ssh -p NoKubernetes-686000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p NoKubernetes-686000 "sudo systemctl is-active --quiet service kubelet": exit status 83 (139.139188ms)

                                                
                                                
-- stdout --
	* The control-plane node NoKubernetes-686000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p NoKubernetes-686000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.14s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (0.33s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-darwin-amd64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-darwin-amd64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (0.33s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (3.68s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-darwin-amd64 stop -p NoKubernetes-686000
no_kubernetes_test.go:158: (dbg) Done: out/minikube-darwin-amd64 stop -p NoKubernetes-686000: (3.680569409s)
--- PASS: TestNoKubernetes/serial/Stop (3.68s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.14s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-amd64 ssh -p NoKubernetes-686000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p NoKubernetes-686000 "sudo systemctl is-active --quiet service kubelet": exit status 83 (140.14287ms)

                                                
                                                
-- stdout --
	* The control-plane node NoKubernetes-686000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p NoKubernetes-686000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.14s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (2s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p old-k8s-version-910000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p old-k8s-version-910000 --alsologtostderr -v=3: (2.001608154s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (2.00s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.33s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-910000 -n old-k8s-version-910000: exit status 7 (73.766445ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p old-k8s-version-910000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.33s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (3.64s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p no-preload-027000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p no-preload-027000 --alsologtostderr -v=3: (3.636443932s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (3.64s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.33s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-027000 -n no-preload-027000: exit status 7 (73.183918ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p no-preload-027000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.33s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (3.36s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p embed-certs-136000 --alsologtostderr -v=3
E0311 04:11:11.167515   36663 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18350-36214/.minikube/profiles/addons-725000/client.crt: no such file or directory
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p embed-certs-136000 --alsologtostderr -v=3: (3.357309945s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (3.36s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.33s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-136000 -n embed-certs-136000: exit status 7 (73.440792ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p embed-certs-136000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.33s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (3.46s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p default-k8s-diff-port-345000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p default-k8s-diff-port-345000 --alsologtostderr -v=3: (3.463850749s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (3.46s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.34s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-345000 -n default-k8s-diff-port-345000: exit status 7 (73.288764ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p default-k8s-diff-port-345000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.34s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p newest-cni-295000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.21s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (3.76s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p newest-cni-295000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p newest-cni-295000 --alsologtostderr -v=3: (3.756316742s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (3.76s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.34s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-295000 -n newest-cni-295000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-295000 -n newest-cni-295000: exit status 7 (75.062459ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p newest-cni-295000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.34s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    

Test skip (24/280)

x
+
TestDownloadOnly/v1.20.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.20.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.20.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.4/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.4/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.29.0-rc.2/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.29.0-rc.2/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:220: skipping, only for docker or podman driver
--- SKIP: TestDownloadOnlyKic (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:498: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with docker false darwin amd64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:41: Skip if not linux.
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing docker
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (11.81s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-196000 /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelMountCmdany-port1071861220/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1710154467331022000" to /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelMountCmdany-port1071861220/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1710154467331022000" to /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelMountCmdany-port1071861220/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1710154467331022000" to /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelMountCmdany-port1071861220/001/test-1710154467331022000
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (224.514081ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (142.084896ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (139.810693ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (144.171988ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (142.701063ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (161.94249ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (139.860617ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:123: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:90: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "sudo umount -f /mount-9p": exit status 83 (139.301184ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:92: "out/minikube-darwin-amd64 -p functional-196000 ssh \"sudo umount -f /mount-9p\"": exit status 83
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-196000 /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelMountCmdany-port1071861220/001:/mount-9p --alsologtostderr -v=1] ...
--- SKIP: TestFunctional/parallel/MountCmd/any-port (11.81s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (13.85s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-196000 /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelMountCmdspecific-port2160805544/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (222.51445ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (140.776693ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (140.435632ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (141.520759ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (140.757935ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (140.729372ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (161.263843ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:251: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "sudo umount -f /mount-9p": exit status 83 (141.400089ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:232: "out/minikube-darwin-amd64 -p functional-196000 ssh \"sudo umount -f /mount-9p\"": exit status 83
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-196000 /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelMountCmdspecific-port2160805544/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- SKIP: TestFunctional/parallel/MountCmd/specific-port (13.85s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (11.83s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-196000 /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2469702618/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-196000 /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2469702618/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-196000 /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2469702618/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T" /mount1: exit status 83 (315.517094ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T" /mount1: exit status 83 (143.208183ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T" /mount1: exit status 83 (160.930883ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T" /mount1: exit status 83 (140.86141ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T" /mount1: exit status 83 (141.0398ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T" /mount1: exit status 83 (142.663652ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-196000 ssh "findmnt -T" /mount1: exit status 83 (161.68855ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-196000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-196000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:340: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-196000 /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2469702618/001:/mount1 --alsologtostderr -v=1] ...
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-196000 /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2469702618/001:/mount2 --alsologtostderr -v=1] ...
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-196000 /var/folders/52/zh_qmlrn1f36yr6lgs7nxtym0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup2469702618/001:/mount3 --alsologtostderr -v=1] ...
--- SKIP: TestFunctional/parallel/MountCmd/VerifyCleanup (11.83s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestKicCustomNetwork (0s)

                                                
                                                
=== RUN   TestKicCustomNetwork
kic_custom_network_test.go:34: only runs with docker driver
--- SKIP: TestKicCustomNetwork (0.00s)

                                                
                                    
x
+
TestKicExistingNetwork (0s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:73: only runs with docker driver
--- SKIP: TestKicExistingNetwork (0.00s)

                                                
                                    
x
+
TestKicCustomSubnet (0s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:102: only runs with docker/podman driver
--- SKIP: TestKicCustomSubnet (0.00s)

                                                
                                    
x
+
TestKicStaticIP (0s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:123: only run with docker/podman driver
--- SKIP: TestKicStaticIP (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestInsufficientStorage (0s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:38: only runs with docker driver
--- SKIP: TestInsufficientStorage (0.00s)

                                                
                                    
x
+
TestMissingContainerUpgrade (0s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
version_upgrade_test.go:284: This test is only for Docker
--- SKIP: TestMissingContainerUpgrade (0.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (6.21s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:626: 
----------------------- debugLogs start: cilium-040000 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-040000" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-040000

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-040000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-040000"

                                                
                                                
----------------------- debugLogs end: cilium-040000 [took: 5.834025624s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-040000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cilium-040000
--- SKIP: TestNetworkPlugins/group/cilium (6.21s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.39s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-804000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p disable-driver-mounts-804000
--- SKIP: TestStartStop/group/disable-driver-mounts (0.39s)

                                                
                                    
Copied to clipboard