Test Report: Hyperkit_macOS 18239

                    
                      59a59c81047135cbdfd2a30078659de6ff7ddc30:2024-03-07:33453
                    
                

Test fail (155/280)

Order failed test Duration
31 TestOffline 12.59
54 TestCertOptions 12.03
55 TestCertExpiration 203.83
56 TestDockerFlags 13.61
57 TestForceSystemdFlag 14.76
58 TestForceSystemdEnv 17.67
64 TestErrorSpam/setup 11.26
73 TestFunctional/serial/StartWithProxy 11.27
75 TestFunctional/serial/SoftStart 5.91
76 TestFunctional/serial/KubeContext 0.11
77 TestFunctional/serial/KubectlGetPods 0.11
84 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.14
85 TestFunctional/serial/CacheCmd/cache/cache_reload 0.51
87 TestFunctional/serial/MinikubeKubectlCmd 0.58
88 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.74
89 TestFunctional/serial/ExtraConfig 5.9
90 TestFunctional/serial/ComponentHealth 0.11
91 TestFunctional/serial/LogsCmd 0.33
92 TestFunctional/serial/LogsFileCmd 0.27
93 TestFunctional/serial/InvalidService 0.04
96 TestFunctional/parallel/DashboardCmd 0.33
99 TestFunctional/parallel/StatusCmd 0.3
103 TestFunctional/parallel/ServiceCmdConnect 0.22
105 TestFunctional/parallel/PersistentVolumeClaim 0.07
107 TestFunctional/parallel/SSHCmd 0.45
108 TestFunctional/parallel/CpCmd 0.99
109 TestFunctional/parallel/MySQL 0.16
110 TestFunctional/parallel/FileSync 0.27
111 TestFunctional/parallel/CertSync 1.22
115 TestFunctional/parallel/NodeLabels 0.12
117 TestFunctional/parallel/NonActiveRuntimeDisabled 0.23
121 TestFunctional/parallel/Version/components 0.14
122 TestFunctional/parallel/ImageCommands/ImageListShort 0.1
123 TestFunctional/parallel/ImageCommands/ImageListTable 0.1
124 TestFunctional/parallel/ImageCommands/ImageListJson 0.1
125 TestFunctional/parallel/ImageCommands/ImageListYaml 0.1
126 TestFunctional/parallel/ImageCommands/ImageBuild 0.34
128 TestFunctional/parallel/DockerEnv/bash 0.17
129 TestFunctional/parallel/UpdateContextCmd/no_changes 0.14
130 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.14
131 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.14
132 TestFunctional/parallel/ServiceCmd/DeployApp 0.06
133 TestFunctional/parallel/ServiceCmd/List 0.25
134 TestFunctional/parallel/ServiceCmd/JSONOutput 0.25
135 TestFunctional/parallel/ServiceCmd/HTTPS 0.18
136 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 2.23
137 TestFunctional/parallel/ServiceCmd/Format 0.14
138 TestFunctional/parallel/ServiceCmd/URL 0.14
140 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.33
143 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 0
144 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 107.68
145 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 1.86
146 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 3.79
147 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.1
149 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.2
157 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig 15.05
159 TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS 39.54
167 TestMutliControlPlane/serial/StartCluster 11.26
168 TestMutliControlPlane/serial/DeployApp 82.57
169 TestMutliControlPlane/serial/PingHostFromPods 0.17
170 TestMutliControlPlane/serial/AddWorkerNode 0.21
171 TestMutliControlPlane/serial/NodeLabels 0.11
172 TestMutliControlPlane/serial/HAppyAfterClusterStart 0.22
173 TestMutliControlPlane/serial/CopyFile 0.15
174 TestMutliControlPlane/serial/StopSecondaryNode 0.31
175 TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop 0.22
176 TestMutliControlPlane/serial/RestartSecondaryNode 54.97
177 TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart 0.22
178 TestMutliControlPlane/serial/RestartClusterKeepsNodes 9.86
179 TestMutliControlPlane/serial/DeleteSecondaryNode 0.29
180 TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete 0.22
181 TestMutliControlPlane/serial/StopCluster 3.73
182 TestMutliControlPlane/serial/RestartCluster 5.9
183 TestMutliControlPlane/serial/DegradedAfterClusterRestart 0.22
184 TestMutliControlPlane/serial/AddSecondaryNode 0.21
185 TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd 0.25
188 TestImageBuild/serial/Setup 11.39
191 TestJSONOutput/start/Command 11.04
194 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
195 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
197 TestJSONOutput/pause/Command 0.14
203 TestJSONOutput/unpause/Command 0.14
220 TestMinikubeProfile 11.95
223 TestMountStart/serial/StartWithMountFirst 11.52
226 TestMultiNode/serial/FreshStart2Nodes 11.66
227 TestMultiNode/serial/DeployApp2Nodes 119.97
228 TestMultiNode/serial/PingHostFrom2Pods 0.17
229 TestMultiNode/serial/AddNode 0.21
230 TestMultiNode/serial/MultiNodeLabels 0.11
231 TestMultiNode/serial/ProfileList 0.22
232 TestMultiNode/serial/CopyFile 0.15
233 TestMultiNode/serial/StopNode 0.38
234 TestMultiNode/serial/StartAfterStop 47.08
235 TestMultiNode/serial/RestartKeepsNodes 9.45
236 TestMultiNode/serial/DeleteNode 0.29
237 TestMultiNode/serial/StopMultiNode 3.83
238 TestMultiNode/serial/RestartMultiNode 5.9
239 TestMultiNode/serial/ValidateNameConflict 22.96
243 TestPreload 11.52
245 TestScheduledStopUnix 11.53
246 TestSkaffold 14
249 TestRunningBinaryUpgrade 45.1
251 TestKubernetesUpgrade 21.18
267 TestStoppedBinaryUpgrade/Upgrade 25.46
268 TestStoppedBinaryUpgrade/MinikubeLogs 0.32
270 TestPause/serial/Start 11.29
280 TestNoKubernetes/serial/StartWithK8s 11.25
281 TestNoKubernetes/serial/StartWithStopK8s 5.89
282 TestNoKubernetes/serial/Start 5.95
286 TestNoKubernetes/serial/StartNoArgs 5.91
288 TestNetworkPlugins/group/auto/Start 11.32
289 TestNetworkPlugins/group/kindnet/Start 11.2
290 TestNetworkPlugins/group/calico/Start 11.29
291 TestNetworkPlugins/group/custom-flannel/Start 12.4
292 TestNetworkPlugins/group/false/Start 11.42
293 TestNetworkPlugins/group/enable-default-cni/Start 11.87
294 TestNetworkPlugins/group/flannel/Start 11.65
295 TestNetworkPlugins/group/bridge/Start 11.82
296 TestNetworkPlugins/group/kubenet/Start 11.44
298 TestStartStop/group/old-k8s-version/serial/FirstStart 11.88
300 TestStartStop/group/no-preload/serial/FirstStart 11.73
301 TestStartStop/group/old-k8s-version/serial/DeployApp 0.18
302 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 0.32
305 TestStartStop/group/old-k8s-version/serial/SecondStart 6.05
306 TestStartStop/group/no-preload/serial/DeployApp 0.18
307 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 0.32
310 TestStartStop/group/no-preload/serial/SecondStart 6.52
311 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 0.07
312 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 0.11
313 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.18
314 TestStartStop/group/old-k8s-version/serial/Pause 0.29
316 TestStartStop/group/embed-certs/serial/FirstStart 11.71
317 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 0.07
318 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 0.11
319 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.18
320 TestStartStop/group/no-preload/serial/Pause 0.28
322 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 11.42
323 TestStartStop/group/embed-certs/serial/DeployApp 0.18
324 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 0.32
327 TestStartStop/group/embed-certs/serial/SecondStart 6.39
328 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 0.19
329 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 0.32
332 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 7.3
333 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 0.07
334 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 0.11
335 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.18
336 TestStartStop/group/embed-certs/serial/Pause 0.29
338 TestStartStop/group/newest-cni/serial/FirstStart 11.29
339 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 0.07
340 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 0.11
341 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.18
342 TestStartStop/group/default-k8s-diff-port/serial/Pause 0.29
347 TestStartStop/group/newest-cni/serial/SecondStart 5.93
350 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.18
351 TestStartStop/group/newest-cni/serial/Pause 0.31
x
+
TestOffline (12.59s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-amd64 start -p offline-docker-243000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit 
aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p offline-docker-243000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit : exit status 60 (12.245523329s)

                                                
                                                
-- stdout --
	* [offline-docker-243000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "offline-docker-243000" primary control-plane node in "offline-docker-243000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "offline-docker-243000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:06:58.050862   13822 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:06:58.051028   13822 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:06:58.051034   13822 out.go:304] Setting ErrFile to fd 2...
	I0307 10:06:58.051038   13822 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:06:58.051212   13822 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:06:58.052953   13822 out.go:298] Setting JSON to false
	I0307 10:06:58.076252   13822 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7589,"bootTime":1709827229,"procs":433,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:06:58.076384   13822 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:06:58.099749   13822 out.go:177] * [offline-docker-243000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:06:58.141875   13822 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:06:58.141892   13822 notify.go:220] Checking for updates...
	I0307 10:06:58.183529   13822 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:06:58.204711   13822 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:06:58.225873   13822 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:06:58.246581   13822 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:06:58.267916   13822 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:06:58.289307   13822 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:06:58.289412   13822 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:06:58.317780   13822 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:06:58.359862   13822 start.go:297] selected driver: hyperkit
	I0307 10:06:58.359879   13822 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:06:58.359890   13822 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:06:58.362947   13822 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:06:58.363061   13822 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:06:58.371072   13822 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:06:58.374979   13822 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:06:58.375002   13822 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 10:06:58.375040   13822 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:06:58.375247   13822 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:06:58.375315   13822 cni.go:84] Creating CNI manager for ""
	I0307 10:06:58.375333   13822 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:06:58.375340   13822 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 10:06:58.375412   13822 start.go:340] cluster config:
	{Name:offline-docker-243000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-243000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loca
l ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:06:58.375497   13822 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:06:58.396660   13822 out.go:177] * Starting "offline-docker-243000" primary control-plane node in "offline-docker-243000" cluster
	I0307 10:06:58.417830   13822 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:06:58.417876   13822 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:06:58.417893   13822 cache.go:56] Caching tarball of preloaded images
	I0307 10:06:58.418042   13822 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:06:58.418058   13822 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:06:58.418132   13822 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/offline-docker-243000/config.json ...
	I0307 10:06:58.418149   13822 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/offline-docker-243000/config.json: {Name:mkdd218b623c7ecab075b8138ce86d80d1675062 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:06:58.418469   13822 start.go:360] acquireMachinesLock for offline-docker-243000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:06:58.418522   13822 start.go:364] duration metric: took 40.042µs to acquireMachinesLock for "offline-docker-243000"
	I0307 10:06:58.418551   13822 start.go:93] Provisioning new machine with config: &{Name:offline-docker-243000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-243000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:06:58.418608   13822 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:06:58.460838   13822 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 10:06:58.461128   13822 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:06:58.461189   13822 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:06:58.469370   13822 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59799
	I0307 10:06:58.469726   13822 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:06:58.470148   13822 main.go:141] libmachine: Using API Version  1
	I0307 10:06:58.470160   13822 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:06:58.470390   13822 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:06:58.470498   13822 main.go:141] libmachine: (offline-docker-243000) Calling .GetMachineName
	I0307 10:06:58.470592   13822 main.go:141] libmachine: (offline-docker-243000) Calling .DriverName
	I0307 10:06:58.470710   13822 start.go:159] libmachine.API.Create for "offline-docker-243000" (driver="hyperkit")
	I0307 10:06:58.470736   13822 client.go:168] LocalClient.Create starting
	I0307 10:06:58.470772   13822 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:06:58.470819   13822 main.go:141] libmachine: Decoding PEM data...
	I0307 10:06:58.470835   13822 main.go:141] libmachine: Parsing certificate...
	I0307 10:06:58.470914   13822 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:06:58.470952   13822 main.go:141] libmachine: Decoding PEM data...
	I0307 10:06:58.470964   13822 main.go:141] libmachine: Parsing certificate...
	I0307 10:06:58.470984   13822 main.go:141] libmachine: Running pre-create checks...
	I0307 10:06:58.470989   13822 main.go:141] libmachine: (offline-docker-243000) Calling .PreCreateCheck
	I0307 10:06:58.471077   13822 main.go:141] libmachine: (offline-docker-243000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:06:58.471256   13822 main.go:141] libmachine: (offline-docker-243000) Calling .GetConfigRaw
	I0307 10:06:58.482672   13822 main.go:141] libmachine: Creating machine...
	I0307 10:06:58.482696   13822 main.go:141] libmachine: (offline-docker-243000) Calling .Create
	I0307 10:06:58.482922   13822 main.go:141] libmachine: (offline-docker-243000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:06:58.483185   13822 main.go:141] libmachine: (offline-docker-243000) DBG | I0307 10:06:58.482903   13844 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:06:58.483285   13822 main.go:141] libmachine: (offline-docker-243000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:06:58.920066   13822 main.go:141] libmachine: (offline-docker-243000) DBG | I0307 10:06:58.919899   13844 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/offline-docker-243000/id_rsa...
	I0307 10:06:59.219169   13822 main.go:141] libmachine: (offline-docker-243000) DBG | I0307 10:06:59.219079   13844 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/offline-docker-243000/offline-docker-243000.rawdisk...
	I0307 10:06:59.219182   13822 main.go:141] libmachine: (offline-docker-243000) DBG | Writing magic tar header
	I0307 10:06:59.219197   13822 main.go:141] libmachine: (offline-docker-243000) DBG | Writing SSH key tar header
	I0307 10:06:59.219465   13822 main.go:141] libmachine: (offline-docker-243000) DBG | I0307 10:06:59.219421   13844 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/offline-docker-243000 ...
	I0307 10:06:59.660886   13822 main.go:141] libmachine: (offline-docker-243000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:06:59.660907   13822 main.go:141] libmachine: (offline-docker-243000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/offline-docker-243000/hyperkit.pid
	I0307 10:06:59.660954   13822 main.go:141] libmachine: (offline-docker-243000) DBG | Using UUID 34bf0e7a-b5fa-4b91-a0d4-f5844a526c38
	I0307 10:06:59.726050   13822 main.go:141] libmachine: (offline-docker-243000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:06:59.726167   13822 client.go:171] duration metric: took 1.255389516s to LocalClient.Create
	I0307 10:07:01.726525   13822 start.go:128] duration metric: took 3.307851256s to createHost
	I0307 10:07:01.726540   13822 start.go:83] releasing machines lock for "offline-docker-243000", held for 3.307959703s
	W0307 10:07:01.726555   13822 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:07:01.726846   13822 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:07:01.726879   13822 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:01.734969   13822 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59801
	I0307 10:07:01.735367   13822 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:01.735757   13822 main.go:141] libmachine: Using API Version  1
	I0307 10:07:01.735768   13822 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:01.736001   13822 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:01.736401   13822 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:07:01.736429   13822 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:01.744867   13822 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59803
	I0307 10:07:01.745189   13822 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:01.745547   13822 main.go:141] libmachine: Using API Version  1
	I0307 10:07:01.745565   13822 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:01.745797   13822 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:01.745911   13822 main.go:141] libmachine: (offline-docker-243000) Calling .GetState
	I0307 10:07:01.745989   13822 main.go:141] libmachine: (offline-docker-243000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:07:01.746022   13822 main.go:141] libmachine: (offline-docker-243000) DBG | hyperkit pid from json: 0
	I0307 10:07:01.746033   13822 main.go:141] libmachine: (offline-docker-243000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/offline-docker-243000/hyperkit.json: no such file or directory
	I0307 10:07:01.746064   13822 main.go:141] libmachine: (offline-docker-243000) Calling .DriverName
	I0307 10:07:01.788066   13822 out.go:177] * Deleting "offline-docker-243000" in hyperkit ...
	I0307 10:07:01.809033   13822 main.go:141] libmachine: (offline-docker-243000) Calling .Remove
	I0307 10:07:01.809413   13822 main.go:141] libmachine: (offline-docker-243000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:07:01.809438   13822 main.go:141] libmachine: (offline-docker-243000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:07:01.809455   13822 main.go:141] libmachine: (offline-docker-243000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/offline-docker-243000/hyperkit.json: no such file or directory
	I0307 10:07:01.809498   13822 main.go:141] libmachine: (offline-docker-243000) DBG | hyperkit pid from json: 0
	W0307 10:07:01.903217   13822 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:07:01.903236   13822 start.go:728] Will try again in 5 seconds ...
	I0307 10:07:06.903570   13822 start.go:360] acquireMachinesLock for offline-docker-243000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:07:06.903683   13822 start.go:364] duration metric: took 81.952µs to acquireMachinesLock for "offline-docker-243000"
	I0307 10:07:06.903701   13822 start.go:93] Provisioning new machine with config: &{Name:offline-docker-243000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-243000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:07:06.903759   13822 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:07:06.958300   13822 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 10:07:06.958454   13822 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:07:06.958505   13822 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:06.968514   13822 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59806
	I0307 10:07:06.968886   13822 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:06.969234   13822 main.go:141] libmachine: Using API Version  1
	I0307 10:07:06.969247   13822 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:06.969485   13822 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:06.969598   13822 main.go:141] libmachine: (offline-docker-243000) Calling .GetMachineName
	I0307 10:07:06.969677   13822 main.go:141] libmachine: (offline-docker-243000) Calling .DriverName
	I0307 10:07:06.969786   13822 start.go:159] libmachine.API.Create for "offline-docker-243000" (driver="hyperkit")
	I0307 10:07:06.969806   13822 client.go:168] LocalClient.Create starting
	I0307 10:07:06.969837   13822 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:07:06.969892   13822 main.go:141] libmachine: Decoding PEM data...
	I0307 10:07:06.969906   13822 main.go:141] libmachine: Parsing certificate...
	I0307 10:07:06.969957   13822 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:07:06.969994   13822 main.go:141] libmachine: Decoding PEM data...
	I0307 10:07:06.970010   13822 main.go:141] libmachine: Parsing certificate...
	I0307 10:07:06.970030   13822 main.go:141] libmachine: Running pre-create checks...
	I0307 10:07:06.970036   13822 main.go:141] libmachine: (offline-docker-243000) Calling .PreCreateCheck
	I0307 10:07:06.970115   13822 main.go:141] libmachine: (offline-docker-243000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:07:06.970134   13822 main.go:141] libmachine: (offline-docker-243000) Calling .GetConfigRaw
	I0307 10:07:06.993323   13822 main.go:141] libmachine: Creating machine...
	I0307 10:07:06.993347   13822 main.go:141] libmachine: (offline-docker-243000) Calling .Create
	I0307 10:07:06.993579   13822 main.go:141] libmachine: (offline-docker-243000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:07:06.993860   13822 main.go:141] libmachine: (offline-docker-243000) DBG | I0307 10:07:06.993554   13959 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:07:06.993984   13822 main.go:141] libmachine: (offline-docker-243000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:07:07.465185   13822 main.go:141] libmachine: (offline-docker-243000) DBG | I0307 10:07:07.465081   13959 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/offline-docker-243000/id_rsa...
	I0307 10:07:07.572409   13822 main.go:141] libmachine: (offline-docker-243000) DBG | I0307 10:07:07.572323   13959 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/offline-docker-243000/offline-docker-243000.rawdisk...
	I0307 10:07:07.572422   13822 main.go:141] libmachine: (offline-docker-243000) DBG | Writing magic tar header
	I0307 10:07:07.572447   13822 main.go:141] libmachine: (offline-docker-243000) DBG | Writing SSH key tar header
	I0307 10:07:07.573085   13822 main.go:141] libmachine: (offline-docker-243000) DBG | I0307 10:07:07.573043   13959 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/offline-docker-243000 ...
	I0307 10:07:07.998498   13822 main.go:141] libmachine: (offline-docker-243000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:07:07.998526   13822 main.go:141] libmachine: (offline-docker-243000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/offline-docker-243000/hyperkit.pid
	I0307 10:07:07.998544   13822 main.go:141] libmachine: (offline-docker-243000) DBG | Using UUID 0b5cfe3e-3fd9-4428-8205-4fc2db93dee6
	I0307 10:07:08.036694   13822 main.go:141] libmachine: (offline-docker-243000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:07:08.036787   13822 client.go:171] duration metric: took 1.066957094s to LocalClient.Create
	I0307 10:07:10.037831   13822 start.go:128] duration metric: took 3.134009286s to createHost
	I0307 10:07:10.037863   13822 start.go:83] releasing machines lock for "offline-docker-243000", held for 3.134121681s
	W0307 10:07:10.038006   13822 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p offline-docker-243000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p offline-docker-243000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:07:10.099246   13822 out.go:177] 
	W0307 10:07:10.121463   13822 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:07:10.121515   13822 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:07:10.121539   13822 out.go:239] * Related issues:
	* Related issues:
	W0307 10:07:10.121574   13822 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:07:10.121613   13822 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:07:10.164374   13822 out.go:177] 

                                                
                                                
** /stderr **
aab_offline_test.go:58: out/minikube-darwin-amd64 start -p offline-docker-243000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit  failed: exit status 60
panic.go:626: *** TestOffline FAILED at 2024-03-07 10:07:10.237028 -0800 PST m=+1183.014828301
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p offline-docker-243000 -n offline-docker-243000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p offline-docker-243000 -n offline-docker-243000: exit status 7 (73.984826ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "offline-docker-243000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "offline-docker-243000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p offline-docker-243000
--- FAIL: TestOffline (12.59s)

                                                
                                    
x
+
TestCertOptions (12.03s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-options-514000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit 
E0307 10:07:44.524222   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-options-514000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit : exit status 60 (11.373514933s)

                                                
                                                
-- stdout --
	* [cert-options-514000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "cert-options-514000" primary control-plane node in "cert-options-514000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "cert-options-514000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-options-514000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-amd64 start -p cert-options-514000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit " : exit status 60
cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-amd64 -p cert-options-514000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p cert-options-514000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 83 (140.058687ms)

                                                
                                                
-- stdout --
	* The control-plane node cert-options-514000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-514000"

                                                
                                                
-- /stdout --
cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-amd64 -p cert-options-514000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 83
cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.
cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.
cert_options_test.go:69: apiserver cert does not include localhost in SAN.
cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-514000 config view
cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 
'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"
cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-amd64 ssh -p cert-options-514000 -- "sudo cat /etc/kubernetes/admin.conf"
cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p cert-options-514000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 83 (138.659163ms)

                                                
                                                
-- stdout --
	* The control-plane node cert-options-514000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-514000"

                                                
                                                
-- /stdout --
cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-amd64 ssh -p cert-options-514000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 83
cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 
-- stdout --
	* The control-plane node cert-options-514000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-514000"

                                                
                                                
-- /stdout --
cert_options_test.go:109: *** TestCertOptions FAILED at 2024-03-07 10:07:56.019477 -0800 PST m=+1228.796565513
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p cert-options-514000 -n cert-options-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p cert-options-514000 -n cert-options-514000: exit status 7 (74.695034ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-options-514000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-options-514000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-options-514000
--- FAIL: TestCertOptions (12.03s)

                                                
                                    
x
+
TestCertExpiration (203.83s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-787000 --memory=2048 --cert-expiration=3m --driver=hyperkit 
cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-expiration-787000 --memory=2048 --cert-expiration=3m --driver=hyperkit : exit status 60 (13.1100292s)

                                                
                                                
-- stdout --
	* [cert-expiration-787000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "cert-expiration-787000" primary control-plane node in "cert-expiration-787000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "cert-expiration-787000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-787000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-amd64 start -p cert-expiration-787000 --memory=2048 --cert-expiration=3m --driver=hyperkit " : exit status 60
cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-787000 --memory=2048 --cert-expiration=8760h --driver=hyperkit 
cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-expiration-787000 --memory=2048 --cert-expiration=8760h --driver=hyperkit : exit status 60 (10.36801896s)

                                                
                                                
-- stdout --
	* [cert-expiration-787000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "cert-expiration-787000" primary control-plane node in "cert-expiration-787000" cluster
	* Restarting existing hyperkit VM for "cert-expiration-787000" ...
	* Restarting existing hyperkit VM for "cert-expiration-787000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-787000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-amd64 start -p cert-expiration-787000 --memory=2048 --cert-expiration=8760h --driver=hyperkit " : exit status 60
cert_options_test.go:136: minikube start output did not warn about expired certs: 
-- stdout --
	* [cert-expiration-787000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "cert-expiration-787000" primary control-plane node in "cert-expiration-787000" cluster
	* Restarting existing hyperkit VM for "cert-expiration-787000" ...
	* Restarting existing hyperkit VM for "cert-expiration-787000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-787000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:138: *** TestCertExpiration FAILED at 2024-03-07 10:11:01.04399 -0800 PST m=+1413.818202868
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p cert-expiration-787000 -n cert-expiration-787000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p cert-expiration-787000 -n cert-expiration-787000: exit status 7 (79.982074ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-expiration-787000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-expiration-787000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-expiration-787000
--- FAIL: TestCertExpiration (203.83s)

                                                
                                    
x
+
TestDockerFlags (13.61s)

                                                
                                                
=== RUN   TestDockerFlags
=== PAUSE TestDockerFlags

                                                
                                                

                                                
                                                
=== CONT  TestDockerFlags
docker_test.go:51: (dbg) Run:  out/minikube-darwin-amd64 start -p docker-flags-466000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p docker-flags-466000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (12.971085255s)

                                                
                                                
-- stdout --
	* [docker-flags-466000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "docker-flags-466000" primary control-plane node in "docker-flags-466000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "docker-flags-466000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:07:30.774737   14065 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:07:30.774903   14065 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:07:30.774908   14065 out.go:304] Setting ErrFile to fd 2...
	I0307 10:07:30.774912   14065 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:07:30.775099   14065 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:07:30.776517   14065 out.go:298] Setting JSON to false
	I0307 10:07:30.798902   14065 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7621,"bootTime":1709827229,"procs":438,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:07:30.798997   14065 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:07:30.820793   14065 out.go:177] * [docker-flags-466000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:07:30.862688   14065 notify.go:220] Checking for updates...
	I0307 10:07:30.884362   14065 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:07:30.905411   14065 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:07:30.926375   14065 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:07:30.947296   14065 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:07:30.968527   14065 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:07:30.989568   14065 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:07:31.011151   14065 config.go:182] Loaded profile config "force-systemd-flag-568000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:07:31.011281   14065 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:07:31.011391   14065 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:07:31.040552   14065 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:07:31.083453   14065 start.go:297] selected driver: hyperkit
	I0307 10:07:31.083478   14065 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:07:31.083494   14065 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:07:31.087139   14065 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:07:31.087265   14065 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:07:31.095842   14065 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:07:31.100072   14065 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:31.100115   14065 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:07:31.100151   14065 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:07:31.100364   14065 start_flags.go:942] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]
	I0307 10:07:31.100424   14065 cni.go:84] Creating CNI manager for ""
	I0307 10:07:31.100442   14065 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:07:31.100449   14065 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 10:07:31.100529   14065 start.go:340] cluster config:
	{Name:docker-flags-466000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-466000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:
[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientP
ath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:07:31.100621   14065 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:07:31.142303   14065 out.go:177] * Starting "docker-flags-466000" primary control-plane node in "docker-flags-466000" cluster
	I0307 10:07:31.163453   14065 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:07:31.163508   14065 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:07:31.163527   14065 cache.go:56] Caching tarball of preloaded images
	I0307 10:07:31.163672   14065 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:07:31.163684   14065 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:07:31.163791   14065 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/docker-flags-466000/config.json ...
	I0307 10:07:31.163815   14065 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/docker-flags-466000/config.json: {Name:mk56139e6cb8f20ac52b6d532f8276c9cd8eb8b3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:07:31.164201   14065 start.go:360] acquireMachinesLock for docker-flags-466000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:07:31.164273   14065 start.go:364] duration metric: took 55.928µs to acquireMachinesLock for "docker-flags-466000"
	I0307 10:07:31.164303   14065 start.go:93] Provisioning new machine with config: &{Name:docker-flags-466000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSH
Key: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-466000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountI
P: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:07:31.164366   14065 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:07:31.238674   14065 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 10:07:31.238989   14065 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:31.239075   14065 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:31.248238   14065 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59882
	I0307 10:07:31.248631   14065 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:31.249061   14065 main.go:141] libmachine: Using API Version  1
	I0307 10:07:31.249071   14065 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:31.249316   14065 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:31.249432   14065 main.go:141] libmachine: (docker-flags-466000) Calling .GetMachineName
	I0307 10:07:31.249520   14065 main.go:141] libmachine: (docker-flags-466000) Calling .DriverName
	I0307 10:07:31.249626   14065 start.go:159] libmachine.API.Create for "docker-flags-466000" (driver="hyperkit")
	I0307 10:07:31.249651   14065 client.go:168] LocalClient.Create starting
	I0307 10:07:31.249684   14065 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:07:31.249732   14065 main.go:141] libmachine: Decoding PEM data...
	I0307 10:07:31.249748   14065 main.go:141] libmachine: Parsing certificate...
	I0307 10:07:31.249801   14065 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:07:31.249837   14065 main.go:141] libmachine: Decoding PEM data...
	I0307 10:07:31.249848   14065 main.go:141] libmachine: Parsing certificate...
	I0307 10:07:31.249860   14065 main.go:141] libmachine: Running pre-create checks...
	I0307 10:07:31.249871   14065 main.go:141] libmachine: (docker-flags-466000) Calling .PreCreateCheck
	I0307 10:07:31.249947   14065 main.go:141] libmachine: (docker-flags-466000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:31.250081   14065 main.go:141] libmachine: (docker-flags-466000) Calling .GetConfigRaw
	I0307 10:07:31.250664   14065 main.go:141] libmachine: Creating machine...
	I0307 10:07:31.250672   14065 main.go:141] libmachine: (docker-flags-466000) Calling .Create
	I0307 10:07:31.250757   14065 main.go:141] libmachine: (docker-flags-466000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:31.250868   14065 main.go:141] libmachine: (docker-flags-466000) DBG | I0307 10:07:31.250746   14074 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:07:31.250922   14065 main.go:141] libmachine: (docker-flags-466000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:07:31.430156   14065 main.go:141] libmachine: (docker-flags-466000) DBG | I0307 10:07:31.430062   14074 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/docker-flags-466000/id_rsa...
	I0307 10:07:31.633850   14065 main.go:141] libmachine: (docker-flags-466000) DBG | I0307 10:07:31.633756   14074 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/docker-flags-466000/docker-flags-466000.rawdisk...
	I0307 10:07:31.633863   14065 main.go:141] libmachine: (docker-flags-466000) DBG | Writing magic tar header
	I0307 10:07:31.633873   14065 main.go:141] libmachine: (docker-flags-466000) DBG | Writing SSH key tar header
	I0307 10:07:31.634671   14065 main.go:141] libmachine: (docker-flags-466000) DBG | I0307 10:07:31.634573   14074 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/docker-flags-466000 ...
	I0307 10:07:31.999844   14065 main.go:141] libmachine: (docker-flags-466000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:31.999862   14065 main.go:141] libmachine: (docker-flags-466000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/docker-flags-466000/hyperkit.pid
	I0307 10:07:31.999898   14065 main.go:141] libmachine: (docker-flags-466000) DBG | Using UUID b0367a2e-4c2e-42d8-b692-563a27260964
	I0307 10:07:32.037677   14065 main.go:141] libmachine: (docker-flags-466000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:07:32.037770   14065 client.go:171] duration metric: took 788.096875ms to LocalClient.Create
	I0307 10:07:34.040032   14065 start.go:128] duration metric: took 2.875603658s to createHost
	I0307 10:07:34.040058   14065 start.go:83] releasing machines lock for "docker-flags-466000", held for 2.875731352s
	W0307 10:07:34.040090   14065 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:07:34.040665   14065 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:34.040714   14065 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:34.050269   14065 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59884
	I0307 10:07:34.050635   14065 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:34.050953   14065 main.go:141] libmachine: Using API Version  1
	I0307 10:07:34.050962   14065 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:34.051191   14065 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:34.051537   14065 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:34.051562   14065 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:34.059359   14065 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59886
	I0307 10:07:34.059681   14065 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:34.060010   14065 main.go:141] libmachine: Using API Version  1
	I0307 10:07:34.060029   14065 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:34.060222   14065 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:34.060325   14065 main.go:141] libmachine: (docker-flags-466000) Calling .GetState
	I0307 10:07:34.060401   14065 main.go:141] libmachine: (docker-flags-466000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:34.060452   14065 main.go:141] libmachine: (docker-flags-466000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/docker-flags-466000/hyperkit.json: no such file or directory
	I0307 10:07:34.060467   14065 main.go:141] libmachine: (docker-flags-466000) DBG | hyperkit pid from json: 0
	I0307 10:07:34.060486   14065 main.go:141] libmachine: (docker-flags-466000) Calling .DriverName
	I0307 10:07:34.105700   14065 out.go:177] * Deleting "docker-flags-466000" in hyperkit ...
	I0307 10:07:34.127644   14065 main.go:141] libmachine: (docker-flags-466000) Calling .Remove
	I0307 10:07:34.127937   14065 main.go:141] libmachine: (docker-flags-466000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:34.127961   14065 main.go:141] libmachine: (docker-flags-466000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:34.128016   14065 main.go:141] libmachine: (docker-flags-466000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/docker-flags-466000/hyperkit.json: no such file or directory
	I0307 10:07:34.128038   14065 main.go:141] libmachine: (docker-flags-466000) DBG | hyperkit pid from json: 0
	W0307 10:07:34.150769   14065 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:07:34.150783   14065 start.go:728] Will try again in 5 seconds ...
	I0307 10:07:39.153032   14065 start.go:360] acquireMachinesLock for docker-flags-466000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:07:40.734767   14065 start.go:364] duration metric: took 1.581649073s to acquireMachinesLock for "docker-flags-466000"
	I0307 10:07:40.734851   14065 start.go:93] Provisioning new machine with config: &{Name:docker-flags-466000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSH
Key: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-466000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountI
P: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:07:40.734984   14065 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:07:40.759211   14065 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 10:07:40.759279   14065 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:40.759304   14065 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:40.767231   14065 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59906
	I0307 10:07:40.767571   14065 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:40.767908   14065 main.go:141] libmachine: Using API Version  1
	I0307 10:07:40.767917   14065 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:40.768130   14065 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:40.768226   14065 main.go:141] libmachine: (docker-flags-466000) Calling .GetMachineName
	I0307 10:07:40.768299   14065 main.go:141] libmachine: (docker-flags-466000) Calling .DriverName
	I0307 10:07:40.768404   14065 start.go:159] libmachine.API.Create for "docker-flags-466000" (driver="hyperkit")
	I0307 10:07:40.768426   14065 client.go:168] LocalClient.Create starting
	I0307 10:07:40.768464   14065 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:07:40.768511   14065 main.go:141] libmachine: Decoding PEM data...
	I0307 10:07:40.768522   14065 main.go:141] libmachine: Parsing certificate...
	I0307 10:07:40.768573   14065 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:07:40.768611   14065 main.go:141] libmachine: Decoding PEM data...
	I0307 10:07:40.768624   14065 main.go:141] libmachine: Parsing certificate...
	I0307 10:07:40.768636   14065 main.go:141] libmachine: Running pre-create checks...
	I0307 10:07:40.768641   14065 main.go:141] libmachine: (docker-flags-466000) Calling .PreCreateCheck
	I0307 10:07:40.768711   14065 main.go:141] libmachine: (docker-flags-466000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:40.768733   14065 main.go:141] libmachine: (docker-flags-466000) Calling .GetConfigRaw
	I0307 10:07:40.822082   14065 main.go:141] libmachine: Creating machine...
	I0307 10:07:40.822110   14065 main.go:141] libmachine: (docker-flags-466000) Calling .Create
	I0307 10:07:40.822384   14065 main.go:141] libmachine: (docker-flags-466000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:40.822679   14065 main.go:141] libmachine: (docker-flags-466000) DBG | I0307 10:07:40.822349   14109 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:07:40.822736   14065 main.go:141] libmachine: (docker-flags-466000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:07:41.047263   14065 main.go:141] libmachine: (docker-flags-466000) DBG | I0307 10:07:41.047200   14109 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/docker-flags-466000/id_rsa...
	I0307 10:07:41.111711   14065 main.go:141] libmachine: (docker-flags-466000) DBG | I0307 10:07:41.111670   14109 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/docker-flags-466000/docker-flags-466000.rawdisk...
	I0307 10:07:41.111750   14065 main.go:141] libmachine: (docker-flags-466000) DBG | Writing magic tar header
	I0307 10:07:41.111777   14065 main.go:141] libmachine: (docker-flags-466000) DBG | Writing SSH key tar header
	I0307 10:07:41.112338   14065 main.go:141] libmachine: (docker-flags-466000) DBG | I0307 10:07:41.112260   14109 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/docker-flags-466000 ...
	I0307 10:07:41.474623   14065 main.go:141] libmachine: (docker-flags-466000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:41.474640   14065 main.go:141] libmachine: (docker-flags-466000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/docker-flags-466000/hyperkit.pid
	I0307 10:07:41.474689   14065 main.go:141] libmachine: (docker-flags-466000) DBG | Using UUID 341918fc-9b0e-4be5-a2de-b48227bfc21d
	I0307 10:07:41.510907   14065 main.go:141] libmachine: (docker-flags-466000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:07:41.511004   14065 client.go:171] duration metric: took 742.559711ms to LocalClient.Create
	I0307 10:07:43.512135   14065 start.go:128] duration metric: took 2.777090942s to createHost
	I0307 10:07:43.512239   14065 start.go:83] releasing machines lock for "docker-flags-466000", held for 2.777326057s
	W0307 10:07:43.512320   14065 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p docker-flags-466000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p docker-flags-466000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:07:43.556413   14065 out.go:177] 
	W0307 10:07:43.579837   14065 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:07:43.579907   14065 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:07:43.579950   14065 out.go:239] * Related issues:
	* Related issues:
	W0307 10:07:43.579999   14065 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:07:43.580073   14065 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:07:43.623499   14065 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-amd64 start -p docker-flags-466000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:56: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-466000 ssh "sudo systemctl show docker --property=Environment --no-pager"
docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p docker-flags-466000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 83 (158.48077ms)

                                                
                                                
-- stdout --
	* The control-plane node docker-flags-466000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p docker-flags-466000"

                                                
                                                
-- /stdout --
docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-amd64 -p docker-flags-466000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 83
docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-466000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-466000\"\n"*.
docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-466000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-466000\"\n"*.
docker_test.go:67: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-466000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"
docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p docker-flags-466000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 83 (138.269719ms)

                                                
                                                
-- stdout --
	* The control-plane node docker-flags-466000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p docker-flags-466000"

                                                
                                                
-- /stdout --
docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-amd64 -p docker-flags-466000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 83
docker_test.go:73: expected "out/minikube-darwin-amd64 -p docker-flags-466000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control-plane node docker-flags-466000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-466000\"\n"
panic.go:626: *** TestDockerFlags FAILED at 2024-03-07 10:07:43.986178 -0800 PST m=+1216.763453242
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p docker-flags-466000 -n docker-flags-466000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p docker-flags-466000 -n docker-flags-466000: exit status 7 (72.922696ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "docker-flags-466000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "docker-flags-466000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p docker-flags-466000
--- FAIL: TestDockerFlags (13.61s)

                                                
                                    
x
+
TestForceSystemdFlag (14.76s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-flag-568000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-flag-568000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (14.271927134s)

                                                
                                                
-- stdout --
	* [force-systemd-flag-568000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "force-systemd-flag-568000" primary control-plane node in "force-systemd-flag-568000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "force-systemd-flag-568000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:07:22.862476   14035 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:07:22.862644   14035 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:07:22.862650   14035 out.go:304] Setting ErrFile to fd 2...
	I0307 10:07:22.862654   14035 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:07:22.862846   14035 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:07:22.864284   14035 out.go:298] Setting JSON to false
	I0307 10:07:22.886422   14035 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7613,"bootTime":1709827229,"procs":434,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:07:22.886510   14035 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:07:22.908362   14035 out.go:177] * [force-systemd-flag-568000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:07:22.951248   14035 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:07:22.951344   14035 notify.go:220] Checking for updates...
	I0307 10:07:22.994152   14035 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:07:23.015088   14035 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:07:23.036091   14035 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:07:23.057321   14035 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:07:23.099164   14035 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:07:23.121295   14035 config.go:182] Loaded profile config "force-systemd-env-752000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:07:23.121509   14035 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:07:23.121666   14035 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:07:23.162319   14035 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:07:23.203994   14035 start.go:297] selected driver: hyperkit
	I0307 10:07:23.204024   14035 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:07:23.204044   14035 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:07:23.208275   14035 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:07:23.208403   14035 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:07:23.216117   14035 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:07:23.220230   14035 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:23.220250   14035 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:07:23.220285   14035 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:07:23.220479   14035 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0307 10:07:23.220533   14035 cni.go:84] Creating CNI manager for ""
	I0307 10:07:23.220551   14035 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:07:23.220558   14035 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 10:07:23.220622   14035 start.go:340] cluster config:
	{Name:force-systemd-flag-568000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-568000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:07:23.220702   14035 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:07:23.263185   14035 out.go:177] * Starting "force-systemd-flag-568000" primary control-plane node in "force-systemd-flag-568000" cluster
	I0307 10:07:23.284188   14035 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:07:23.284284   14035 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:07:23.284314   14035 cache.go:56] Caching tarball of preloaded images
	I0307 10:07:23.284497   14035 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:07:23.284516   14035 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:07:23.284650   14035 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/force-systemd-flag-568000/config.json ...
	I0307 10:07:23.284685   14035 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/force-systemd-flag-568000/config.json: {Name:mkbc722e09ce95abd45f1ce844035c4594133675 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:07:23.285489   14035 start.go:360] acquireMachinesLock for force-systemd-flag-568000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:07:23.285617   14035 start.go:364] duration metric: took 97.566µs to acquireMachinesLock for "force-systemd-flag-568000"
	I0307 10:07:23.285663   14035 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-568000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-568000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disable
Optimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:07:23.285757   14035 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:07:23.307242   14035 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 10:07:23.307495   14035 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:23.307591   14035 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:23.316676   14035 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59864
	I0307 10:07:23.317044   14035 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:23.317476   14035 main.go:141] libmachine: Using API Version  1
	I0307 10:07:23.317496   14035 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:23.317758   14035 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:23.317880   14035 main.go:141] libmachine: (force-systemd-flag-568000) Calling .GetMachineName
	I0307 10:07:23.317980   14035 main.go:141] libmachine: (force-systemd-flag-568000) Calling .DriverName
	I0307 10:07:23.318096   14035 start.go:159] libmachine.API.Create for "force-systemd-flag-568000" (driver="hyperkit")
	I0307 10:07:23.318125   14035 client.go:168] LocalClient.Create starting
	I0307 10:07:23.318160   14035 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:07:23.318210   14035 main.go:141] libmachine: Decoding PEM data...
	I0307 10:07:23.318227   14035 main.go:141] libmachine: Parsing certificate...
	I0307 10:07:23.318280   14035 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:07:23.318315   14035 main.go:141] libmachine: Decoding PEM data...
	I0307 10:07:23.318328   14035 main.go:141] libmachine: Parsing certificate...
	I0307 10:07:23.318342   14035 main.go:141] libmachine: Running pre-create checks...
	I0307 10:07:23.318352   14035 main.go:141] libmachine: (force-systemd-flag-568000) Calling .PreCreateCheck
	I0307 10:07:23.318430   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:23.318590   14035 main.go:141] libmachine: (force-systemd-flag-568000) Calling .GetConfigRaw
	I0307 10:07:23.328732   14035 main.go:141] libmachine: Creating machine...
	I0307 10:07:23.328757   14035 main.go:141] libmachine: (force-systemd-flag-568000) Calling .Create
	I0307 10:07:23.329025   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:23.329271   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | I0307 10:07:23.328975   14043 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:07:23.329396   14035 main.go:141] libmachine: (force-systemd-flag-568000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:07:23.504948   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | I0307 10:07:23.504852   14043 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-flag-568000/id_rsa...
	I0307 10:07:23.706648   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | I0307 10:07:23.706577   14043 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-flag-568000/force-systemd-flag-568000.rawdisk...
	I0307 10:07:23.706661   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | Writing magic tar header
	I0307 10:07:23.706672   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | Writing SSH key tar header
	I0307 10:07:23.707444   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | I0307 10:07:23.707385   14043 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-flag-568000 ...
	I0307 10:07:24.069156   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:24.069174   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-flag-568000/hyperkit.pid
	I0307 10:07:24.069237   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | Using UUID 064aff8f-9808-4f6c-845a-4a5603f27291
	I0307 10:07:24.104097   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:07:24.104191   14035 client.go:171] duration metric: took 786.042899ms to LocalClient.Create
	I0307 10:07:26.105516   14035 start.go:128] duration metric: took 2.819695422s to createHost
	I0307 10:07:26.105550   14035 start.go:83] releasing machines lock for "force-systemd-flag-568000", held for 2.819875751s
	W0307 10:07:26.105657   14035 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:07:26.106035   14035 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:26.106066   14035 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:26.114590   14035 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59866
	I0307 10:07:26.114939   14035 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:26.115285   14035 main.go:141] libmachine: Using API Version  1
	I0307 10:07:26.115304   14035 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:26.115551   14035 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:26.115892   14035 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:26.115919   14035 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:26.123843   14035 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59868
	I0307 10:07:26.124174   14035 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:26.124503   14035 main.go:141] libmachine: Using API Version  1
	I0307 10:07:26.124513   14035 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:26.124730   14035 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:26.124840   14035 main.go:141] libmachine: (force-systemd-flag-568000) Calling .GetState
	I0307 10:07:26.124929   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:26.124953   14035 main.go:141] libmachine: (force-systemd-flag-568000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-flag-568000/hyperkit.json: no such file or directory
	I0307 10:07:26.124962   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | hyperkit pid from json: 0
	I0307 10:07:26.125024   14035 main.go:141] libmachine: (force-systemd-flag-568000) Calling .DriverName
	I0307 10:07:26.169319   14035 out.go:177] * Deleting "force-systemd-flag-568000" in hyperkit ...
	I0307 10:07:26.190222   14035 main.go:141] libmachine: (force-systemd-flag-568000) Calling .Remove
	I0307 10:07:26.190519   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:26.190546   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:26.190669   14035 main.go:141] libmachine: (force-systemd-flag-568000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-flag-568000/hyperkit.json: no such file or directory
	I0307 10:07:26.190725   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | hyperkit pid from json: 0
	W0307 10:07:26.209097   14035 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:07:26.209117   14035 start.go:728] Will try again in 5 seconds ...
	I0307 10:07:31.209615   14035 start.go:360] acquireMachinesLock for force-systemd-flag-568000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:07:34.040156   14035 start.go:364] duration metric: took 2.830457041s to acquireMachinesLock for "force-systemd-flag-568000"
	I0307 10:07:34.040212   14035 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-568000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-568000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disable
Optimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:07:34.040317   14035 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:07:34.061597   14035 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 10:07:34.061683   14035 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:34.061729   14035 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:34.069534   14035 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59888
	I0307 10:07:34.069872   14035 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:34.070216   14035 main.go:141] libmachine: Using API Version  1
	I0307 10:07:34.070244   14035 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:34.070467   14035 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:34.070572   14035 main.go:141] libmachine: (force-systemd-flag-568000) Calling .GetMachineName
	I0307 10:07:34.070656   14035 main.go:141] libmachine: (force-systemd-flag-568000) Calling .DriverName
	I0307 10:07:34.070767   14035 start.go:159] libmachine.API.Create for "force-systemd-flag-568000" (driver="hyperkit")
	I0307 10:07:34.070790   14035 client.go:168] LocalClient.Create starting
	I0307 10:07:34.070822   14035 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:07:34.070856   14035 main.go:141] libmachine: Decoding PEM data...
	I0307 10:07:34.070867   14035 main.go:141] libmachine: Parsing certificate...
	I0307 10:07:34.070928   14035 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:07:34.070959   14035 main.go:141] libmachine: Decoding PEM data...
	I0307 10:07:34.070973   14035 main.go:141] libmachine: Parsing certificate...
	I0307 10:07:34.070987   14035 main.go:141] libmachine: Running pre-create checks...
	I0307 10:07:34.070993   14035 main.go:141] libmachine: (force-systemd-flag-568000) Calling .PreCreateCheck
	I0307 10:07:34.071074   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:34.071107   14035 main.go:141] libmachine: (force-systemd-flag-568000) Calling .GetConfigRaw
	I0307 10:07:34.105896   14035 main.go:141] libmachine: Creating machine...
	I0307 10:07:34.105959   14035 main.go:141] libmachine: (force-systemd-flag-568000) Calling .Create
	I0307 10:07:34.106205   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:34.106471   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | I0307 10:07:34.106161   14080 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:07:34.106559   14035 main.go:141] libmachine: (force-systemd-flag-568000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:07:34.334736   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | I0307 10:07:34.334636   14080 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-flag-568000/id_rsa...
	I0307 10:07:34.477439   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | I0307 10:07:34.477351   14080 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-flag-568000/force-systemd-flag-568000.rawdisk...
	I0307 10:07:34.477451   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | Writing magic tar header
	I0307 10:07:34.477461   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | Writing SSH key tar header
	I0307 10:07:34.478164   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | I0307 10:07:34.478125   14080 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-flag-568000 ...
	I0307 10:07:34.840400   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:34.840418   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-flag-568000/hyperkit.pid
	I0307 10:07:34.840429   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | Using UUID 06d7bfe1-74e7-42dc-8811-bd6d0d8854e3
	I0307 10:07:34.876353   14035 main.go:141] libmachine: (force-systemd-flag-568000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:07:34.876442   14035 client.go:171] duration metric: took 805.631854ms to LocalClient.Create
	I0307 10:07:36.878541   14035 start.go:128] duration metric: took 2.838106483s to createHost
	I0307 10:07:36.878568   14035 start.go:83] releasing machines lock for "force-systemd-flag-568000", held for 2.838348338s
	W0307 10:07:36.878704   14035 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p force-systemd-flag-568000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p force-systemd-flag-568000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:07:36.925210   14035 out.go:177] 
	W0307 10:07:36.947175   14035 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:07:36.947233   14035 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:07:36.947258   14035 out.go:239] * Related issues:
	* Related issues:
	W0307 10:07:36.947281   14035 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:07:36.947300   14035 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:07:36.990204   14035 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-flag-568000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-flag-568000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p force-systemd-flag-568000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (139.627079ms)

                                                
                                                
-- stdout --
	* The control-plane node force-systemd-flag-568000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p force-systemd-flag-568000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-amd64 -p force-systemd-flag-568000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83
docker_test.go:106: *** TestForceSystemdFlag FAILED at 2024-03-07 10:07:37.218509 -0800 PST m=+1209.995889364
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-flag-568000 -n force-systemd-flag-568000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-flag-568000 -n force-systemd-flag-568000: exit status 7 (73.456932ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-flag-568000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-flag-568000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-flag-568000
--- FAIL: TestForceSystemdFlag (14.76s)

                                                
                                    
x
+
TestForceSystemdEnv (17.67s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-env-752000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-env-752000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (17.185055092s)

                                                
                                                
-- stdout --
	* [force-systemd-env-752000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=true
	* Using the hyperkit driver based on user configuration
	* Downloading driver docker-machine-driver-hyperkit:
	* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:
	
	    $ sudo chown root:wheel /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit 
	    $ sudo chmod u+s /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit 
	
	
	* Starting "force-systemd-env-752000" primary control-plane node in "force-systemd-env-752000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "force-systemd-env-752000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:07:13.106189   13991 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:07:13.106855   13991 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:07:13.106864   13991 out.go:304] Setting ErrFile to fd 2...
	I0307 10:07:13.106869   13991 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:07:13.107464   13991 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:07:13.109002   13991 out.go:298] Setting JSON to false
	I0307 10:07:13.131793   13991 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7604,"bootTime":1709827229,"procs":437,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:07:13.131903   13991 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:07:13.154678   13991 out.go:177] * [force-systemd-env-752000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:07:13.196826   13991 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:07:13.196888   13991 notify.go:220] Checking for updates...
	I0307 10:07:13.240786   13991 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:07:13.262787   13991 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:07:13.283648   13991 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:07:13.305818   13991 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:07:13.326787   13991 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true
	I0307 10:07:13.348004   13991 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:07:13.348088   13991 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:07:13.376826   13991 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:07:13.418748   13991 start.go:297] selected driver: hyperkit
	I0307 10:07:13.418786   13991 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:07:13.418828   13991 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:07:13.423194   13991 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:07:16.612345   13991 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/testdata/hyperkit-driver-without-version:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	W0307 10:07:16.625929   13991 install.go:62] docker-machine-driver-hyperkit: exit status 1
	I0307 10:07:16.647013   13991 out.go:177] * Downloading driver docker-machine-driver-hyperkit:
	I0307 10:07:16.689498   13991 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64.sha256 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:17.109299   13991 driver.go:46] failed to download arch specific driver: getter: &{Ctx:context.Background Src:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64.sha256 Dst:/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit.download Pwd: Mode:2 Umask:---------- Detectors:[0x864cf80 0x864cf80 0x864cf80 0x864cf80 0x864cf80 0x864cf80 0x864cf80] Decompressors:map[bz2:0xc000765580 gz:0xc000765588 tar:0xc000765530 tar.bz2:0xc000765540 tar.gz:0xc000765550 tar.xz:0xc000765560 tar.zst:0xc000765570 tbz2:0xc000765540 tgz:0xc000765550 txz:0xc000765560 tzst:0xc000765570 xz:0xc000765590 zip:0xc0007655a0 zst:0xc000765598] Getters:map[file:0xc0020741d0 http:0xc0007a61e0 https:0xc0007a6230] Dir:false ProgressListener:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downl
oading checksum file: bad response code: 404. trying to get the common version
	I0307 10:07:17.109372   13991 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit.sha256 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:19.049211   13991 install.go:79] stdout: 
	I0307 10:07:19.070861   13991 out.go:177] * The 'hyperkit' driver requires elevated permissions. The following commands will be executed:
	
	    $ sudo chown root:wheel /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit 
	    $ sudo chmod u+s /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit 
	
	
	I0307 10:07:19.091509   13991 install.go:99] testing: [sudo -n chown root:wheel /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit]
	I0307 10:07:19.107721   13991 install.go:106] running: [sudo chown root:wheel /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit]
	I0307 10:07:19.123129   13991 install.go:99] testing: [sudo -n chmod u+s /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit]
	I0307 10:07:19.137392   13991 install.go:106] running: [sudo chmod u+s /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit]
	I0307 10:07:19.151796   13991 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:07:19.152026   13991 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0307 10:07:19.152082   13991 cni.go:84] Creating CNI manager for ""
	I0307 10:07:19.152101   13991 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:07:19.152106   13991 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 10:07:19.152174   13991 start.go:340] cluster config:
	{Name:force-systemd-env-752000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-752000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluste
r.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:07:19.152256   13991 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:07:19.194400   13991 out.go:177] * Starting "force-systemd-env-752000" primary control-plane node in "force-systemd-env-752000" cluster
	I0307 10:07:19.215440   13991 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:07:19.215472   13991 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:07:19.215490   13991 cache.go:56] Caching tarball of preloaded images
	I0307 10:07:19.215594   13991 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:07:19.215603   13991 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:07:19.215709   13991 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/force-systemd-env-752000/config.json ...
	I0307 10:07:19.215736   13991 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/force-systemd-env-752000/config.json: {Name:mk6d42a8fc6a8751fd9ff54f828416293c34c9d4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:07:19.216040   13991 start.go:360] acquireMachinesLock for force-systemd-env-752000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:07:19.216099   13991 start.go:364] duration metric: took 46.406µs to acquireMachinesLock for "force-systemd-env-752000"
	I0307 10:07:19.216125   13991 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-752000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-752000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOp
timizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:07:19.216168   13991 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:07:19.237300   13991 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 10:07:19.237443   13991 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:19.237496   13991 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:19.555174   13991 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59848
	I0307 10:07:19.555515   13991 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:19.555937   13991 main.go:141] libmachine: Using API Version  1
	I0307 10:07:19.555955   13991 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:19.556194   13991 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:19.556292   13991 main.go:141] libmachine: (force-systemd-env-752000) Calling .GetMachineName
	I0307 10:07:19.556377   13991 main.go:141] libmachine: (force-systemd-env-752000) Calling .DriverName
	I0307 10:07:19.556492   13991 start.go:159] libmachine.API.Create for "force-systemd-env-752000" (driver="hyperkit")
	I0307 10:07:19.556525   13991 client.go:168] LocalClient.Create starting
	I0307 10:07:19.556556   13991 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:07:19.556607   13991 main.go:141] libmachine: Decoding PEM data...
	I0307 10:07:19.556625   13991 main.go:141] libmachine: Parsing certificate...
	I0307 10:07:19.556678   13991 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:07:19.556714   13991 main.go:141] libmachine: Decoding PEM data...
	I0307 10:07:19.556723   13991 main.go:141] libmachine: Parsing certificate...
	I0307 10:07:19.556736   13991 main.go:141] libmachine: Running pre-create checks...
	I0307 10:07:19.556748   13991 main.go:141] libmachine: (force-systemd-env-752000) Calling .PreCreateCheck
	I0307 10:07:19.556821   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:19.557210   13991 main.go:141] libmachine: (force-systemd-env-752000) Calling .GetConfigRaw
	I0307 10:07:19.557629   13991 main.go:141] libmachine: Creating machine...
	I0307 10:07:19.557639   13991 main.go:141] libmachine: (force-systemd-env-752000) Calling .Create
	I0307 10:07:19.557718   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:19.557840   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | I0307 10:07:19.557708   14021 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:07:19.557888   13991 main.go:141] libmachine: (force-systemd-env-752000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:07:19.734044   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | I0307 10:07:19.733980   14021 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-env-752000/id_rsa...
	I0307 10:07:19.835935   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | I0307 10:07:19.835872   14021 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-env-752000/force-systemd-env-752000.rawdisk...
	I0307 10:07:19.835950   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | Writing magic tar header
	I0307 10:07:19.836015   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | Writing SSH key tar header
	I0307 10:07:19.836583   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | I0307 10:07:19.836538   14021 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-env-752000 ...
	I0307 10:07:20.199538   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:20.199559   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-env-752000/hyperkit.pid
	I0307 10:07:20.199599   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | Using UUID b1bbfacc-438b-4d07-8d59-d5aef073ae2e
	I0307 10:07:20.248691   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:07:20.248774   13991 client.go:171] duration metric: took 692.227549ms to LocalClient.Create
	I0307 10:07:22.249722   13991 start.go:128] duration metric: took 3.033484365s to createHost
	I0307 10:07:22.249736   13991 start.go:83] releasing machines lock for "force-systemd-env-752000", held for 3.033582991s
	W0307 10:07:22.249752   13991 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:07:22.250059   13991 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:22.250083   13991 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:22.258117   13991 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59859
	I0307 10:07:22.258446   13991 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:22.258783   13991 main.go:141] libmachine: Using API Version  1
	I0307 10:07:22.258792   13991 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:22.258986   13991 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:22.259308   13991 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:22.259333   13991 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:22.267297   13991 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59861
	I0307 10:07:22.267626   13991 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:22.267995   13991 main.go:141] libmachine: Using API Version  1
	I0307 10:07:22.268011   13991 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:22.268215   13991 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:22.268315   13991 main.go:141] libmachine: (force-systemd-env-752000) Calling .GetState
	I0307 10:07:22.268397   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:22.268427   13991 main.go:141] libmachine: (force-systemd-env-752000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-env-752000/hyperkit.json: no such file or directory
	I0307 10:07:22.268433   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | hyperkit pid from json: 0
	I0307 10:07:22.268478   13991 main.go:141] libmachine: (force-systemd-env-752000) Calling .DriverName
	I0307 10:07:22.319081   13991 out.go:177] * Deleting "force-systemd-env-752000" in hyperkit ...
	I0307 10:07:22.340245   13991 main.go:141] libmachine: (force-systemd-env-752000) Calling .Remove
	I0307 10:07:22.340367   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:22.340375   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:22.340386   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | hyperkit pid from json: 0
	I0307 10:07:22.340399   13991 main.go:141] libmachine: (force-systemd-env-752000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-env-752000/hyperkit.json: no such file or directory
	W0307 10:07:22.357118   13991 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:07:22.357131   13991 start.go:728] Will try again in 5 seconds ...
	I0307 10:07:27.359364   13991 start.go:360] acquireMachinesLock for force-systemd-env-752000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:07:27.359541   13991 start.go:364] duration metric: took 144.618µs to acquireMachinesLock for "force-systemd-env-752000"
	I0307 10:07:27.359583   13991 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-752000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-752000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOp
timizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:07:27.359698   13991 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:07:27.382019   13991 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 10:07:27.382180   13991 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:07:27.382237   13991 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:07:27.391686   13991 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59870
	I0307 10:07:27.392049   13991 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:07:27.392430   13991 main.go:141] libmachine: Using API Version  1
	I0307 10:07:27.392444   13991 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:07:27.392685   13991 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:07:27.392809   13991 main.go:141] libmachine: (force-systemd-env-752000) Calling .GetMachineName
	I0307 10:07:27.392897   13991 main.go:141] libmachine: (force-systemd-env-752000) Calling .DriverName
	I0307 10:07:27.392993   13991 start.go:159] libmachine.API.Create for "force-systemd-env-752000" (driver="hyperkit")
	I0307 10:07:27.393012   13991 client.go:168] LocalClient.Create starting
	I0307 10:07:27.393039   13991 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:07:27.393090   13991 main.go:141] libmachine: Decoding PEM data...
	I0307 10:07:27.393101   13991 main.go:141] libmachine: Parsing certificate...
	I0307 10:07:27.393142   13991 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:07:27.393177   13991 main.go:141] libmachine: Decoding PEM data...
	I0307 10:07:27.393201   13991 main.go:141] libmachine: Parsing certificate...
	I0307 10:07:27.393213   13991 main.go:141] libmachine: Running pre-create checks...
	I0307 10:07:27.393219   13991 main.go:141] libmachine: (force-systemd-env-752000) Calling .PreCreateCheck
	I0307 10:07:27.393307   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:27.393330   13991 main.go:141] libmachine: (force-systemd-env-752000) Calling .GetConfigRaw
	I0307 10:07:27.393790   13991 main.go:141] libmachine: Creating machine...
	I0307 10:07:27.393799   13991 main.go:141] libmachine: (force-systemd-env-752000) Calling .Create
	I0307 10:07:27.393880   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:27.394014   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | I0307 10:07:27.393869   14049 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:07:27.394060   13991 main.go:141] libmachine: (force-systemd-env-752000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:07:27.568162   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | I0307 10:07:27.568077   14049 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-env-752000/id_rsa...
	I0307 10:07:27.683188   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | I0307 10:07:27.683111   14049 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-env-752000/force-systemd-env-752000.rawdisk...
	I0307 10:07:27.683201   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | Writing magic tar header
	I0307 10:07:27.683222   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | Writing SSH key tar header
	I0307 10:07:27.683822   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | I0307 10:07:27.683786   14049 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-env-752000 ...
	I0307 10:07:28.044604   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:07:28.044623   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/force-systemd-env-752000/hyperkit.pid
	I0307 10:07:28.044656   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | Using UUID 0a2a4d9c-bc86-4f00-a6e8-a8c009c171de
	I0307 10:07:28.080749   13991 main.go:141] libmachine: (force-systemd-env-752000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:07:28.080833   13991 client.go:171] duration metric: took 687.80392ms to LocalClient.Create
	I0307 10:07:30.081282   13991 start.go:128] duration metric: took 2.721527044s to createHost
	I0307 10:07:30.081302   13991 start.go:83] releasing machines lock for "force-systemd-env-752000", held for 2.721706071s
	W0307 10:07:30.081407   13991 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p force-systemd-env-752000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p force-systemd-env-752000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:07:30.125304   13991 out.go:177] 
	W0307 10:07:30.146495   13991 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:07:30.146551   13991 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:07:30.146570   13991 out.go:239] * Related issues:
	* Related issues:
	W0307 10:07:30.146608   13991 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:07:30.146701   13991 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:07:30.168321   13991 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-env-752000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-env-752000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p force-systemd-env-752000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (140.212882ms)

                                                
                                                
-- stdout --
	* The control-plane node force-systemd-env-752000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p force-systemd-env-752000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-amd64 -p force-systemd-env-752000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83
docker_test.go:166: *** TestForceSystemdEnv FAILED at 2024-03-07 10:07:30.375134 -0800 PST m=+1203.152620714
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-752000 -n force-systemd-env-752000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-752000 -n force-systemd-env-752000: exit status 7 (75.117478ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-env-752000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-env-752000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-env-752000
--- FAIL: TestForceSystemdEnv (17.67s)

                                                
                                    
x
+
TestErrorSpam/setup (11.26s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -p nospam-025000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 --driver=hyperkit 
error_spam_test.go:81: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p nospam-025000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 --driver=hyperkit : exit status 60 (11.257482958s)

                                                
                                                
-- stdout --
	* [nospam-025000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "nospam-025000" primary control-plane node in "nospam-025000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
	* Deleting "nospam-025000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p nospam-025000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
error_spam_test.go:83: "out/minikube-darwin-amd64 start -p nospam-025000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 --driver=hyperkit " failed: exit status 60
error_spam_test.go:96: unexpected stderr: "! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "* Failed to start hyperkit VM. Running \"minikube delete -p nospam-025000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "* Suggestion: "
error_spam_test.go:96: unexpected stderr: "    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing."
error_spam_test.go:96: unexpected stderr: "    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver."
error_spam_test.go:96: unexpected stderr: "* Related issues:"
error_spam_test.go:96: unexpected stderr: "  - https://github.com/kubernetes/minikube/issues/6028"
error_spam_test.go:96: unexpected stderr: "  - https://github.com/kubernetes/minikube/issues/5594"
error_spam_test.go:110: minikube stdout:
* [nospam-025000] minikube v1.32.0 on Darwin 14.3.1
- MINIKUBE_LOCATION=18239
- KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the hyperkit driver based on user configuration
* Starting "nospam-025000" primary control-plane node in "nospam-025000" cluster
* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
* Deleting "nospam-025000" in hyperkit ...
* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...

                                                
                                                

                                                
                                                
error_spam_test.go:111: minikube stderr:
! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Failed to start hyperkit VM. Running "minikube delete -p nospam-025000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
* Related issues:
- https://github.com/kubernetes/minikube/issues/6028
- https://github.com/kubernetes/minikube/issues/5594
error_spam_test.go:121: missing kubeadm init sub-step "Generating certificates and keys ..."
error_spam_test.go:121: missing kubeadm init sub-step "Booting up control plane ..."
error_spam_test.go:121: missing kubeadm init sub-step "Configuring RBAC rules ..."
--- FAIL: TestErrorSpam/setup (11.26s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (11.27s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-899000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit 
functional_test.go:2230: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-899000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit : exit status 60 (11.197036805s)

                                                
                                                
-- stdout --
	* [functional-899000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "functional-899000" primary control-plane node in "functional-899000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	* Deleting "functional-899000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Local proxy ignored: not passing HTTP_PROXY=localhost:58981 to docker env.
	! Local proxy ignored: not passing HTTP_PROXY=localhost:58981 to docker env.
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! Local proxy ignored: not passing HTTP_PROXY=localhost:58981 to docker env.
	* Failed to start hyperkit VM. Running "minikube delete -p functional-899000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
functional_test.go:2232: failed minikube start. args "out/minikube-darwin-amd64 start -p functional-899000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit ": exit status 60
functional_test.go:2237: start stdout=* [functional-899000] minikube v1.32.0 on Darwin 14.3.1
- MINIKUBE_LOCATION=18239
- KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the hyperkit driver based on user configuration
* Starting "functional-899000" primary control-plane node in "functional-899000" cluster
* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
* Deleting "functional-899000" in hyperkit ...
* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

                                                
                                                

                                                
                                                
, want: *Found network options:*
functional_test.go:2242: start stderr=! Local proxy ignored: not passing HTTP_PROXY=localhost:58981 to docker env.
! Local proxy ignored: not passing HTTP_PROXY=localhost:58981 to docker env.
! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
! Local proxy ignored: not passing HTTP_PROXY=localhost:58981 to docker env.
* Failed to start hyperkit VM. Running "minikube delete -p functional-899000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
* Related issues:
- https://github.com/kubernetes/minikube/issues/6028
- https://github.com/kubernetes/minikube/issues/5594
, want: *You appear to be using a proxy*
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (74.912716ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/StartWithProxy (11.27s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (5.91s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-899000 --alsologtostderr -v=8
functional_test.go:655: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-899000 --alsologtostderr -v=8: exit status 60 (5.830333902s)

                                                
                                                
-- stdout --
	* [functional-899000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "functional-899000" primary control-plane node in "functional-899000" cluster
	* Restarting existing hyperkit VM for "functional-899000" ...
	* Restarting existing hyperkit VM for "functional-899000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 09:55:37.949282   12083 out.go:291] Setting OutFile to fd 1 ...
	I0307 09:55:37.949481   12083 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:55:37.949487   12083 out.go:304] Setting ErrFile to fd 2...
	I0307 09:55:37.949490   12083 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:55:37.949669   12083 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 09:55:37.951867   12083 out.go:298] Setting JSON to false
	I0307 09:55:37.974407   12083 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":6908,"bootTime":1709827229,"procs":440,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 09:55:37.974515   12083 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 09:55:37.996080   12083 out.go:177] * [functional-899000] minikube v1.32.0 on Darwin 14.3.1
	I0307 09:55:38.059889   12083 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 09:55:38.038273   12083 notify.go:220] Checking for updates...
	I0307 09:55:38.103083   12083 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 09:55:38.123767   12083 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 09:55:38.145027   12083 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 09:55:38.166352   12083 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 09:55:38.187904   12083 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 09:55:38.209769   12083 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 09:55:38.209950   12083 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 09:55:38.210481   12083 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:55:38.210536   12083 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:55:38.219538   12083 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:58999
	I0307 09:55:38.219904   12083 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:55:38.220360   12083 main.go:141] libmachine: Using API Version  1
	I0307 09:55:38.220370   12083 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:55:38.220614   12083 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:55:38.220732   12083 main.go:141] libmachine: (functional-899000) Calling .DriverName
	I0307 09:55:38.250146   12083 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 09:55:38.292203   12083 start.go:297] selected driver: hyperkit
	I0307 09:55:38.292226   12083 start.go:901] validating driver "hyperkit" against &{Name:functional-899000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-899000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 09:55:38.292390   12083 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 09:55:38.292532   12083 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 09:55:38.292688   12083 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 09:55:38.301268   12083 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 09:55:38.305328   12083 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:55:38.305350   12083 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 09:55:38.308122   12083 cni.go:84] Creating CNI manager for ""
	I0307 09:55:38.308150   12083 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 09:55:38.308218   12083 start.go:340] cluster config:
	{Name:functional-899000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-899000 Namespace:default APISe
rverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disa
bleMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 09:55:38.308314   12083 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 09:55:38.351894   12083 out.go:177] * Starting "functional-899000" primary control-plane node in "functional-899000" cluster
	I0307 09:55:38.377784   12083 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 09:55:38.377889   12083 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 09:55:38.377918   12083 cache.go:56] Caching tarball of preloaded images
	I0307 09:55:38.378065   12083 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 09:55:38.378079   12083 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 09:55:38.378198   12083 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/functional-899000/config.json ...
	I0307 09:55:38.378909   12083 start.go:360] acquireMachinesLock for functional-899000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 09:55:38.378979   12083 start.go:364] duration metric: took 51.174µs to acquireMachinesLock for "functional-899000"
	I0307 09:55:38.379011   12083 start.go:96] Skipping create...Using existing machine configuration
	I0307 09:55:38.379025   12083 fix.go:54] fixHost starting: 
	I0307 09:55:38.379316   12083 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:55:38.379345   12083 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:55:38.387678   12083 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59001
	I0307 09:55:38.388030   12083 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:55:38.388404   12083 main.go:141] libmachine: Using API Version  1
	I0307 09:55:38.388419   12083 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:55:38.388653   12083 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:55:38.388781   12083 main.go:141] libmachine: (functional-899000) Calling .DriverName
	I0307 09:55:38.388886   12083 main.go:141] libmachine: (functional-899000) Calling .GetState
	I0307 09:55:38.388967   12083 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:55:38.388993   12083 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
	I0307 09:55:38.389010   12083 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
	I0307 09:55:38.389039   12083 fix.go:112] recreateIfNeeded on functional-899000: state=Stopped err=<nil>
	I0307 09:55:38.389054   12083 main.go:141] libmachine: (functional-899000) Calling .DriverName
	W0307 09:55:38.389129   12083 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 09:55:38.409849   12083 out.go:177] * Restarting existing hyperkit VM for "functional-899000" ...
	I0307 09:55:38.451636   12083 main.go:141] libmachine: (functional-899000) Calling .Start
	I0307 09:55:38.451779   12083 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:55:38.451811   12083 main.go:141] libmachine: (functional-899000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.pid
	I0307 09:55:38.451894   12083 main.go:141] libmachine: (functional-899000) DBG | Using UUID a96a8196-4cbd-47d6-b323-4a8018c7e122
	I0307 09:55:38.453050   12083 main.go:141] libmachine: (functional-899000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 09:55:38.453130   12083 fix.go:56] duration metric: took 74.109082ms for fixHost
	I0307 09:55:38.453140   12083 start.go:83] releasing machines lock for "functional-899000", held for 74.150415ms
	W0307 09:55:38.453154   12083 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 09:55:38.453216   12083 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 09:55:38.453222   12083 start.go:728] Will try again in 5 seconds ...
	I0307 09:55:43.454889   12083 start.go:360] acquireMachinesLock for functional-899000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 09:55:43.454990   12083 start.go:364] duration metric: took 64.045µs to acquireMachinesLock for "functional-899000"
	I0307 09:55:43.455009   12083 start.go:96] Skipping create...Using existing machine configuration
	I0307 09:55:43.455014   12083 fix.go:54] fixHost starting: 
	I0307 09:55:43.455252   12083 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:55:43.455300   12083 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:55:43.464218   12083 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59003
	I0307 09:55:43.464621   12083 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:55:43.465095   12083 main.go:141] libmachine: Using API Version  1
	I0307 09:55:43.465108   12083 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:55:43.465353   12083 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:55:43.465465   12083 main.go:141] libmachine: (functional-899000) Calling .DriverName
	I0307 09:55:43.465558   12083 main.go:141] libmachine: (functional-899000) Calling .GetState
	I0307 09:55:43.465637   12083 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:55:43.465675   12083 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
	I0307 09:55:43.465685   12083 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
	I0307 09:55:43.465688   12083 fix.go:112] recreateIfNeeded on functional-899000: state=Stopped err=<nil>
	I0307 09:55:43.465698   12083 main.go:141] libmachine: (functional-899000) Calling .DriverName
	W0307 09:55:43.465782   12083 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 09:55:43.487272   12083 out.go:177] * Restarting existing hyperkit VM for "functional-899000" ...
	I0307 09:55:43.528889   12083 main.go:141] libmachine: (functional-899000) Calling .Start
	I0307 09:55:43.529089   12083 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:55:43.529121   12083 main.go:141] libmachine: (functional-899000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.pid
	I0307 09:55:43.529189   12083 main.go:141] libmachine: (functional-899000) DBG | Using UUID a96a8196-4cbd-47d6-b323-4a8018c7e122
	I0307 09:55:43.530827   12083 main.go:141] libmachine: (functional-899000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 09:55:43.530905   12083 fix.go:56] duration metric: took 75.888522ms for fixHost
	I0307 09:55:43.530934   12083 start.go:83] releasing machines lock for "functional-899000", held for 75.936318ms
	W0307 09:55:43.530983   12083 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-899000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p functional-899000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 09:55:43.572702   12083 out.go:177] 
	W0307 09:55:43.594021   12083 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 09:55:43.594139   12083 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 09:55:43.594174   12083 out.go:239] * Related issues:
	* Related issues:
	W0307 09:55:43.594196   12083 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 09:55:43.594228   12083 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 09:55:43.635872   12083 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:657: failed to soft start minikube. args "out/minikube-darwin-amd64 start -p functional-899000 --alsologtostderr -v=8": exit status 60
functional_test.go:659: soft start took 5.831709187s for "functional-899000" cluster.
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (75.175411ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/SoftStart (5.91s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
functional_test.go:677: (dbg) Non-zero exit: kubectl config current-context: exit status 1 (36.615477ms)

                                                
                                                
** stderr ** 
	error: current-context is not set

                                                
                                                
** /stderr **
functional_test.go:679: failed to get current-context. args "kubectl config current-context" : exit status 1
functional_test.go:683: expected current-context = "functional-899000", but got *""*
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (74.246242ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/KubeContext (0.11s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-899000 get po -A
functional_test.go:692: (dbg) Non-zero exit: kubectl --context functional-899000 get po -A: exit status 1 (36.876757ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-899000

                                                
                                                
** /stderr **
functional_test.go:694: failed to get kubectl pods: args "kubectl --context functional-899000 get po -A" : exit status 1
functional_test.go:698: expected stderr to be empty but got *"Error in configuration: context was not found for specified context: functional-899000\n"*: args "kubectl --context functional-899000 get po -A"
functional_test.go:701: expected stdout to include *kube-system* but got *""*. args: "kubectl --context functional-899000 get po -A"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (74.129329ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh sudo crictl images
functional_test.go:1120: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh sudo crictl images: exit status 83 (139.521702ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1122: failed to get images by "out/minikube-darwin-amd64 -p functional-899000 ssh sudo crictl images" ssh exit status 83
functional_test.go:1126: expected sha for pause:3.3 "0184c1613d929" to be in the output but got *
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --*
--- FAIL: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.14s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (0.51s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh sudo docker rmi registry.k8s.io/pause:latest
functional_test.go:1143: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh sudo docker rmi registry.k8s.io/pause:latest: exit status 83 (139.003602ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1146: failed to manually delete image "out/minikube-darwin-amd64 -p functional-899000 ssh sudo docker rmi registry.k8s.io/pause:latest" : exit status 83
functional_test.go:1149: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 83 (137.635214ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1154: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 cache reload
functional_test.go:1159: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 83 (138.350127ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1161: expected "out/minikube-darwin-amd64 -p functional-899000 ssh sudo crictl inspecti registry.k8s.io/pause:latest" to run successfully but got error: exit status 83
--- FAIL: TestFunctional/serial/CacheCmd/cache/cache_reload (0.51s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.58s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 kubectl -- --context functional-899000 get pods
functional_test.go:712: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 kubectl -- --context functional-899000 get pods: exit status 1 (500.987841ms)

                                                
                                                
** stderr ** 
	Error in configuration: 
	* context was not found for specified context: functional-899000
	* no server found for cluster "functional-899000"

                                                
                                                
** /stderr **
functional_test.go:715: failed to get pods. args "out/minikube-darwin-amd64 -p functional-899000 kubectl -- --context functional-899000 get pods": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (74.09403ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/MinikubeKubectlCmd (0.58s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.74s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-899000 get pods
functional_test.go:737: (dbg) Non-zero exit: out/kubectl --context functional-899000 get pods: exit status 1 (664.02329ms)

                                                
                                                
** stderr ** 
	Error in configuration: 
	* context was not found for specified context: functional-899000
	* no server found for cluster "functional-899000"

                                                
                                                
** /stderr **
functional_test.go:740: failed to run kubectl directly. args "out/kubectl --context functional-899000 get pods": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (73.426034ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.74s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (5.9s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-899000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:753: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-899000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: exit status 60 (5.824178308s)

                                                
                                                
-- stdout --
	* [functional-899000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "functional-899000" primary control-plane node in "functional-899000" cluster
	* Restarting existing hyperkit VM for "functional-899000" ...
	* Restarting existing hyperkit VM for "functional-899000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p functional-899000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
functional_test.go:755: failed to restart minikube. args "out/minikube-darwin-amd64 start -p functional-899000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all": exit status 60
functional_test.go:757: restart took 5.824366578s for "functional-899000" cluster.
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (73.832165ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/ExtraConfig (5.90s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-899000 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:806: (dbg) Non-zero exit: kubectl --context functional-899000 get po -l tier=control-plane -n kube-system -o=json: exit status 1 (36.899347ms)

                                                
                                                
** stderr ** 
	error: context "functional-899000" does not exist

                                                
                                                
** /stderr **
functional_test.go:808: failed to get components. args "kubectl --context functional-899000 get po -l tier=control-plane -n kube-system -o=json": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (73.624081ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (0.33s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 logs
functional_test.go:1232: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 logs: exit status 83 (322.624285ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| delete  | -p download-only-068000                                                                     | download-only-068000 | jenkins | v1.32.0 | 07 Mar 24 09:48 PST | 07 Mar 24 09:48 PST |
	| start   | --download-only -p                                                                          | binary-mirror-853000 | jenkins | v1.32.0 | 07 Mar 24 09:48 PST |                     |
	|         | binary-mirror-853000                                                                        |                      |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |
	|         | --binary-mirror                                                                             |                      |         |         |                     |                     |
	|         | http://127.0.0.1:58552                                                                      |                      |         |         |                     |                     |
	|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
	| delete  | -p binary-mirror-853000                                                                     | binary-mirror-853000 | jenkins | v1.32.0 | 07 Mar 24 09:48 PST | 07 Mar 24 09:48 PST |
	| addons  | enable dashboard -p                                                                         | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:48 PST |                     |
	|         | addons-392000                                                                               |                      |         |         |                     |                     |
	| addons  | disable dashboard -p                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:48 PST |                     |
	|         | addons-392000                                                                               |                      |         |         |                     |                     |
	| start   | -p addons-392000 --wait=true                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:48 PST | 07 Mar 24 09:52 PST |
	|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |
	|         | --addons=registry                                                                           |                      |         |         |                     |                     |
	|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |
	|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |
	|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |
	|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |
	|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin                                                               |                      |         |         |                     |                     |
	|         | --addons=yakd --driver=hyperkit                                                             |                      |         |         |                     |                     |
	|         |  --addons=ingress                                                                           |                      |         |         |                     |                     |
	|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |
	|         | --addons=helm-tiller                                                                        |                      |         |         |                     |                     |
	| ip      | addons-392000 ip                                                                            | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:52 PST | 07 Mar 24 09:52 PST |
	| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:52 PST | 07 Mar 24 09:52 PST |
	|         | registry --alsologtostderr                                                                  |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
	|         | helm-tiller --alsologtostderr                                                               |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| addons  | addons-392000 addons                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
	|         | disable metrics-server                                                                      |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p                                                                 | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
	|         | addons-392000                                                                               |                      |         |         |                     |                     |
	| ssh     | addons-392000 ssh curl -s                                                                   | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
	|         | http://127.0.0.1/ -H 'Host:                                                                 |                      |         |         |                     |                     |
	|         | nginx.example.com'                                                                          |                      |         |         |                     |                     |
	| ip      | addons-392000 ip                                                                            | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
	| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
	|         | ingress-dns --alsologtostderr                                                               |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
	|         | ingress --alsologtostderr -v=1                                                              |                      |         |         |                     |                     |
	| addons  | addons-392000 addons                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
	|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | addons-392000 addons                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
	|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| ssh     | addons-392000 ssh cat                                                                       | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
	|         | /opt/local-path-provisioner/pvc-7a18c37d-2d4d-4f64-8618-18046acb553b_default_test-pvc/file1 |                      |         |         |                     |                     |
	| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:54 PST |
	|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | disable nvidia-device-plugin                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
	|         | -p addons-392000                                                                            |                      |         |         |                     |                     |
	| addons  | disable cloud-spanner -p                                                                    | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
	|         | addons-392000                                                                               |                      |         |         |                     |                     |
	| addons  | enable headlamp                                                                             | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
	|         | -p addons-392000                                                                            |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
	|         | gcp-auth --alsologtostderr                                                                  |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| stop    | -p addons-392000                                                                            | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
	| addons  | enable dashboard -p                                                                         | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
	|         | addons-392000                                                                               |                      |         |         |                     |                     |
	| addons  | disable dashboard -p                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
	|         | addons-392000                                                                               |                      |         |         |                     |                     |
	| addons  | disable gvisor -p                                                                           | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
	|         | addons-392000                                                                               |                      |         |         |                     |                     |
	| delete  | -p addons-392000                                                                            | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:55 PST |
	| start   | -p nospam-025000 -n=1 --memory=2250 --wait=false                                            | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | --log_dir=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                    |                      |         |         |                     |                     |
	|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
	| start   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
	|         | start --dry-run                                                                             |                      |         |         |                     |                     |
	| start   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
	|         | start --dry-run                                                                             |                      |         |         |                     |                     |
	| start   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
	|         | start --dry-run                                                                             |                      |         |         |                     |                     |
	| pause   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
	|         | pause                                                                                       |                      |         |         |                     |                     |
	| pause   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
	|         | pause                                                                                       |                      |         |         |                     |                     |
	| pause   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
	|         | pause                                                                                       |                      |         |         |                     |                     |
	| unpause | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
	|         | unpause                                                                                     |                      |         |         |                     |                     |
	| unpause | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
	|         | unpause                                                                                     |                      |         |         |                     |                     |
	| unpause | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
	|         | unpause                                                                                     |                      |         |         |                     |                     |
	| stop    | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
	|         | stop                                                                                        |                      |         |         |                     |                     |
	| stop    | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
	|         | stop                                                                                        |                      |         |         |                     |                     |
	| stop    | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
	|         | stop                                                                                        |                      |         |         |                     |                     |
	| delete  | -p nospam-025000                                                                            | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
	| start   | -p functional-899000                                                                        | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | --memory=4000                                                                               |                      |         |         |                     |                     |
	|         | --apiserver-port=8441                                                                       |                      |         |         |                     |                     |
	|         | --wait=all --driver=hyperkit                                                                |                      |         |         |                     |                     |
	| start   | -p functional-899000                                                                        | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | --alsologtostderr -v=8                                                                      |                      |         |         |                     |                     |
	| cache   | functional-899000 cache add                                                                 | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
	|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
	| cache   | functional-899000 cache add                                                                 | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
	|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
	| cache   | functional-899000 cache add                                                                 | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| cache   | functional-899000 cache add                                                                 | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
	|         | minikube-local-cache-test:functional-899000                                                 |                      |         |         |                     |                     |
	| cache   | functional-899000 cache delete                                                              | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
	|         | minikube-local-cache-test:functional-899000                                                 |                      |         |         |                     |                     |
	| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
	|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
	| cache   | list                                                                                        | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
	| ssh     | functional-899000 ssh sudo                                                                  | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | crictl images                                                                               |                      |         |         |                     |                     |
	| ssh     | functional-899000                                                                           | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | ssh sudo docker rmi                                                                         |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| ssh     | functional-899000 ssh                                                                       | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| cache   | functional-899000 cache reload                                                              | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
	| ssh     | functional-899000 ssh                                                                       | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
	|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
	| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| kubectl | functional-899000 kubectl --                                                                | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | --context functional-899000                                                                 |                      |         |         |                     |                     |
	|         | get pods                                                                                    |                      |         |         |                     |                     |
	| start   | -p functional-899000                                                                        | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
	|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision                    |                      |         |         |                     |                     |
	|         | --wait=all                                                                                  |                      |         |         |                     |                     |
	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/07 09:55:49
	Running on machine: MacOS-Agent-2
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0307 09:55:49.756047   12182 out.go:291] Setting OutFile to fd 1 ...
	I0307 09:55:49.756310   12182 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:55:49.756313   12182 out.go:304] Setting ErrFile to fd 2...
	I0307 09:55:49.756316   12182 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:55:49.756491   12182 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 09:55:49.757855   12182 out.go:298] Setting JSON to false
	I0307 09:55:49.780200   12182 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":6920,"bootTime":1709827229,"procs":435,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 09:55:49.780293   12182 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 09:55:49.803893   12182 out.go:177] * [functional-899000] minikube v1.32.0 on Darwin 14.3.1
	I0307 09:55:49.845967   12182 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 09:55:49.867683   12182 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 09:55:49.846015   12182 notify.go:220] Checking for updates...
	I0307 09:55:49.888893   12182 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 09:55:49.909786   12182 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 09:55:49.932331   12182 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 09:55:49.952784   12182 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 09:55:49.974500   12182 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 09:55:49.974649   12182 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 09:55:49.975379   12182 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:55:49.975445   12182 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:55:49.984527   12182 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59053
	I0307 09:55:49.984890   12182 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:55:49.985311   12182 main.go:141] libmachine: Using API Version  1
	I0307 09:55:49.985321   12182 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:55:49.985564   12182 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:55:49.985685   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
	I0307 09:55:50.014051   12182 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 09:55:50.055668   12182 start.go:297] selected driver: hyperkit
	I0307 09:55:50.055684   12182 start.go:901] validating driver "hyperkit" against &{Name:functional-899000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-899000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 09:55:50.055885   12182 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 09:55:50.056074   12182 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 09:55:50.056223   12182 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 09:55:50.064835   12182 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 09:55:50.068829   12182 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:55:50.068847   12182 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 09:55:50.071606   12182 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 09:55:50.071669   12182 cni.go:84] Creating CNI manager for ""
	I0307 09:55:50.071684   12182 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 09:55:50.071749   12182 start.go:340] cluster config:
	{Name:functional-899000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-899000 Namespace:default APISe
rverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 09:55:50.071845   12182 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 09:55:50.113976   12182 out.go:177] * Starting "functional-899000" primary control-plane node in "functional-899000" cluster
	I0307 09:55:50.134547   12182 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 09:55:50.134595   12182 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 09:55:50.134613   12182 cache.go:56] Caching tarball of preloaded images
	I0307 09:55:50.134751   12182 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 09:55:50.134762   12182 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 09:55:50.134874   12182 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/functional-899000/config.json ...
	I0307 09:55:50.135566   12182 start.go:360] acquireMachinesLock for functional-899000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 09:55:50.135644   12182 start.go:364] duration metric: took 65.868µs to acquireMachinesLock for "functional-899000"
	I0307 09:55:50.135669   12182 start.go:96] Skipping create...Using existing machine configuration
	I0307 09:55:50.135678   12182 fix.go:54] fixHost starting: 
	I0307 09:55:50.135989   12182 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:55:50.136011   12182 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:55:50.144111   12182 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59055
	I0307 09:55:50.144457   12182 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:55:50.144812   12182 main.go:141] libmachine: Using API Version  1
	I0307 09:55:50.144825   12182 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:55:50.145080   12182 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:55:50.145196   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
	I0307 09:55:50.145303   12182 main.go:141] libmachine: (functional-899000) Calling .GetState
	I0307 09:55:50.145386   12182 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:55:50.145404   12182 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
	I0307 09:55:50.145420   12182 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
	I0307 09:55:50.145440   12182 fix.go:112] recreateIfNeeded on functional-899000: state=Stopped err=<nil>
	I0307 09:55:50.145453   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
	W0307 09:55:50.145520   12182 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 09:55:50.188052   12182 out.go:177] * Restarting existing hyperkit VM for "functional-899000" ...
	I0307 09:55:50.208874   12182 main.go:141] libmachine: (functional-899000) Calling .Start
	I0307 09:55:50.209138   12182 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:55:50.209174   12182 main.go:141] libmachine: (functional-899000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.pid
	I0307 09:55:50.209261   12182 main.go:141] libmachine: (functional-899000) DBG | Using UUID a96a8196-4cbd-47d6-b323-4a8018c7e122
	I0307 09:55:50.249228   12182 main.go:141] libmachine: (functional-899000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 09:55:50.249343   12182 fix.go:56] duration metric: took 113.664597ms for fixHost
	I0307 09:55:50.249351   12182 start.go:83] releasing machines lock for "functional-899000", held for 113.700515ms
	W0307 09:55:50.249364   12182 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 09:55:50.249427   12182 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 09:55:50.249435   12182 start.go:728] Will try again in 5 seconds ...
	I0307 09:55:55.251118   12182 start.go:360] acquireMachinesLock for functional-899000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 09:55:55.251289   12182 start.go:364] duration metric: took 116.294µs to acquireMachinesLock for "functional-899000"
	I0307 09:55:55.251318   12182 start.go:96] Skipping create...Using existing machine configuration
	I0307 09:55:55.251323   12182 fix.go:54] fixHost starting: 
	I0307 09:55:55.251765   12182 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:55:55.251803   12182 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:55:55.261583   12182 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59057
	I0307 09:55:55.261949   12182 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:55:55.262330   12182 main.go:141] libmachine: Using API Version  1
	I0307 09:55:55.262341   12182 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:55:55.262543   12182 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:55:55.262647   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
	I0307 09:55:55.262738   12182 main.go:141] libmachine: (functional-899000) Calling .GetState
	I0307 09:55:55.262814   12182 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:55:55.262831   12182 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
	I0307 09:55:55.262835   12182 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
	I0307 09:55:55.262883   12182 fix.go:112] recreateIfNeeded on functional-899000: state=Stopped err=<nil>
	I0307 09:55:55.262896   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
	W0307 09:55:55.262979   12182 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 09:55:55.284251   12182 out.go:177] * Restarting existing hyperkit VM for "functional-899000" ...
	I0307 09:55:55.326241   12182 main.go:141] libmachine: (functional-899000) Calling .Start
	I0307 09:55:55.326509   12182 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:55:55.326550   12182 main.go:141] libmachine: (functional-899000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.pid
	I0307 09:55:55.326689   12182 main.go:141] libmachine: (functional-899000) DBG | Using UUID a96a8196-4cbd-47d6-b323-4a8018c7e122
	I0307 09:55:55.328437   12182 main.go:141] libmachine: (functional-899000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 09:55:55.328534   12182 fix.go:56] duration metric: took 77.210308ms for fixHost
	I0307 09:55:55.328540   12182 start.go:83] releasing machines lock for "functional-899000", held for 77.242793ms
	W0307 09:55:55.328614   12182 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-899000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 09:55:55.371180   12182 out.go:177] 
	W0307 09:55:55.392450   12182 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 09:55:55.392521   12182 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 09:55:55.392538   12182 out.go:239] * Related issues:
	W0307 09:55:55.392574   12182 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	W0307 09:55:55.392616   12182 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	I0307 09:55:55.435519   12182 out.go:177] 
	
	
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1234: out/minikube-darwin-amd64 -p functional-899000 logs failed: exit status 83
functional_test.go:1224: expected minikube logs to include word: -"Linux"- but got 
***
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| delete  | -p download-only-068000                                                                     | download-only-068000 | jenkins | v1.32.0 | 07 Mar 24 09:48 PST | 07 Mar 24 09:48 PST |
| start   | --download-only -p                                                                          | binary-mirror-853000 | jenkins | v1.32.0 | 07 Mar 24 09:48 PST |                     |
|         | binary-mirror-853000                                                                        |                      |         |         |                     |                     |
|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |
|         | --binary-mirror                                                                             |                      |         |         |                     |                     |
|         | http://127.0.0.1:58552                                                                      |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| delete  | -p binary-mirror-853000                                                                     | binary-mirror-853000 | jenkins | v1.32.0 | 07 Mar 24 09:48 PST | 07 Mar 24 09:48 PST |
| addons  | enable dashboard -p                                                                         | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:48 PST |                     |
|         | addons-392000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:48 PST |                     |
|         | addons-392000                                                                               |                      |         |         |                     |                     |
| start   | -p addons-392000 --wait=true                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:48 PST | 07 Mar 24 09:52 PST |
|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |
|         | --addons=registry                                                                           |                      |         |         |                     |                     |
|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |
|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |
|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |
|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |
|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |
|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |
|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |
|         | --addons=nvidia-device-plugin                                                               |                      |         |         |                     |                     |
|         | --addons=yakd --driver=hyperkit                                                             |                      |         |         |                     |                     |
|         |  --addons=ingress                                                                           |                      |         |         |                     |                     |
|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |
|         | --addons=helm-tiller                                                                        |                      |         |         |                     |                     |
| ip      | addons-392000 ip                                                                            | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:52 PST | 07 Mar 24 09:52 PST |
| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:52 PST | 07 Mar 24 09:52 PST |
|         | registry --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | helm-tiller --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-392000 addons                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | disable metrics-server                                                                      |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable inspektor-gadget -p                                                                 | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | addons-392000                                                                               |                      |         |         |                     |                     |
| ssh     | addons-392000 ssh curl -s                                                                   | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | http://127.0.0.1/ -H 'Host:                                                                 |                      |         |         |                     |                     |
|         | nginx.example.com'                                                                          |                      |         |         |                     |                     |
| ip      | addons-392000 ip                                                                            | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | ingress-dns --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | ingress --alsologtostderr -v=1                                                              |                      |         |         |                     |                     |
| addons  | addons-392000 addons                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | addons-392000 addons                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| ssh     | addons-392000 ssh cat                                                                       | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | /opt/local-path-provisioner/pvc-7a18c37d-2d4d-4f64-8618-18046acb553b_default_test-pvc/file1 |                      |         |         |                     |                     |
| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:54 PST |
|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable nvidia-device-plugin                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | -p addons-392000                                                                            |                      |         |         |                     |                     |
| addons  | disable cloud-spanner -p                                                                    | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
|         | addons-392000                                                                               |                      |         |         |                     |                     |
| addons  | enable headlamp                                                                             | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
|         | -p addons-392000                                                                            |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
|         | gcp-auth --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| stop    | -p addons-392000                                                                            | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
| addons  | enable dashboard -p                                                                         | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
|         | addons-392000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
|         | addons-392000                                                                               |                      |         |         |                     |                     |
| addons  | disable gvisor -p                                                                           | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
|         | addons-392000                                                                               |                      |         |         |                     |                     |
| delete  | -p addons-392000                                                                            | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:55 PST |
| start   | -p nospam-025000 -n=1 --memory=2250 --wait=false                                            | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | --log_dir=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                    |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| start   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| pause   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| unpause | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| stop    | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| delete  | -p nospam-025000                                                                            | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
| start   | -p functional-899000                                                                        | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | --memory=4000                                                                               |                      |         |         |                     |                     |
|         | --apiserver-port=8441                                                                       |                      |         |         |                     |                     |
|         | --wait=all --driver=hyperkit                                                                |                      |         |         |                     |                     |
| start   | -p functional-899000                                                                        | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | --alsologtostderr -v=8                                                                      |                      |         |         |                     |                     |
| cache   | functional-899000 cache add                                                                 | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | functional-899000 cache add                                                                 | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | functional-899000 cache add                                                                 | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-899000 cache add                                                                 | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | minikube-local-cache-test:functional-899000                                                 |                      |         |         |                     |                     |
| cache   | functional-899000 cache delete                                                              | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | minikube-local-cache-test:functional-899000                                                 |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | list                                                                                        | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
| ssh     | functional-899000 ssh sudo                                                                  | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | crictl images                                                                               |                      |         |         |                     |                     |
| ssh     | functional-899000                                                                           | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | ssh sudo docker rmi                                                                         |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| ssh     | functional-899000 ssh                                                                       | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-899000 cache reload                                                              | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
| ssh     | functional-899000 ssh                                                                       | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| kubectl | functional-899000 kubectl --                                                                | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | --context functional-899000                                                                 |                      |         |         |                     |                     |
|         | get pods                                                                                    |                      |         |         |                     |                     |
| start   | -p functional-899000                                                                        | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision                    |                      |         |         |                     |                     |
|         | --wait=all                                                                                  |                      |         |         |                     |                     |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

                                                
                                                

                                                
                                                
==> Last Start <==
Log file created at: 2024/03/07 09:55:49
Running on machine: MacOS-Agent-2
Binary: Built with gc go1.22.0 for darwin/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0307 09:55:49.756047   12182 out.go:291] Setting OutFile to fd 1 ...
I0307 09:55:49.756310   12182 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:55:49.756313   12182 out.go:304] Setting ErrFile to fd 2...
I0307 09:55:49.756316   12182 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:55:49.756491   12182 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
I0307 09:55:49.757855   12182 out.go:298] Setting JSON to false
I0307 09:55:49.780200   12182 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":6920,"bootTime":1709827229,"procs":435,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
W0307 09:55:49.780293   12182 start.go:137] gopshost.Virtualization returned error: not implemented yet
I0307 09:55:49.803893   12182 out.go:177] * [functional-899000] minikube v1.32.0 on Darwin 14.3.1
I0307 09:55:49.845967   12182 out.go:177]   - MINIKUBE_LOCATION=18239
I0307 09:55:49.867683   12182 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
I0307 09:55:49.846015   12182 notify.go:220] Checking for updates...
I0307 09:55:49.888893   12182 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
I0307 09:55:49.909786   12182 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0307 09:55:49.932331   12182 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
I0307 09:55:49.952784   12182 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
I0307 09:55:49.974500   12182 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 09:55:49.974649   12182 driver.go:392] Setting default libvirt URI to qemu:///system
I0307 09:55:49.975379   12182 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:55:49.975445   12182 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 09:55:49.984527   12182 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59053
I0307 09:55:49.984890   12182 main.go:141] libmachine: () Calling .GetVersion
I0307 09:55:49.985311   12182 main.go:141] libmachine: Using API Version  1
I0307 09:55:49.985321   12182 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 09:55:49.985564   12182 main.go:141] libmachine: () Calling .GetMachineName
I0307 09:55:49.985685   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
I0307 09:55:50.014051   12182 out.go:177] * Using the hyperkit driver based on existing profile
I0307 09:55:50.055668   12182 start.go:297] selected driver: hyperkit
I0307 09:55:50.055684   12182 start.go:901] validating driver "hyperkit" against &{Name:functional-899000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:functional-899000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0307 09:55:50.055885   12182 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0307 09:55:50.056074   12182 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 09:55:50.056223   12182 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I0307 09:55:50.064835   12182 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
I0307 09:55:50.068829   12182 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:55:50.068847   12182 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I0307 09:55:50.071606   12182 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0307 09:55:50.071669   12182 cni.go:84] Creating CNI manager for ""
I0307 09:55:50.071684   12182 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0307 09:55:50.071749   12182 start.go:340] cluster config:
{Name:functional-899000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-899000 Namespace:default APISer
verHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPor
t:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0307 09:55:50.071845   12182 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 09:55:50.113976   12182 out.go:177] * Starting "functional-899000" primary control-plane node in "functional-899000" cluster
I0307 09:55:50.134547   12182 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
I0307 09:55:50.134595   12182 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
I0307 09:55:50.134613   12182 cache.go:56] Caching tarball of preloaded images
I0307 09:55:50.134751   12182 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0307 09:55:50.134762   12182 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
I0307 09:55:50.134874   12182 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/functional-899000/config.json ...
I0307 09:55:50.135566   12182 start.go:360] acquireMachinesLock for functional-899000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0307 09:55:50.135644   12182 start.go:364] duration metric: took 65.868µs to acquireMachinesLock for "functional-899000"
I0307 09:55:50.135669   12182 start.go:96] Skipping create...Using existing machine configuration
I0307 09:55:50.135678   12182 fix.go:54] fixHost starting: 
I0307 09:55:50.135989   12182 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:55:50.136011   12182 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 09:55:50.144111   12182 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59055
I0307 09:55:50.144457   12182 main.go:141] libmachine: () Calling .GetVersion
I0307 09:55:50.144812   12182 main.go:141] libmachine: Using API Version  1
I0307 09:55:50.144825   12182 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 09:55:50.145080   12182 main.go:141] libmachine: () Calling .GetMachineName
I0307 09:55:50.145196   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
I0307 09:55:50.145303   12182 main.go:141] libmachine: (functional-899000) Calling .GetState
I0307 09:55:50.145386   12182 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:55:50.145404   12182 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
I0307 09:55:50.145420   12182 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
I0307 09:55:50.145440   12182 fix.go:112] recreateIfNeeded on functional-899000: state=Stopped err=<nil>
I0307 09:55:50.145453   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
W0307 09:55:50.145520   12182 fix.go:138] unexpected machine state, will restart: <nil>
I0307 09:55:50.188052   12182 out.go:177] * Restarting existing hyperkit VM for "functional-899000" ...
I0307 09:55:50.208874   12182 main.go:141] libmachine: (functional-899000) Calling .Start
I0307 09:55:50.209138   12182 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:55:50.209174   12182 main.go:141] libmachine: (functional-899000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.pid
I0307 09:55:50.209261   12182 main.go:141] libmachine: (functional-899000) DBG | Using UUID a96a8196-4cbd-47d6-b323-4a8018c7e122
I0307 09:55:50.249228   12182 main.go:141] libmachine: (functional-899000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0307 09:55:50.249343   12182 fix.go:56] duration metric: took 113.664597ms for fixHost
I0307 09:55:50.249351   12182 start.go:83] releasing machines lock for "functional-899000", held for 113.700515ms
W0307 09:55:50.249364   12182 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
W0307 09:55:50.249427   12182 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0307 09:55:50.249435   12182 start.go:728] Will try again in 5 seconds ...
I0307 09:55:55.251118   12182 start.go:360] acquireMachinesLock for functional-899000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0307 09:55:55.251289   12182 start.go:364] duration metric: took 116.294µs to acquireMachinesLock for "functional-899000"
I0307 09:55:55.251318   12182 start.go:96] Skipping create...Using existing machine configuration
I0307 09:55:55.251323   12182 fix.go:54] fixHost starting: 
I0307 09:55:55.251765   12182 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:55:55.251803   12182 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 09:55:55.261583   12182 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59057
I0307 09:55:55.261949   12182 main.go:141] libmachine: () Calling .GetVersion
I0307 09:55:55.262330   12182 main.go:141] libmachine: Using API Version  1
I0307 09:55:55.262341   12182 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 09:55:55.262543   12182 main.go:141] libmachine: () Calling .GetMachineName
I0307 09:55:55.262647   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
I0307 09:55:55.262738   12182 main.go:141] libmachine: (functional-899000) Calling .GetState
I0307 09:55:55.262814   12182 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:55:55.262831   12182 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
I0307 09:55:55.262835   12182 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
I0307 09:55:55.262883   12182 fix.go:112] recreateIfNeeded on functional-899000: state=Stopped err=<nil>
I0307 09:55:55.262896   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
W0307 09:55:55.262979   12182 fix.go:138] unexpected machine state, will restart: <nil>
I0307 09:55:55.284251   12182 out.go:177] * Restarting existing hyperkit VM for "functional-899000" ...
I0307 09:55:55.326241   12182 main.go:141] libmachine: (functional-899000) Calling .Start
I0307 09:55:55.326509   12182 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:55:55.326550   12182 main.go:141] libmachine: (functional-899000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.pid
I0307 09:55:55.326689   12182 main.go:141] libmachine: (functional-899000) DBG | Using UUID a96a8196-4cbd-47d6-b323-4a8018c7e122
I0307 09:55:55.328437   12182 main.go:141] libmachine: (functional-899000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0307 09:55:55.328534   12182 fix.go:56] duration metric: took 77.210308ms for fixHost
I0307 09:55:55.328540   12182 start.go:83] releasing machines lock for "functional-899000", held for 77.242793ms
W0307 09:55:55.328614   12182 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-899000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0307 09:55:55.371180   12182 out.go:177] 
W0307 09:55:55.392450   12182 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
W0307 09:55:55.392521   12182 out.go:239] * Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
W0307 09:55:55.392538   12182 out.go:239] * Related issues:
W0307 09:55:55.392574   12182 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
W0307 09:55:55.392616   12182 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
I0307 09:55:55.435519   12182 out.go:177] 

                                                
                                                

                                                
                                                
* The control-plane node functional-899000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-899000"
***
--- FAIL: TestFunctional/serial/LogsCmd (0.33s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (0.27s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 logs --file /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalserialLogsFileCmd433343094/001/logs.txt
functional_test.go:1224: expected minikube logs to include word: -"Linux"- but got 
***
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| delete  | -p download-only-068000                                                                     | download-only-068000 | jenkins | v1.32.0 | 07 Mar 24 09:48 PST | 07 Mar 24 09:48 PST |
| start   | --download-only -p                                                                          | binary-mirror-853000 | jenkins | v1.32.0 | 07 Mar 24 09:48 PST |                     |
|         | binary-mirror-853000                                                                        |                      |         |         |                     |                     |
|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |
|         | --binary-mirror                                                                             |                      |         |         |                     |                     |
|         | http://127.0.0.1:58552                                                                      |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| delete  | -p binary-mirror-853000                                                                     | binary-mirror-853000 | jenkins | v1.32.0 | 07 Mar 24 09:48 PST | 07 Mar 24 09:48 PST |
| addons  | enable dashboard -p                                                                         | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:48 PST |                     |
|         | addons-392000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:48 PST |                     |
|         | addons-392000                                                                               |                      |         |         |                     |                     |
| start   | -p addons-392000 --wait=true                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:48 PST | 07 Mar 24 09:52 PST |
|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |
|         | --addons=registry                                                                           |                      |         |         |                     |                     |
|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |
|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |
|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |
|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |
|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |
|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |
|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |
|         | --addons=nvidia-device-plugin                                                               |                      |         |         |                     |                     |
|         | --addons=yakd --driver=hyperkit                                                             |                      |         |         |                     |                     |
|         |  --addons=ingress                                                                           |                      |         |         |                     |                     |
|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |
|         | --addons=helm-tiller                                                                        |                      |         |         |                     |                     |
| ip      | addons-392000 ip                                                                            | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:52 PST | 07 Mar 24 09:52 PST |
| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:52 PST | 07 Mar 24 09:52 PST |
|         | registry --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | helm-tiller --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-392000 addons                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | disable metrics-server                                                                      |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable inspektor-gadget -p                                                                 | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | addons-392000                                                                               |                      |         |         |                     |                     |
| ssh     | addons-392000 ssh curl -s                                                                   | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | http://127.0.0.1/ -H 'Host:                                                                 |                      |         |         |                     |                     |
|         | nginx.example.com'                                                                          |                      |         |         |                     |                     |
| ip      | addons-392000 ip                                                                            | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | ingress-dns --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | ingress --alsologtostderr -v=1                                                              |                      |         |         |                     |                     |
| addons  | addons-392000 addons                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | addons-392000 addons                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| ssh     | addons-392000 ssh cat                                                                       | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | /opt/local-path-provisioner/pvc-7a18c37d-2d4d-4f64-8618-18046acb553b_default_test-pvc/file1 |                      |         |         |                     |                     |
| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:54 PST |
|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable nvidia-device-plugin                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:53 PST | 07 Mar 24 09:53 PST |
|         | -p addons-392000                                                                            |                      |         |         |                     |                     |
| addons  | disable cloud-spanner -p                                                                    | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
|         | addons-392000                                                                               |                      |         |         |                     |                     |
| addons  | enable headlamp                                                                             | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
|         | -p addons-392000                                                                            |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | addons-392000 addons disable                                                                | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
|         | gcp-auth --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| stop    | -p addons-392000                                                                            | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
| addons  | enable dashboard -p                                                                         | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
|         | addons-392000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
|         | addons-392000                                                                               |                      |         |         |                     |                     |
| addons  | disable gvisor -p                                                                           | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:54 PST |
|         | addons-392000                                                                               |                      |         |         |                     |                     |
| delete  | -p addons-392000                                                                            | addons-392000        | jenkins | v1.32.0 | 07 Mar 24 09:54 PST | 07 Mar 24 09:55 PST |
| start   | -p nospam-025000 -n=1 --memory=2250 --wait=false                                            | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | --log_dir=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                    |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| start   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| pause   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| unpause | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| stop    | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-025000 --log_dir                                                                     | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| delete  | -p nospam-025000                                                                            | nospam-025000        | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
| start   | -p functional-899000                                                                        | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | --memory=4000                                                                               |                      |         |         |                     |                     |
|         | --apiserver-port=8441                                                                       |                      |         |         |                     |                     |
|         | --wait=all --driver=hyperkit                                                                |                      |         |         |                     |                     |
| start   | -p functional-899000                                                                        | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | --alsologtostderr -v=8                                                                      |                      |         |         |                     |                     |
| cache   | functional-899000 cache add                                                                 | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | functional-899000 cache add                                                                 | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | functional-899000 cache add                                                                 | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-899000 cache add                                                                 | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | minikube-local-cache-test:functional-899000                                                 |                      |         |         |                     |                     |
| cache   | functional-899000 cache delete                                                              | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | minikube-local-cache-test:functional-899000                                                 |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | list                                                                                        | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
| ssh     | functional-899000 ssh sudo                                                                  | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | crictl images                                                                               |                      |         |         |                     |                     |
| ssh     | functional-899000                                                                           | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | ssh sudo docker rmi                                                                         |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| ssh     | functional-899000 ssh                                                                       | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-899000 cache reload                                                              | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
| ssh     | functional-899000 ssh                                                                       | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:55 PST | 07 Mar 24 09:55 PST |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| kubectl | functional-899000 kubectl --                                                                | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | --context functional-899000                                                                 |                      |         |         |                     |                     |
|         | get pods                                                                                    |                      |         |         |                     |                     |
| start   | -p functional-899000                                                                        | functional-899000    | jenkins | v1.32.0 | 07 Mar 24 09:55 PST |                     |
|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision                    |                      |         |         |                     |                     |
|         | --wait=all                                                                                  |                      |         |         |                     |                     |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

                                                
                                                

                                                
                                                
==> Last Start <==
Log file created at: 2024/03/07 09:55:49
Running on machine: MacOS-Agent-2
Binary: Built with gc go1.22.0 for darwin/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0307 09:55:49.756047   12182 out.go:291] Setting OutFile to fd 1 ...
I0307 09:55:49.756310   12182 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:55:49.756313   12182 out.go:304] Setting ErrFile to fd 2...
I0307 09:55:49.756316   12182 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:55:49.756491   12182 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
I0307 09:55:49.757855   12182 out.go:298] Setting JSON to false
I0307 09:55:49.780200   12182 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":6920,"bootTime":1709827229,"procs":435,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
W0307 09:55:49.780293   12182 start.go:137] gopshost.Virtualization returned error: not implemented yet
I0307 09:55:49.803893   12182 out.go:177] * [functional-899000] minikube v1.32.0 on Darwin 14.3.1
I0307 09:55:49.845967   12182 out.go:177]   - MINIKUBE_LOCATION=18239
I0307 09:55:49.867683   12182 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
I0307 09:55:49.846015   12182 notify.go:220] Checking for updates...
I0307 09:55:49.888893   12182 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
I0307 09:55:49.909786   12182 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0307 09:55:49.932331   12182 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
I0307 09:55:49.952784   12182 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
I0307 09:55:49.974500   12182 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 09:55:49.974649   12182 driver.go:392] Setting default libvirt URI to qemu:///system
I0307 09:55:49.975379   12182 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:55:49.975445   12182 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 09:55:49.984527   12182 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59053
I0307 09:55:49.984890   12182 main.go:141] libmachine: () Calling .GetVersion
I0307 09:55:49.985311   12182 main.go:141] libmachine: Using API Version  1
I0307 09:55:49.985321   12182 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 09:55:49.985564   12182 main.go:141] libmachine: () Calling .GetMachineName
I0307 09:55:49.985685   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
I0307 09:55:50.014051   12182 out.go:177] * Using the hyperkit driver based on existing profile
I0307 09:55:50.055668   12182 start.go:297] selected driver: hyperkit
I0307 09:55:50.055684   12182 start.go:901] validating driver "hyperkit" against &{Name:functional-899000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:functional-899000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0307 09:55:50.055885   12182 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0307 09:55:50.056074   12182 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 09:55:50.056223   12182 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I0307 09:55:50.064835   12182 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
I0307 09:55:50.068829   12182 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:55:50.068847   12182 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I0307 09:55:50.071606   12182 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0307 09:55:50.071669   12182 cni.go:84] Creating CNI manager for ""
I0307 09:55:50.071684   12182 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0307 09:55:50.071749   12182 start.go:340] cluster config:
{Name:functional-899000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-899000 Namespace:default APISer
verHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPor
t:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0307 09:55:50.071845   12182 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 09:55:50.113976   12182 out.go:177] * Starting "functional-899000" primary control-plane node in "functional-899000" cluster
I0307 09:55:50.134547   12182 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
I0307 09:55:50.134595   12182 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
I0307 09:55:50.134613   12182 cache.go:56] Caching tarball of preloaded images
I0307 09:55:50.134751   12182 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0307 09:55:50.134762   12182 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
I0307 09:55:50.134874   12182 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/functional-899000/config.json ...
I0307 09:55:50.135566   12182 start.go:360] acquireMachinesLock for functional-899000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0307 09:55:50.135644   12182 start.go:364] duration metric: took 65.868µs to acquireMachinesLock for "functional-899000"
I0307 09:55:50.135669   12182 start.go:96] Skipping create...Using existing machine configuration
I0307 09:55:50.135678   12182 fix.go:54] fixHost starting: 
I0307 09:55:50.135989   12182 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:55:50.136011   12182 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 09:55:50.144111   12182 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59055
I0307 09:55:50.144457   12182 main.go:141] libmachine: () Calling .GetVersion
I0307 09:55:50.144812   12182 main.go:141] libmachine: Using API Version  1
I0307 09:55:50.144825   12182 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 09:55:50.145080   12182 main.go:141] libmachine: () Calling .GetMachineName
I0307 09:55:50.145196   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
I0307 09:55:50.145303   12182 main.go:141] libmachine: (functional-899000) Calling .GetState
I0307 09:55:50.145386   12182 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:55:50.145404   12182 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
I0307 09:55:50.145420   12182 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
I0307 09:55:50.145440   12182 fix.go:112] recreateIfNeeded on functional-899000: state=Stopped err=<nil>
I0307 09:55:50.145453   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
W0307 09:55:50.145520   12182 fix.go:138] unexpected machine state, will restart: <nil>
I0307 09:55:50.188052   12182 out.go:177] * Restarting existing hyperkit VM for "functional-899000" ...
I0307 09:55:50.208874   12182 main.go:141] libmachine: (functional-899000) Calling .Start
I0307 09:55:50.209138   12182 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:55:50.209174   12182 main.go:141] libmachine: (functional-899000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.pid
I0307 09:55:50.209261   12182 main.go:141] libmachine: (functional-899000) DBG | Using UUID a96a8196-4cbd-47d6-b323-4a8018c7e122
I0307 09:55:50.249228   12182 main.go:141] libmachine: (functional-899000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0307 09:55:50.249343   12182 fix.go:56] duration metric: took 113.664597ms for fixHost
I0307 09:55:50.249351   12182 start.go:83] releasing machines lock for "functional-899000", held for 113.700515ms
W0307 09:55:50.249364   12182 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
W0307 09:55:50.249427   12182 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0307 09:55:50.249435   12182 start.go:728] Will try again in 5 seconds ...
I0307 09:55:55.251118   12182 start.go:360] acquireMachinesLock for functional-899000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0307 09:55:55.251289   12182 start.go:364] duration metric: took 116.294µs to acquireMachinesLock for "functional-899000"
I0307 09:55:55.251318   12182 start.go:96] Skipping create...Using existing machine configuration
I0307 09:55:55.251323   12182 fix.go:54] fixHost starting: 
I0307 09:55:55.251765   12182 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:55:55.251803   12182 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 09:55:55.261583   12182 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59057
I0307 09:55:55.261949   12182 main.go:141] libmachine: () Calling .GetVersion
I0307 09:55:55.262330   12182 main.go:141] libmachine: Using API Version  1
I0307 09:55:55.262341   12182 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 09:55:55.262543   12182 main.go:141] libmachine: () Calling .GetMachineName
I0307 09:55:55.262647   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
I0307 09:55:55.262738   12182 main.go:141] libmachine: (functional-899000) Calling .GetState
I0307 09:55:55.262814   12182 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:55:55.262831   12182 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
I0307 09:55:55.262835   12182 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
I0307 09:55:55.262883   12182 fix.go:112] recreateIfNeeded on functional-899000: state=Stopped err=<nil>
I0307 09:55:55.262896   12182 main.go:141] libmachine: (functional-899000) Calling .DriverName
W0307 09:55:55.262979   12182 fix.go:138] unexpected machine state, will restart: <nil>
I0307 09:55:55.284251   12182 out.go:177] * Restarting existing hyperkit VM for "functional-899000" ...
I0307 09:55:55.326241   12182 main.go:141] libmachine: (functional-899000) Calling .Start
I0307 09:55:55.326509   12182 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:55:55.326550   12182 main.go:141] libmachine: (functional-899000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.pid
I0307 09:55:55.326689   12182 main.go:141] libmachine: (functional-899000) DBG | Using UUID a96a8196-4cbd-47d6-b323-4a8018c7e122
I0307 09:55:55.328437   12182 main.go:141] libmachine: (functional-899000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0307 09:55:55.328534   12182 fix.go:56] duration metric: took 77.210308ms for fixHost
I0307 09:55:55.328540   12182 start.go:83] releasing machines lock for "functional-899000", held for 77.242793ms
W0307 09:55:55.328614   12182 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-899000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0307 09:55:55.371180   12182 out.go:177] 
W0307 09:55:55.392450   12182 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
W0307 09:55:55.392521   12182 out.go:239] * Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
W0307 09:55:55.392538   12182 out.go:239] * Related issues:
W0307 09:55:55.392574   12182 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
W0307 09:55:55.392616   12182 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
I0307 09:55:55.435519   12182 out.go:177] 

                                                
                                                

                                                
                                                
***
--- FAIL: TestFunctional/serial/LogsFileCmd (0.27s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-899000 apply -f testdata/invalidsvc.yaml
functional_test.go:2317: (dbg) Non-zero exit: kubectl --context functional-899000 apply -f testdata/invalidsvc.yaml: exit status 1 (38.655356ms)

                                                
                                                
** stderr ** 
	error: context "functional-899000" does not exist

                                                
                                                
** /stderr **
functional_test.go:2319: kubectl --context functional-899000 apply -f testdata/invalidsvc.yaml failed: exit status 1
--- FAIL: TestFunctional/serial/InvalidService (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (0.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-899000 --alsologtostderr -v=1]
functional_test.go:914: output didn't produce a URL
functional_test.go:906: (dbg) stopping [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-899000 --alsologtostderr -v=1] ...
functional_test.go:906: (dbg) [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-899000 --alsologtostderr -v=1] stdout:
functional_test.go:906: (dbg) [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-899000 --alsologtostderr -v=1] stderr:
I0307 09:56:51.820285   12635 out.go:291] Setting OutFile to fd 1 ...
I0307 09:56:51.821190   12635 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:56:51.821197   12635 out.go:304] Setting ErrFile to fd 2...
I0307 09:56:51.821201   12635 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:56:51.821382   12635 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
I0307 09:56:51.821705   12635 mustload.go:65] Loading cluster: functional-899000
I0307 09:56:51.822040   12635 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 09:56:51.822379   12635 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:56:51.822422   12635 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 09:56:51.830270   12635 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59288
I0307 09:56:51.830668   12635 main.go:141] libmachine: () Calling .GetVersion
I0307 09:56:51.831092   12635 main.go:141] libmachine: Using API Version  1
I0307 09:56:51.831121   12635 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 09:56:51.831357   12635 main.go:141] libmachine: () Calling .GetMachineName
I0307 09:56:51.831468   12635 main.go:141] libmachine: (functional-899000) Calling .GetState
I0307 09:56:51.831553   12635 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:56:51.831586   12635 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
I0307 09:56:51.831597   12635 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
I0307 09:56:51.852844   12635 out.go:177] * The control-plane node functional-899000 host is not running: state=Stopped
I0307 09:56:51.873356   12635 out.go:177]   To start a cluster, run: "minikube start -p functional-899000"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (74.115343ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/DashboardCmd (0.33s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (0.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 status
functional_test.go:850: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 status: exit status 7 (74.506378ms)

                                                
                                                
-- stdout --
	functional-899000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
functional_test.go:852: failed to run minikube status. args "out/minikube-darwin-amd64 -p functional-899000 status" : exit status 7
functional_test.go:856: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:856: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}: exit status 7 (73.90838ms)

                                                
                                                
-- stdout --
	host:Stopped,kublet:Stopped,apiserver:Stopped,kubeconfig:Stopped

                                                
                                                
-- /stdout --
functional_test.go:858: failed to run minikube status with custom format: args "out/minikube-darwin-amd64 -p functional-899000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}": exit status 7
functional_test.go:868: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 status -o json
functional_test.go:868: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 status -o json: exit status 7 (73.9431ms)

                                                
                                                
-- stdout --
	{"Name":"functional-899000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
functional_test.go:870: failed to run minikube status with json output. args "out/minikube-darwin-amd64 -p functional-899000 status -o json" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (73.374252ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/StatusCmd (0.30s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1625: (dbg) Run:  kubectl --context functional-899000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8
functional_test.go:1625: (dbg) Non-zero exit: kubectl --context functional-899000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8: exit status 1 (37.171554ms)

                                                
                                                
** stderr ** 
	error: context "functional-899000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1629: failed to create hello-node deployment with this command "kubectl --context functional-899000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8": exit status 1.
functional_test.go:1594: service test failed - dumping debug information
functional_test.go:1595: -----------------------service failure post-mortem--------------------------------
functional_test.go:1598: (dbg) Run:  kubectl --context functional-899000 describe po hello-node-connect
functional_test.go:1598: (dbg) Non-zero exit: kubectl --context functional-899000 describe po hello-node-connect: exit status 1 (36.675044ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-899000

                                                
                                                
** /stderr **
functional_test.go:1600: "kubectl --context functional-899000 describe po hello-node-connect" failed: exit status 1
functional_test.go:1602: hello-node pod describe:
functional_test.go:1604: (dbg) Run:  kubectl --context functional-899000 logs -l app=hello-node-connect
functional_test.go:1604: (dbg) Non-zero exit: kubectl --context functional-899000 logs -l app=hello-node-connect: exit status 1 (36.44759ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-899000

                                                
                                                
** /stderr **
functional_test.go:1606: "kubectl --context functional-899000 logs -l app=hello-node-connect" failed: exit status 1
functional_test.go:1608: hello-node logs:
functional_test.go:1610: (dbg) Run:  kubectl --context functional-899000 describe svc hello-node-connect
functional_test.go:1610: (dbg) Non-zero exit: kubectl --context functional-899000 describe svc hello-node-connect: exit status 1 (37.112289ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-899000

                                                
                                                
** /stderr **
functional_test.go:1612: "kubectl --context functional-899000 describe svc hello-node-connect" failed: exit status 1
functional_test.go:1614: hello-node svc describe:
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (74.219974ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/ServiceCmdConnect (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:45: failed waiting for storage-provisioner: client config: context "functional-899000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (74.309415ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/PersistentVolumeClaim (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1721: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "echo hello"
functional_test.go:1721: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "echo hello": exit status 83 (207.982234ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1726: failed to run an ssh command. args "out/minikube-darwin-amd64 -p functional-899000 ssh \"echo hello\"" : exit status 83
functional_test.go:1730: expected minikube ssh command output to be -"hello"- but got *"* The control-plane node functional-899000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-899000\"\n"*. args "out/minikube-darwin-amd64 -p functional-899000 ssh \"echo hello\""
functional_test.go:1738: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "cat /etc/hostname"
functional_test.go:1738: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "cat /etc/hostname": exit status 83 (162.376454ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1744: failed to run an ssh command. args "out/minikube-darwin-amd64 -p functional-899000 ssh \"cat /etc/hostname\"" : exit status 83
functional_test.go:1748: expected minikube ssh command output to be -"functional-899000"- but got *"* The control-plane node functional-899000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-899000\"\n"*. args "out/minikube-darwin-amd64 -p functional-899000 ssh \"cat /etc/hostname\""
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (83.318174ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/SSHCmd (0.45s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (0.99s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 cp testdata/cp-test.txt /home/docker/cp-test.txt: exit status 83 (154.151591ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-899000 cp testdata/cp-test.txt /home/docker/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh -n functional-899000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh -n functional-899000 "sudo cat /home/docker/cp-test.txt": exit status 83 (155.213712ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-899000 ssh -n functional-899000 \"sudo cat /home/docker/cp-test.txt\"" : exit status 83
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
  strings.Join({
+ 	"* ",
  	"T",
- 	"est file for checking file cp process",
+ 	"he control-plane node functional-899000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-899000\"\n",
  }, "")
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 cp functional-899000:/home/docker/cp-test.txt /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelCpCmd3984854155/001/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 cp functional-899000:/home/docker/cp-test.txt /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelCpCmd3984854155/001/cp-test.txt: exit status 83 (159.190298ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-899000 cp functional-899000:/home/docker/cp-test.txt /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelCpCmd3984854155/001/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh -n functional-899000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh -n functional-899000 "sudo cat /home/docker/cp-test.txt": exit status 83 (174.822404ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-899000 ssh -n functional-899000 \"sudo cat /home/docker/cp-test.txt\"" : exit status 83
helpers_test.go:528: failed to read test file 'testdata/cp-test.txt' : open /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelCpCmd3984854155/001/cp-test.txt: no such file or directory
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
  string(
- 	"* The control-plane node functional-899000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-899000\"\n",
+ 	"",
  )
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt: exit status 83 (136.973322ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-899000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh -n functional-899000 "sudo cat /tmp/does/not/exist/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh -n functional-899000 "sudo cat /tmp/does/not/exist/cp-test.txt": exit status 83 (187.04696ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-899000 ssh -n functional-899000 \"sudo cat /tmp/does/not/exist/cp-test.txt\"" : exit status 83
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
  strings.Join({
+ 	"* ",
  	"T",
- 	"est file for checking file cp process",
+ 	"he control-plane node functional-899000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-899000\"\n",
  }, "")
--- FAIL: TestFunctional/parallel/CpCmd (0.99s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1789: (dbg) Run:  kubectl --context functional-899000 replace --force -f testdata/mysql.yaml
functional_test.go:1789: (dbg) Non-zero exit: kubectl --context functional-899000 replace --force -f testdata/mysql.yaml: exit status 1 (57.852238ms)

                                                
                                                
** stderr ** 
	error: context "functional-899000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1791: failed to kubectl replace mysql: args "kubectl --context functional-899000 replace --force -f testdata/mysql.yaml" failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (104.804399ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/MySQL (0.16s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/11298/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /etc/test/nested/copy/11298/hosts"
functional_test.go:1927: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /etc/test/nested/copy/11298/hosts": exit status 83 (167.133384ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1929: out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /etc/test/nested/copy/11298/hosts" failed: exit status 83
functional_test.go:1932: file sync test content: * The control-plane node functional-899000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-899000"
functional_test.go:1942: /etc/sync.test content mismatch (-want +got):
  strings.Join({
+ 	"* ",
  	"T",
- 	"est file for checking file sync process",
+ 	"he control-plane node functional-899000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-899000\"\n",
  }, "")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (99.584978ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/FileSync (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (1.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/11298.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /etc/ssl/certs/11298.pem"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /etc/ssl/certs/11298.pem": exit status 83 (167.01287ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/etc/ssl/certs/11298.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-899000 ssh \"sudo cat /etc/ssl/certs/11298.pem\"": exit status 83
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /etc/ssl/certs/11298.pem mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-899000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-899000"
  	"""
  )
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/11298.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /usr/share/ca-certificates/11298.pem"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /usr/share/ca-certificates/11298.pem": exit status 83 (195.865166ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/usr/share/ca-certificates/11298.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-899000 ssh \"sudo cat /usr/share/ca-certificates/11298.pem\"": exit status 83
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /usr/share/ca-certificates/11298.pem mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-899000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-899000"
  	"""
  )
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /etc/ssl/certs/51391683.0": exit status 83 (160.957063ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/etc/ssl/certs/51391683.0" inside minikube. args "out/minikube-darwin-amd64 -p functional-899000 ssh \"sudo cat /etc/ssl/certs/51391683.0\"": exit status 83
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /etc/ssl/certs/51391683.0 mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-899000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-899000"
  	"""
  )
functional_test.go:1995: Checking for existence of /etc/ssl/certs/112982.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /etc/ssl/certs/112982.pem"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /etc/ssl/certs/112982.pem": exit status 83 (209.633211ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/etc/ssl/certs/112982.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-899000 ssh \"sudo cat /etc/ssl/certs/112982.pem\"": exit status 83
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /etc/ssl/certs/112982.pem mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-899000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-899000"
  	"""
  )
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/112982.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /usr/share/ca-certificates/112982.pem"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /usr/share/ca-certificates/112982.pem": exit status 83 (222.893835ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/usr/share/ca-certificates/112982.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-899000 ssh \"sudo cat /usr/share/ca-certificates/112982.pem\"": exit status 83
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /usr/share/ca-certificates/112982.pem mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-899000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-899000"
  	"""
  )
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0": exit status 83 (179.626003ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/etc/ssl/certs/3ec20f2e.0" inside minikube. args "out/minikube-darwin-amd64 -p functional-899000 ssh \"sudo cat /etc/ssl/certs/3ec20f2e.0\"": exit status 83
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /etc/ssl/certs/3ec20f2e.0 mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-899000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-899000"
  	"""
  )
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (82.085381ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/CertSync (1.22s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-899000 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
functional_test.go:218: (dbg) Non-zero exit: kubectl --context functional-899000 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'": exit status 1 (41.696124ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-899000

                                                
                                                
** /stderr **
functional_test.go:220: failed to 'kubectl get nodes' with args "kubectl --context functional-899000 get nodes --output=go-template \"--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'\"": exit status 1
functional_test.go:226: expected to have label "minikube.k8s.io/commit" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-899000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/version" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-899000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/updated_at" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-899000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/name" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-899000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/primary" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-899000

                                                
                                                
** /stderr **
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-899000 -n functional-899000: exit status 7 (74.318476ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-899000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/NodeLabels (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "sudo systemctl is-active crio": exit status 83 (228.834506ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:2026: output of 
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --: exit status 83
functional_test.go:2029: For runtime "docker": expected "crio" to be inactive but got "* The control-plane node functional-899000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-899000\"\n" 
--- FAIL: TestFunctional/parallel/NonActiveRuntimeDisabled (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 version -o=json --components
functional_test.go:2266: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 version -o=json --components: exit status 83 (138.323169ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:2268: error version: exit status 83
functional_test.go:2273: expected to see "buildctl" in the minikube version --components but got:
* The control-plane node functional-899000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-899000"
functional_test.go:2273: expected to see "commit" in the minikube version --components but got:
* The control-plane node functional-899000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-899000"
functional_test.go:2273: expected to see "containerd" in the minikube version --components but got:
* The control-plane node functional-899000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-899000"
functional_test.go:2273: expected to see "crictl" in the minikube version --components but got:
* The control-plane node functional-899000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-899000"
functional_test.go:2273: expected to see "crio" in the minikube version --components but got:
* The control-plane node functional-899000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-899000"
functional_test.go:2273: expected to see "ctr" in the minikube version --components but got:
* The control-plane node functional-899000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-899000"
functional_test.go:2273: expected to see "docker" in the minikube version --components but got:
* The control-plane node functional-899000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-899000"
functional_test.go:2273: expected to see "minikubeVersion" in the minikube version --components but got:
* The control-plane node functional-899000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-899000"
functional_test.go:2273: expected to see "podman" in the minikube version --components but got:
* The control-plane node functional-899000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-899000"
functional_test.go:2273: expected to see "crun" in the minikube version --components but got:
* The control-plane node functional-899000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-899000"
--- FAIL: TestFunctional/parallel/Version/components (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-899000 image ls --format short --alsologtostderr:

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-899000 image ls --format short --alsologtostderr:
I0307 09:56:52.809245   12658 out.go:291] Setting OutFile to fd 1 ...
I0307 09:56:52.809425   12658 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:56:52.809430   12658 out.go:304] Setting ErrFile to fd 2...
I0307 09:56:52.809434   12658 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:56:52.809605   12658 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
I0307 09:56:52.810191   12658 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 09:56:52.810280   12658 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 09:56:52.811101   12658 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:56:52.811156   12658 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 09:56:52.819774   12658 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59301
I0307 09:56:52.820196   12658 main.go:141] libmachine: () Calling .GetVersion
I0307 09:56:52.820589   12658 main.go:141] libmachine: Using API Version  1
I0307 09:56:52.820599   12658 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 09:56:52.820844   12658 main.go:141] libmachine: () Calling .GetMachineName
I0307 09:56:52.820958   12658 main.go:141] libmachine: (functional-899000) Calling .GetState
I0307 09:56:52.821034   12658 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:56:52.821060   12658 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
I0307 09:56:52.821072   12658 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
I0307 09:56:52.821101   12658 main.go:141] libmachine: Making call to close driver server
I0307 09:56:52.821108   12658 main.go:141] libmachine: (functional-899000) Calling .Close
I0307 09:56:52.821188   12658 main.go:141] libmachine: Successfully made call to close driver server
I0307 09:56:52.821192   12658 main.go:141] libmachine: (functional-899000) DBG | Closing plugin on server side
I0307 09:56:52.821196   12658 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListShort (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-899000 image ls --format table --alsologtostderr:
|-------|-----|----------|------|
| Image | Tag | Image ID | Size |
|-------|-----|----------|------|
|-------|-----|----------|------|
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-899000 image ls --format table --alsologtostderr:
I0307 09:56:53.443813   12676 out.go:291] Setting OutFile to fd 1 ...
I0307 09:56:53.444068   12676 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:56:53.444073   12676 out.go:304] Setting ErrFile to fd 2...
I0307 09:56:53.444077   12676 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:56:53.444245   12676 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
I0307 09:56:53.445756   12676 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 09:56:53.445867   12676 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 09:56:53.446217   12676 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:56:53.446259   12676 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 09:56:53.454111   12676 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59313
I0307 09:56:53.454534   12676 main.go:141] libmachine: () Calling .GetVersion
I0307 09:56:53.454968   12676 main.go:141] libmachine: Using API Version  1
I0307 09:56:53.454994   12676 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 09:56:53.455250   12676 main.go:141] libmachine: () Calling .GetMachineName
I0307 09:56:53.455362   12676 main.go:141] libmachine: (functional-899000) Calling .GetState
I0307 09:56:53.455462   12676 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:56:53.455477   12676 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
I0307 09:56:53.455488   12676 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
I0307 09:56:53.455652   12676 main.go:141] libmachine: Making call to close driver server
I0307 09:56:53.455668   12676 main.go:141] libmachine: (functional-899000) Calling .Close
I0307 09:56:53.455758   12676 main.go:141] libmachine: Successfully made call to close driver server
I0307 09:56:53.455772   12676 main.go:141] libmachine: Making call to close connection to plugin binary
I0307 09:56:53.455778   12676 main.go:141] libmachine: (functional-899000) DBG | Closing plugin on server side
functional_test.go:274: expected | registry.k8s.io/pause to be listed with minikube but the image is not there
E0307 09:57:44.444791   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
E0307 09:57:44.452759   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
E0307 09:57:44.464151   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
E0307 09:57:44.485313   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
E0307 09:57:44.525615   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
E0307 09:57:44.606191   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
E0307 09:57:44.768309   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
E0307 09:57:45.089372   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
E0307 09:57:45.731525   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
E0307 09:57:47.011958   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListTable (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-899000 image ls --format json --alsologtostderr:
[]
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-899000 image ls --format json --alsologtostderr:
I0307 09:56:53.346651   12673 out.go:291] Setting OutFile to fd 1 ...
I0307 09:56:53.346836   12673 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:56:53.346842   12673 out.go:304] Setting ErrFile to fd 2...
I0307 09:56:53.346846   12673 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:56:53.347035   12673 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
I0307 09:56:53.347618   12673 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 09:56:53.347714   12673 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 09:56:53.348054   12673 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:56:53.348098   12673 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 09:56:53.355627   12673 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59311
I0307 09:56:53.356023   12673 main.go:141] libmachine: () Calling .GetVersion
I0307 09:56:53.356452   12673 main.go:141] libmachine: Using API Version  1
I0307 09:56:53.356463   12673 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 09:56:53.356658   12673 main.go:141] libmachine: () Calling .GetMachineName
I0307 09:56:53.356764   12673 main.go:141] libmachine: (functional-899000) Calling .GetState
I0307 09:56:53.356848   12673 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:56:53.356908   12673 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
I0307 09:56:53.356946   12673 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
I0307 09:56:53.357021   12673 main.go:141] libmachine: Making call to close driver server
I0307 09:56:53.357035   12673 main.go:141] libmachine: (functional-899000) Calling .Close
I0307 09:56:53.357124   12673 main.go:141] libmachine: Successfully made call to close driver server
I0307 09:56:53.357134   12673 main.go:141] libmachine: (functional-899000) DBG | Closing plugin on server side
I0307 09:56:53.357136   12673 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected ["registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListJson (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-899000 image ls --format yaml --alsologtostderr:
[]

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-899000 image ls --format yaml --alsologtostderr:
I0307 09:56:52.908503   12661 out.go:291] Setting OutFile to fd 1 ...
I0307 09:56:52.908662   12661 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:56:52.908667   12661 out.go:304] Setting ErrFile to fd 2...
I0307 09:56:52.908671   12661 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:56:52.909462   12661 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
I0307 09:56:52.910344   12661 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 09:56:52.910438   12661 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 09:56:52.910768   12661 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:56:52.910825   12661 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 09:56:52.918994   12661 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59303
I0307 09:56:52.919417   12661 main.go:141] libmachine: () Calling .GetVersion
I0307 09:56:52.919825   12661 main.go:141] libmachine: Using API Version  1
I0307 09:56:52.919834   12661 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 09:56:52.920037   12661 main.go:141] libmachine: () Calling .GetMachineName
I0307 09:56:52.920140   12661 main.go:141] libmachine: (functional-899000) Calling .GetState
I0307 09:56:52.920224   12661 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:56:52.920252   12661 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
I0307 09:56:52.920270   12661 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
I0307 09:56:52.920380   12661 main.go:141] libmachine: Making call to close driver server
I0307 09:56:52.920390   12661 main.go:141] libmachine: (functional-899000) Calling .Close
I0307 09:56:52.920477   12661 main.go:141] libmachine: (functional-899000) DBG | Closing plugin on server side
I0307 09:56:52.920487   12661 main.go:141] libmachine: Successfully made call to close driver server
I0307 09:56:52.920495   12661 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected - registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListYaml (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh pgrep buildkitd: exit status 83 (138.74098ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:314: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image build -t localhost/my-image:functional-899000 testdata/build --alsologtostderr
functional_test.go:322: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-899000 image build -t localhost/my-image:functional-899000 testdata/build --alsologtostderr:
I0307 09:56:53.147601   12667 out.go:291] Setting OutFile to fd 1 ...
I0307 09:56:53.148420   12667 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:56:53.148425   12667 out.go:304] Setting ErrFile to fd 2...
I0307 09:56:53.148429   12667 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:56:53.149258   12667 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
I0307 09:56:53.150233   12667 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 09:56:53.150917   12667 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 09:56:53.151239   12667 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:56:53.151276   12667 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 09:56:53.159012   12667 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59307
I0307 09:56:53.159411   12667 main.go:141] libmachine: () Calling .GetVersion
I0307 09:56:53.159832   12667 main.go:141] libmachine: Using API Version  1
I0307 09:56:53.159842   12667 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 09:56:53.160101   12667 main.go:141] libmachine: () Calling .GetMachineName
I0307 09:56:53.160225   12667 main.go:141] libmachine: (functional-899000) Calling .GetState
I0307 09:56:53.160307   12667 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:56:53.160346   12667 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
I0307 09:56:53.160361   12667 build_images.go:123] succeeded building to: 
I0307 09:56:53.160361   12667 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
I0307 09:56:53.160367   12667 build_images.go:124] failed building to: 
I0307 09:56:53.160376   12667 main.go:141] libmachine: Making call to close driver server
I0307 09:56:53.160381   12667 main.go:141] libmachine: (functional-899000) Calling .Close
I0307 09:56:53.160470   12667 main.go:141] libmachine: (functional-899000) DBG | Closing plugin on server side
I0307 09:56:53.160510   12667 main.go:141] libmachine: Successfully made call to close driver server
I0307 09:56:53.160533   12667 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image ls
functional_test.go:442: expected "localhost/my-image:functional-899000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageBuild (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv/bash (0.17s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv/bash
functional_test.go:495: (dbg) Run:  /bin/bash -c "eval $(out/minikube-darwin-amd64 -p functional-899000 docker-env) && out/minikube-darwin-amd64 status -p functional-899000"
functional_test.go:495: (dbg) Non-zero exit: /bin/bash -c "eval $(out/minikube-darwin-amd64 -p functional-899000 docker-env) && out/minikube-darwin-amd64 status -p functional-899000": exit status 1 (168.455347ms)
functional_test.go:501: failed to do status after eval-ing docker-env. error: exit status 1
--- FAIL: TestFunctional/parallel/DockerEnv/bash (0.17s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 update-context --alsologtostderr -v=2: exit status 83 (135.702597ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 09:56:52.395268   12647 out.go:291] Setting OutFile to fd 1 ...
	I0307 09:56:52.395809   12647 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:56:52.395815   12647 out.go:304] Setting ErrFile to fd 2...
	I0307 09:56:52.395819   12647 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:56:52.395988   12647 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 09:56:52.396281   12647 mustload.go:65] Loading cluster: functional-899000
	I0307 09:56:52.396546   12647 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 09:56:52.396863   12647 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:56:52.396916   12647 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:56:52.404577   12647 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59295
	I0307 09:56:52.404967   12647 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:56:52.405424   12647 main.go:141] libmachine: Using API Version  1
	I0307 09:56:52.405433   12647 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:56:52.405696   12647 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:56:52.405832   12647 main.go:141] libmachine: (functional-899000) Calling .GetState
	I0307 09:56:52.405918   12647 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:56:52.405974   12647 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
	I0307 09:56:52.405987   12647 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
	I0307 09:56:52.426745   12647 out.go:177] * The control-plane node functional-899000 host is not running: state=Stopped
	I0307 09:56:52.447673   12647 out.go:177]   To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-899000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2122: update-context: got="* The control-plane node functional-899000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-899000\"\n", want=*"No changes"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_changes (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 update-context --alsologtostderr -v=2: exit status 83 (139.097595ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 09:56:52.669463   12655 out.go:291] Setting OutFile to fd 1 ...
	I0307 09:56:52.670140   12655 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:56:52.670150   12655 out.go:304] Setting ErrFile to fd 2...
	I0307 09:56:52.670156   12655 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:56:52.670774   12655 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 09:56:52.671103   12655 mustload.go:65] Loading cluster: functional-899000
	I0307 09:56:52.671365   12655 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 09:56:52.671676   12655 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:56:52.671735   12655 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:56:52.679494   12655 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59299
	I0307 09:56:52.679912   12655 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:56:52.680340   12655 main.go:141] libmachine: Using API Version  1
	I0307 09:56:52.680349   12655 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:56:52.680551   12655 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:56:52.680659   12655 main.go:141] libmachine: (functional-899000) Calling .GetState
	I0307 09:56:52.680738   12655 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:56:52.680794   12655 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
	I0307 09:56:52.680828   12655 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
	I0307 09:56:52.702635   12655 out.go:177] * The control-plane node functional-899000 host is not running: state=Stopped
	I0307 09:56:52.724169   12655 out.go:177]   To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-899000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2122: update-context: got="* The control-plane node functional-899000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-899000\"\n", want=*"context has been updated"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 update-context --alsologtostderr -v=2: exit status 83 (137.541718ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 09:56:52.531990   12652 out.go:291] Setting OutFile to fd 1 ...
	I0307 09:56:52.532261   12652 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:56:52.532267   12652 out.go:304] Setting ErrFile to fd 2...
	I0307 09:56:52.532271   12652 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:56:52.532455   12652 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 09:56:52.532769   12652 mustload.go:65] Loading cluster: functional-899000
	I0307 09:56:52.533051   12652 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 09:56:52.533422   12652 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:56:52.533455   12652 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:56:52.541110   12652 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59297
	I0307 09:56:52.541517   12652 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:56:52.541942   12652 main.go:141] libmachine: Using API Version  1
	I0307 09:56:52.541975   12652 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:56:52.542224   12652 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:56:52.542333   12652 main.go:141] libmachine: (functional-899000) Calling .GetState
	I0307 09:56:52.542422   12652 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:56:52.542444   12652 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
	I0307 09:56:52.542464   12652 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
	I0307 09:56:52.563918   12652 out.go:177] * The control-plane node functional-899000 host is not running: state=Stopped
	I0307 09:56:52.584905   12652 out.go:177]   To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-899000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2122: update-context: got="* The control-plane node functional-899000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-899000\"\n", want=*"context has been updated"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (0.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1435: (dbg) Run:  kubectl --context functional-899000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8
functional_test.go:1435: (dbg) Non-zero exit: kubectl --context functional-899000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8: exit status 1 (58.520745ms)

                                                
                                                
** stderr ** 
	error: context "functional-899000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1439: failed to create hello-node deployment with this command "kubectl --context functional-899000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8": exit status 1.
--- FAIL: TestFunctional/parallel/ServiceCmd/DeployApp (0.06s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1455: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 service list
functional_test.go:1455: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 service list: exit status 83 (246.505485ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1457: failed to do service list. args "out/minikube-darwin-amd64 -p functional-899000 service list" : exit status 83
functional_test.go:1460: expected 'service list' to contain *hello-node* but got -"* The control-plane node functional-899000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-899000\"\n"-
--- FAIL: TestFunctional/parallel/ServiceCmd/List (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1485: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 service list -o json
functional_test.go:1485: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 service list -o json: exit status 83 (245.796359ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1487: failed to list services with json format. args "out/minikube-darwin-amd64 -p functional-899000 service list -o json": exit status 83
--- FAIL: TestFunctional/parallel/ServiceCmd/JSONOutput (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1505: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 service --namespace=default --https --url hello-node
functional_test.go:1505: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 service --namespace=default --https --url hello-node: exit status 83 (183.670774ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1507: failed to get service url. args "out/minikube-darwin-amd64 -p functional-899000 service --namespace=default --https --url hello-node" : exit status 83
--- FAIL: TestFunctional/parallel/ServiceCmd/HTTPS (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (2.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image load --daemon gcr.io/google-containers/addon-resizer:functional-899000 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-darwin-amd64 -p functional-899000 image load --daemon gcr.io/google-containers/addon-resizer:functional-899000 --alsologtostderr: (2.128134445s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-899000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (2.23s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1536: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 service hello-node --url --format={{.IP}}
functional_test.go:1536: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 service hello-node --url --format={{.IP}}: exit status 83 (136.819567ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1538: failed to get service url with custom format. args "out/minikube-darwin-amd64 -p functional-899000 service hello-node --url --format={{.IP}}": exit status 83
functional_test.go:1544: "* The control-plane node functional-899000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-899000\"" is not a valid IP
--- FAIL: TestFunctional/parallel/ServiceCmd/Format (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1555: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 service hello-node --url
functional_test.go:1555: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 service hello-node --url: exit status 83 (137.043674ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test.go:1557: failed to get service url. args: "out/minikube-darwin-amd64 -p functional-899000 service hello-node --url": exit status 83
functional_test.go:1561: found endpoint for hello-node: * The control-plane node functional-899000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-899000"
functional_test.go:1565: failed to parse "* The control-plane node functional-899000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-899000\"": parse "* The control-plane node functional-899000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-899000\"": net/url: invalid control character in URL
--- FAIL: TestFunctional/parallel/ServiceCmd/URL (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-899000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-899000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:190: tunnel command failed with unexpected error: exit code 83. stderr: I0307 09:56:01.592945   12382 out.go:291] Setting OutFile to fd 1 ...
I0307 09:56:01.593171   12382 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:56:01.593178   12382 out.go:304] Setting ErrFile to fd 2...
I0307 09:56:01.593182   12382 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 09:56:01.593434   12382 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
I0307 09:56:01.593798   12382 mustload.go:65] Loading cluster: functional-899000
I0307 09:56:01.594168   12382 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 09:56:01.594560   12382 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 09:56:01.594633   12382 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 09:56:01.604115   12382 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59147
I0307 09:56:01.604742   12382 main.go:141] libmachine: () Calling .GetVersion
I0307 09:56:01.605297   12382 main.go:141] libmachine: Using API Version  1
I0307 09:56:01.605309   12382 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 09:56:01.605552   12382 main.go:141] libmachine: () Calling .GetMachineName
I0307 09:56:01.605708   12382 main.go:141] libmachine: (functional-899000) Calling .GetState
I0307 09:56:01.605833   12382 main.go:141] libmachine: (functional-899000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 09:56:01.605917   12382 main.go:141] libmachine: (functional-899000) DBG | hyperkit pid from json: 0
I0307 09:56:01.605966   12382 main.go:141] libmachine: (functional-899000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/functional-899000/hyperkit.json: no such file or directory
I0307 09:56:01.629128   12382 out.go:177] * The control-plane node functional-899000 host is not running: state=Stopped
I0307 09:56:01.692128   12382 out.go:177]   To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
stdout: * The control-plane node functional-899000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-899000"
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-amd64 -p functional-899000 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: read stdout failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-899000 tunnel --alsologtostderr] stdout:
functional_test_tunnel_test.go:194: read stderr failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-899000 tunnel --alsologtostderr] stderr:
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-amd64 -p functional-899000 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 12385: os: process already finished
helpers_test.go:502: unable to terminate pid 12381: os: process already finished
functional_test_tunnel_test.go:194: read stdout failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-899000 tunnel --alsologtostderr] stdout:
functional_test_tunnel_test.go:194: read stderr failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-899000 tunnel --alsologtostderr] stderr:
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.33s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:208: failed to get Kubernetes client for "functional-899000": client config: context "functional-899000" does not exist
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (107.68s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:288: failed to hit nginx at "http://": Temporary Error: Get "http:": http: no Host in request URL
functional_test_tunnel_test.go:290: (dbg) Run:  kubectl --context functional-899000 get svc nginx-svc
functional_test_tunnel_test.go:290: (dbg) Non-zero exit: kubectl --context functional-899000 get svc nginx-svc: exit status 1 (38.266409ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-899000

                                                
                                                
** /stderr **
functional_test_tunnel_test.go:292: kubectl --context functional-899000 get svc nginx-svc failed: exit status 1
functional_test_tunnel_test.go:294: failed to kubectl get svc nginx-svc:
functional_test_tunnel_test.go:301: expected body to contain "Welcome to nginx!", but got *""*
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (107.68s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.86s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image load --daemon gcr.io/google-containers/addon-resizer:functional-899000 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-darwin-amd64 -p functional-899000 image load --daemon gcr.io/google-containers/addon-resizer:functional-899000 --alsologtostderr: (1.761610559s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-899000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.86s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (3.79s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (1.95985014s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-899000
functional_test.go:244: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image load --daemon gcr.io/google-containers/addon-resizer:functional-899000 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-darwin-amd64 -p functional-899000 image load --daemon gcr.io/google-containers/addon-resizer:functional-899000 --alsologtostderr: (1.675189534s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-899000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (3.79s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image save gcr.io/google-containers/addon-resizer:functional-899000 /Users/jenkins/workspace/addon-resizer-save.tar --alsologtostderr
functional_test.go:385: expected "/Users/jenkins/workspace/addon-resizer-save.tar" to exist after `image save`, but doesn't exist
--- FAIL: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image load /Users/jenkins/workspace/addon-resizer-save.tar --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-899000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (15.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
E0307 09:57:49.572526   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
functional_test_tunnel_test.go:319: (dbg) Run:  dig +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A
E0307 09:57:54.694897   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
functional_test_tunnel_test.go:319: (dbg) Non-zero exit: dig +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A: exit status 9 (15.022019195s)

                                                
                                                
-- stdout --
	
	; <<>> DiG 9.10.6 <<>> +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A
	; (1 server found)
	;; global options: +cmd
	;; connection timed out; no servers could be reached

                                                
                                                
-- /stdout --
functional_test_tunnel_test.go:322: failed to resolve DNS name: exit status 9
functional_test_tunnel_test.go:329: expected body to contain "ANSWER: 1", but got *"\n; <<>> DiG 9.10.6 <<>> +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A\n; (1 server found)\n;; global options: +cmd\n;; connection timed out; no servers could be reached\n"*
functional_test_tunnel_test.go:332: (dbg) Run:  scutil --dns
functional_test_tunnel_test.go:336: debug for DNS configuration:
DNS configuration

                                                
                                                
resolver #1
nameserver[0] : 8.8.8.8
flags    : Request A records
reach    : 0x00000002 (Reachable)

                                                
                                                
resolver #2
domain   : local
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300000

                                                
                                                
resolver #3
domain   : 254.169.in-addr.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300200

                                                
                                                
resolver #4
domain   : 8.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300400

                                                
                                                
resolver #5
domain   : 9.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300600

                                                
                                                
resolver #6
domain   : a.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300800

                                                
                                                
resolver #7
domain   : b.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 301000

                                                
                                                
resolver #8
domain   : cluster.local
nameserver[0] : 10.96.0.10
flags    : Request A records
reach    : 0x00000002 (Reachable)
order    : 1

                                                
                                                
DNS configuration (for scoped queries)

                                                
                                                
resolver #1
nameserver[0] : 8.8.8.8
if_index : 4 (en0)
flags    : Scoped, Request A records
reach    : 0x00000002 (Reachable)
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (15.05s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (39.54s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
E0307 09:58:25.419634   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
functional_test_tunnel_test.go:419: failed to hit nginx with DNS forwarded "http://nginx-svc.default.svc.cluster.local.": Temporary Error: Get "http://nginx-svc.default.svc.cluster.local.": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
functional_test_tunnel_test.go:426: expected body to contain "Welcome to nginx!", but got *""*
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (39.54s)

                                                
                                    
x
+
TestMutliControlPlane/serial/StartCluster (11.26s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run:  out/minikube-darwin-amd64 start -p ha-917000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=hyperkit 
ha_test.go:101: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ha-917000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=hyperkit : exit status 60 (11.183044499s)

                                                
                                                
-- stdout --
	* [ha-917000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "ha-917000" primary control-plane node in "ha-917000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "ha-917000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 09:58:54.871374   12754 out.go:291] Setting OutFile to fd 1 ...
	I0307 09:58:54.872198   12754 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:58:54.872208   12754 out.go:304] Setting ErrFile to fd 2...
	I0307 09:58:54.872215   12754 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:58:54.872703   12754 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 09:58:54.874179   12754 out.go:298] Setting JSON to false
	I0307 09:58:54.896532   12754 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7105,"bootTime":1709827229,"procs":429,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 09:58:54.896631   12754 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 09:58:54.918453   12754 out.go:177] * [ha-917000] minikube v1.32.0 on Darwin 14.3.1
	I0307 09:58:54.960114   12754 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 09:58:54.981224   12754 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 09:58:54.960135   12754 notify.go:220] Checking for updates...
	I0307 09:58:55.002059   12754 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 09:58:55.023287   12754 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 09:58:55.044028   12754 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 09:58:55.064984   12754 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 09:58:55.086554   12754 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 09:58:55.116787   12754 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 09:58:55.159206   12754 start.go:297] selected driver: hyperkit
	I0307 09:58:55.159236   12754 start.go:901] validating driver "hyperkit" against <nil>
	I0307 09:58:55.159262   12754 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 09:58:55.163347   12754 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 09:58:55.163453   12754 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 09:58:55.171382   12754 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 09:58:55.175401   12754 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:58:55.175422   12754 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 09:58:55.175452   12754 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 09:58:55.175658   12754 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 09:58:55.175712   12754 cni.go:84] Creating CNI manager for ""
	I0307 09:58:55.175721   12754 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I0307 09:58:55.175727   12754 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0307 09:58:55.175800   12754 start.go:340] cluster config:
	{Name:ha-917000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-917000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docke
r CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0
GPUs: AutoPauseInterval:1m0s}
	I0307 09:58:55.175908   12754 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 09:58:55.217966   12754 out.go:177] * Starting "ha-917000" primary control-plane node in "ha-917000" cluster
	I0307 09:58:55.239151   12754 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 09:58:55.239220   12754 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 09:58:55.239242   12754 cache.go:56] Caching tarball of preloaded images
	I0307 09:58:55.239378   12754 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 09:58:55.239392   12754 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 09:58:55.239764   12754 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/ha-917000/config.json ...
	I0307 09:58:55.239817   12754 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/ha-917000/config.json: {Name:mk625893367ca2ccc1e97d6d66a8b7741175fdf3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 09:58:55.240391   12754 start.go:360] acquireMachinesLock for ha-917000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 09:58:55.240488   12754 start.go:364] duration metric: took 79.468µs to acquireMachinesLock for "ha-917000"
	I0307 09:58:55.240521   12754 start.go:93] Provisioning new machine with config: &{Name:ha-917000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-917000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 09:58:55.240583   12754 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 09:58:55.261865   12754 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 09:58:55.262060   12754 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:58:55.262117   12754 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:58:55.270692   12754 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59320
	I0307 09:58:55.271045   12754 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:58:55.271448   12754 main.go:141] libmachine: Using API Version  1
	I0307 09:58:55.271457   12754 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:58:55.271731   12754 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:58:55.271842   12754 main.go:141] libmachine: (ha-917000) Calling .GetMachineName
	I0307 09:58:55.271929   12754 main.go:141] libmachine: (ha-917000) Calling .DriverName
	I0307 09:58:55.272039   12754 start.go:159] libmachine.API.Create for "ha-917000" (driver="hyperkit")
	I0307 09:58:55.272063   12754 client.go:168] LocalClient.Create starting
	I0307 09:58:55.272101   12754 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 09:58:55.272150   12754 main.go:141] libmachine: Decoding PEM data...
	I0307 09:58:55.272167   12754 main.go:141] libmachine: Parsing certificate...
	I0307 09:58:55.272223   12754 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 09:58:55.272261   12754 main.go:141] libmachine: Decoding PEM data...
	I0307 09:58:55.272273   12754 main.go:141] libmachine: Parsing certificate...
	I0307 09:58:55.272289   12754 main.go:141] libmachine: Running pre-create checks...
	I0307 09:58:55.272298   12754 main.go:141] libmachine: (ha-917000) Calling .PreCreateCheck
	I0307 09:58:55.272363   12754 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:58:55.272527   12754 main.go:141] libmachine: (ha-917000) Calling .GetConfigRaw
	I0307 09:58:55.283469   12754 main.go:141] libmachine: Creating machine...
	I0307 09:58:55.283486   12754 main.go:141] libmachine: (ha-917000) Calling .Create
	I0307 09:58:55.283677   12754 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:58:55.283891   12754 main.go:141] libmachine: (ha-917000) DBG | I0307 09:58:55.283649   12762 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 09:58:55.283994   12754 main.go:141] libmachine: (ha-917000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 09:58:55.463149   12754 main.go:141] libmachine: (ha-917000) DBG | I0307 09:58:55.463055   12762 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/id_rsa...
	I0307 09:58:55.596153   12754 main.go:141] libmachine: (ha-917000) DBG | I0307 09:58:55.596070   12762 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/ha-917000.rawdisk...
	I0307 09:58:55.596170   12754 main.go:141] libmachine: (ha-917000) DBG | Writing magic tar header
	I0307 09:58:55.596178   12754 main.go:141] libmachine: (ha-917000) DBG | Writing SSH key tar header
	I0307 09:58:55.596915   12754 main.go:141] libmachine: (ha-917000) DBG | I0307 09:58:55.596854   12762 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000 ...
	I0307 09:58:55.961804   12754 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:58:55.961826   12754 main.go:141] libmachine: (ha-917000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.pid
	I0307 09:58:55.961867   12754 main.go:141] libmachine: (ha-917000) DBG | Using UUID 09bb4d58-ed79-4d94-90d9-b5dc2a46a6ec
	I0307 09:58:56.002496   12754 main.go:141] libmachine: (ha-917000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 09:58:56.002576   12754 client.go:171] duration metric: took 730.498799ms to LocalClient.Create
	I0307 09:58:58.002913   12754 start.go:128] duration metric: took 2.762291545s to createHost
	I0307 09:58:58.002939   12754 start.go:83] releasing machines lock for "ha-917000", held for 2.762421686s
	W0307 09:58:58.002989   12754 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 09:58:58.003518   12754 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:58:58.003564   12754 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:58:58.012409   12754 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59322
	I0307 09:58:58.012725   12754 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:58:58.013131   12754 main.go:141] libmachine: Using API Version  1
	I0307 09:58:58.013153   12754 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:58:58.013389   12754 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:58:58.013732   12754 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:58:58.013755   12754 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:58:58.022073   12754 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59324
	I0307 09:58:58.022412   12754 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:58:58.022771   12754 main.go:141] libmachine: Using API Version  1
	I0307 09:58:58.022785   12754 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:58:58.022984   12754 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:58:58.023109   12754 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 09:58:58.023194   12754 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:58:58.023211   12754 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 09:58:58.023220   12754 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 09:58:58.023271   12754 main.go:141] libmachine: (ha-917000) Calling .DriverName
	I0307 09:58:58.057788   12754 out.go:177] * Deleting "ha-917000" in hyperkit ...
	I0307 09:58:58.078742   12754 main.go:141] libmachine: (ha-917000) Calling .Remove
	I0307 09:58:58.079090   12754 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:58:58.079110   12754 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:58:58.079128   12754 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 09:58:58.079148   12754 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	W0307 09:58:58.096566   12754 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 09:58:58.096579   12754 start.go:728] Will try again in 5 seconds ...
	I0307 09:59:03.097403   12754 start.go:360] acquireMachinesLock for ha-917000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 09:59:03.097555   12754 start.go:364] duration metric: took 124.363µs to acquireMachinesLock for "ha-917000"
	I0307 09:59:03.097578   12754 start.go:93] Provisioning new machine with config: &{Name:ha-917000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-917000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 09:59:03.097678   12754 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 09:59:03.139120   12754 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 09:59:03.139259   12754 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:59:03.139315   12754 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:59:03.148791   12754 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59326
	I0307 09:59:03.149122   12754 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:59:03.149520   12754 main.go:141] libmachine: Using API Version  1
	I0307 09:59:03.149533   12754 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:59:03.149730   12754 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:59:03.149847   12754 main.go:141] libmachine: (ha-917000) Calling .GetMachineName
	I0307 09:59:03.149937   12754 main.go:141] libmachine: (ha-917000) Calling .DriverName
	I0307 09:59:03.150040   12754 start.go:159] libmachine.API.Create for "ha-917000" (driver="hyperkit")
	I0307 09:59:03.150057   12754 client.go:168] LocalClient.Create starting
	I0307 09:59:03.150085   12754 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 09:59:03.150138   12754 main.go:141] libmachine: Decoding PEM data...
	I0307 09:59:03.150149   12754 main.go:141] libmachine: Parsing certificate...
	I0307 09:59:03.150191   12754 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 09:59:03.150241   12754 main.go:141] libmachine: Decoding PEM data...
	I0307 09:59:03.150254   12754 main.go:141] libmachine: Parsing certificate...
	I0307 09:59:03.150268   12754 main.go:141] libmachine: Running pre-create checks...
	I0307 09:59:03.150273   12754 main.go:141] libmachine: (ha-917000) Calling .PreCreateCheck
	I0307 09:59:03.150341   12754 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:59:03.150369   12754 main.go:141] libmachine: (ha-917000) Calling .GetConfigRaw
	I0307 09:59:03.150792   12754 main.go:141] libmachine: Creating machine...
	I0307 09:59:03.150800   12754 main.go:141] libmachine: (ha-917000) Calling .Create
	I0307 09:59:03.150882   12754 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:59:03.151007   12754 main.go:141] libmachine: (ha-917000) DBG | I0307 09:59:03.150878   12771 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 09:59:03.151062   12754 main.go:141] libmachine: (ha-917000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 09:59:03.326687   12754 main.go:141] libmachine: (ha-917000) DBG | I0307 09:59:03.326621   12771 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/id_rsa...
	I0307 09:59:03.432754   12754 main.go:141] libmachine: (ha-917000) DBG | I0307 09:59:03.432698   12771 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/ha-917000.rawdisk...
	I0307 09:59:03.432777   12754 main.go:141] libmachine: (ha-917000) DBG | Writing magic tar header
	I0307 09:59:03.432787   12754 main.go:141] libmachine: (ha-917000) DBG | Writing SSH key tar header
	I0307 09:59:03.433549   12754 main.go:141] libmachine: (ha-917000) DBG | I0307 09:59:03.433454   12771 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000 ...
	I0307 09:59:03.793543   12754 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 09:59:03.793578   12754 main.go:141] libmachine: (ha-917000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.pid
	I0307 09:59:03.793592   12754 main.go:141] libmachine: (ha-917000) DBG | Using UUID b6500542-58a0-4a13-83a2-bfd064822ec1
	I0307 09:59:03.832240   12754 main.go:141] libmachine: (ha-917000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 09:59:03.832325   12754 client.go:171] duration metric: took 682.257386ms to LocalClient.Create
	I0307 09:59:05.834525   12754 start.go:128] duration metric: took 2.736809844s to createHost
	I0307 09:59:05.834555   12754 start.go:83] releasing machines lock for "ha-917000", held for 2.73697033s
	W0307 09:59:05.834708   12754 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p ha-917000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p ha-917000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 09:59:05.858743   12754 out.go:177] 
	W0307 09:59:05.882579   12754 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 09:59:05.882651   12754 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 09:59:05.882687   12754 out.go:239] * Related issues:
	* Related issues:
	W0307 09:59:05.882726   12754 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 09:59:05.882752   12754 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 09:59:05.930784   12754 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:103: failed to fresh-start ha (multi-control plane) cluster. args "out/minikube-darwin-amd64 start -p ha-917000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (74.801895ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/StartCluster (11.26s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DeployApp (82.57s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:128: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml: exit status 1 (100.996634ms)

                                                
                                                
** stderr ** 
	error: cluster "ha-917000" does not exist

                                                
                                                
** /stderr **
ha_test.go:130: failed to create busybox deployment to ha (multi-control plane) cluster
ha_test.go:133: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- rollout status deployment/busybox
ha_test.go:133: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- rollout status deployment/busybox: exit status 1 (101.548283ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:135: failed to deploy busybox to ha (multi-control plane) cluster
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.780677ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
E0307 09:59:06.381653   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.362098ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.778872ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.198385ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.822064ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.070255ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.412679ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.319495ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.75418ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.676928ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:159: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:163: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:163: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (101.433872ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:165: failed get Pod names
ha_test.go:171: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- exec  -- nslookup kubernetes.io
E0307 10:00:28.302719   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
ha_test.go:171: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- exec  -- nslookup kubernetes.io: exit status 1 (100.597457ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:173: Pod  could not resolve 'kubernetes.io': exit status 1
ha_test.go:181: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- exec  -- nslookup kubernetes.default
ha_test.go:181: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- exec  -- nslookup kubernetes.default: exit status 1 (100.714502ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:183: Pod  could not resolve 'kubernetes.default': exit status 1
ha_test.go:189: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- exec  -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (99.455838ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:191: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (73.250758ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DeployApp (82.57s)

                                                
                                    
x
+
TestMutliControlPlane/serial/PingHostFromPods (0.17s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:199: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-917000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (100.077079ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-917000"

                                                
                                                
** /stderr **
ha_test.go:201: failed to get Pod names: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (73.668016ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/PingHostFromPods (0.17s)

                                                
                                    
x
+
TestMutliControlPlane/serial/AddWorkerNode (0.21s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 node add -p ha-917000 -v=7 --alsologtostderr
ha_test.go:228: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p ha-917000 -v=7 --alsologtostderr: exit status 83 (137.665537ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-917000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-917000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:00:28.879826   12886 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:00:28.880096   12886 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:28.880101   12886 out.go:304] Setting ErrFile to fd 2...
	I0307 10:00:28.880105   12886 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:28.880286   12886 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:00:28.880638   12886 mustload.go:65] Loading cluster: ha-917000
	I0307 10:00:28.880909   12886 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:00:28.881258   12886 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:00:28.881304   12886 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:00:28.888976   12886 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59336
	I0307 10:00:28.889348   12886 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:00:28.889790   12886 main.go:141] libmachine: Using API Version  1
	I0307 10:00:28.889821   12886 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:00:28.890072   12886 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:00:28.890188   12886 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:00:28.890271   12886 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:00:28.890287   12886 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:00:28.890297   12886 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:00:28.912158   12886 out.go:177] * The control-plane node ha-917000 host is not running: state=Stopped
	I0307 10:00:28.933706   12886 out.go:177]   To start a cluster, run: "minikube start -p ha-917000"

                                                
                                                
** /stderr **
ha_test.go:230: failed to add worker node to current ha (multi-control plane) cluster. args "out/minikube-darwin-amd64 node add -p ha-917000 -v=7 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (74.375975ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/AddWorkerNode (0.21s)

                                                
                                    
x
+
TestMutliControlPlane/serial/NodeLabels (0.11s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run:  kubectl --context ha-917000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
ha_test.go:255: (dbg) Non-zero exit: kubectl --context ha-917000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (36.621262ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: ha-917000

                                                
                                                
** /stderr **
ha_test.go:257: failed to 'kubectl get nodes' with args "kubectl --context ha-917000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1
ha_test.go:264: failed to decode json from label list: args "kubectl --context ha-917000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (73.895715ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/NodeLabels (0.11s)

                                                
                                    
x
+
TestMutliControlPlane/serial/HAppyAfterClusterStart (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:304: expected profile "ha-917000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-917000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-917000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServe
rPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-917000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4\",\"Containe
rRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\"
:false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
ha_test.go:307: expected profile "ha-917000" in json of 'profile list' to have "HAppy" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-917000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-917000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-917000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4
\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000000
0},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (74.753152ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/HAppyAfterClusterStart (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/CopyFile (0.15s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/CopyFile
ha_test.go:326: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 status --output json -v=7 --alsologtostderr
ha_test.go:326: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 status --output json -v=7 --alsologtostderr: exit status 7 (74.047306ms)

                                                
                                                
-- stdout --
	{"Name":"ha-917000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:00:29.423588   12904 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:00:29.423765   12904 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:29.423771   12904 out.go:304] Setting ErrFile to fd 2...
	I0307 10:00:29.423775   12904 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:29.423954   12904 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:00:29.424143   12904 out.go:298] Setting JSON to true
	I0307 10:00:29.424164   12904 mustload.go:65] Loading cluster: ha-917000
	I0307 10:00:29.424207   12904 notify.go:220] Checking for updates...
	I0307 10:00:29.424429   12904 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:00:29.424446   12904 status.go:255] checking status of ha-917000 ...
	I0307 10:00:29.425948   12904 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:00:29.426008   12904 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:00:29.434189   12904 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59351
	I0307 10:00:29.434536   12904 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:00:29.434941   12904 main.go:141] libmachine: Using API Version  1
	I0307 10:00:29.434959   12904 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:00:29.435186   12904 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:00:29.435298   12904 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:00:29.435385   12904 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:00:29.435415   12904 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:00:29.435426   12904 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:00:29.435470   12904 status.go:330] ha-917000 host status = "Stopped" (err=<nil>)
	I0307 10:00:29.435481   12904 status.go:343] host is not running, skipping remaining checks
	I0307 10:00:29.435488   12904 status.go:257] ha-917000 status: &{Name:ha-917000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:333: failed to decode json from status: args "out/minikube-darwin-amd64 -p ha-917000 status --output json -v=7 --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (73.920026ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/CopyFile (0.15s)

                                                
                                    
x
+
TestMutliControlPlane/serial/StopSecondaryNode (0.31s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/StopSecondaryNode
ha_test.go:363: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 node stop m02 -v=7 --alsologtostderr
ha_test.go:363: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 node stop m02 -v=7 --alsologtostderr: exit status 85 (158.62562ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:00:29.573975   12910 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:00:29.574404   12910 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:29.574411   12910 out.go:304] Setting ErrFile to fd 2...
	I0307 10:00:29.574415   12910 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:29.574583   12910 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:00:29.574952   12910 mustload.go:65] Loading cluster: ha-917000
	I0307 10:00:29.575280   12910 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:00:29.596628   12910 out.go:177] 
	W0307 10:00:29.617390   12910 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	W0307 10:00:29.617404   12910 out.go:239] * 
	* 
	W0307 10:00:29.626650   12910 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_8ce24bb09be8aab84076d51946735f62cbf80299_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_8ce24bb09be8aab84076d51946735f62cbf80299_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I0307 10:00:29.647357   12910 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:365: secondary control-plane node stop returned an error. args "out/minikube-darwin-amd64 -p ha-917000 node stop m02 -v=7 --alsologtostderr": exit status 85
ha_test.go:369: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr
ha_test.go:369: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr: exit status 7 (74.124419ms)

                                                
                                                
-- stdout --
	ha-917000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:00:29.731622   12912 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:00:29.731894   12912 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:29.731900   12912 out.go:304] Setting ErrFile to fd 2...
	I0307 10:00:29.731904   12912 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:29.732075   12912 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:00:29.732258   12912 out.go:298] Setting JSON to false
	I0307 10:00:29.732279   12912 mustload.go:65] Loading cluster: ha-917000
	I0307 10:00:29.732326   12912 notify.go:220] Checking for updates...
	I0307 10:00:29.732557   12912 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:00:29.732575   12912 status.go:255] checking status of ha-917000 ...
	I0307 10:00:29.733271   12912 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:00:29.733560   12912 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:00:29.742069   12912 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59357
	I0307 10:00:29.742405   12912 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:00:29.742827   12912 main.go:141] libmachine: Using API Version  1
	I0307 10:00:29.742836   12912 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:00:29.743030   12912 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:00:29.743138   12912 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:00:29.743219   12912 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:00:29.743233   12912 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:00:29.743241   12912 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:00:29.743283   12912 status.go:330] ha-917000 host status = "Stopped" (err=<nil>)
	I0307 10:00:29.743296   12912 status.go:343] host is not running, skipping remaining checks
	I0307 10:00:29.743302   12912 status.go:257] ha-917000 status: &{Name:ha-917000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:375: status says not all three control-plane nodes are present: args "out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr": ha-917000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:378: status says not three hosts are running: args "out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr": ha-917000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:381: status says not three kubelets are running: args "out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr": ha-917000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:384: status says not two apiservers are running: args "out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr": ha-917000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (73.855759ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/StopSecondaryNode (0.31s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:390: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:413: expected profile "ha-917000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-917000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-917000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACoun
t\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-917000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.2
8.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000
0000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (74.034663ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/RestartSecondaryNode (54.97s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/RestartSecondaryNode
ha_test.go:420: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 node start m02 -v=7 --alsologtostderr
ha_test.go:420: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 node start m02 -v=7 --alsologtostderr: exit status 85 (155.845144ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:00:30.101237   12928 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:00:30.102094   12928 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:30.102101   12928 out.go:304] Setting ErrFile to fd 2...
	I0307 10:00:30.102105   12928 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:30.102279   12928 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:00:30.102657   12928 mustload.go:65] Loading cluster: ha-917000
	I0307 10:00:30.103897   12928 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:00:30.124618   12928 out.go:177] 
	W0307 10:00:30.145558   12928 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	W0307 10:00:30.145584   12928 out.go:239] * 
	* 
	W0307 10:00:30.150230   12928 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I0307 10:00:30.171558   12928 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:422: I0307 10:00:30.101237   12928 out.go:291] Setting OutFile to fd 1 ...
I0307 10:00:30.102094   12928 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 10:00:30.102101   12928 out.go:304] Setting ErrFile to fd 2...
I0307 10:00:30.102105   12928 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 10:00:30.102279   12928 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
I0307 10:00:30.102657   12928 mustload.go:65] Loading cluster: ha-917000
I0307 10:00:30.103897   12928 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 10:00:30.124618   12928 out.go:177] 
W0307 10:00:30.145558   12928 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
W0307 10:00:30.145584   12928 out.go:239] * 
* 
W0307 10:00:30.150230   12928 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I0307 10:00:30.171558   12928 out.go:177] 
ha_test.go:423: secondary control-plane node start returned an error. args "out/minikube-darwin-amd64 -p ha-917000 node start m02 -v=7 --alsologtostderr": exit status 85
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr: exit status 7 (74.091934ms)

                                                
                                                
-- stdout --
	ha-917000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:00:30.258773   12930 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:00:30.258957   12930 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:30.258962   12930 out.go:304] Setting ErrFile to fd 2...
	I0307 10:00:30.258966   12930 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:30.259143   12930 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:00:30.259332   12930 out.go:298] Setting JSON to false
	I0307 10:00:30.259362   12930 mustload.go:65] Loading cluster: ha-917000
	I0307 10:00:30.259405   12930 notify.go:220] Checking for updates...
	I0307 10:00:30.259633   12930 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:00:30.259652   12930 status.go:255] checking status of ha-917000 ...
	I0307 10:00:30.260019   12930 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:00:30.260066   12930 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:00:30.268440   12930 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59369
	I0307 10:00:30.268805   12930 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:00:30.269244   12930 main.go:141] libmachine: Using API Version  1
	I0307 10:00:30.269254   12930 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:00:30.269448   12930 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:00:30.269549   12930 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:00:30.269630   12930 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:00:30.269660   12930 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:00:30.269678   12930 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:00:30.269680   12930 status.go:330] ha-917000 host status = "Stopped" (err=<nil>)
	I0307 10:00:30.269688   12930 status.go:343] host is not running, skipping remaining checks
	I0307 10:00:30.269696   12930 status.go:257] ha-917000 status: &{Name:ha-917000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr: exit status 7 (74.674716ms)

                                                
                                                
-- stdout --
	ha-917000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:00:31.595030   12933 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:00:31.595316   12933 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:31.595322   12933 out.go:304] Setting ErrFile to fd 2...
	I0307 10:00:31.595326   12933 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:31.595511   12933 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:00:31.595702   12933 out.go:298] Setting JSON to false
	I0307 10:00:31.595724   12933 mustload.go:65] Loading cluster: ha-917000
	I0307 10:00:31.595761   12933 notify.go:220] Checking for updates...
	I0307 10:00:31.595993   12933 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:00:31.596010   12933 status.go:255] checking status of ha-917000 ...
	I0307 10:00:31.596719   12933 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:00:31.596780   12933 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:00:31.605491   12933 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59372
	I0307 10:00:31.605812   12933 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:00:31.606213   12933 main.go:141] libmachine: Using API Version  1
	I0307 10:00:31.606225   12933 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:00:31.606443   12933 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:00:31.606553   12933 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:00:31.606634   12933 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:00:31.606656   12933 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:00:31.606668   12933 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:00:31.606682   12933 status.go:330] ha-917000 host status = "Stopped" (err=<nil>)
	I0307 10:00:31.606689   12933 status.go:343] host is not running, skipping remaining checks
	I0307 10:00:31.606696   12933 status.go:257] ha-917000 status: &{Name:ha-917000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr: exit status 7 (78.325372ms)

                                                
                                                
-- stdout --
	ha-917000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:00:33.843700   12936 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:00:33.843899   12936 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:33.843904   12936 out.go:304] Setting ErrFile to fd 2...
	I0307 10:00:33.843908   12936 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:33.844082   12936 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:00:33.844259   12936 out.go:298] Setting JSON to false
	I0307 10:00:33.844280   12936 mustload.go:65] Loading cluster: ha-917000
	I0307 10:00:33.844315   12936 notify.go:220] Checking for updates...
	I0307 10:00:33.844547   12936 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:00:33.844565   12936 status.go:255] checking status of ha-917000 ...
	I0307 10:00:33.844925   12936 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:00:33.844977   12936 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:00:33.853159   12936 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59375
	I0307 10:00:33.853479   12936 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:00:33.853959   12936 main.go:141] libmachine: Using API Version  1
	I0307 10:00:33.853975   12936 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:00:33.854178   12936 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:00:33.854272   12936 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:00:33.854360   12936 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:00:33.854401   12936 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:00:33.854414   12936 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:00:33.854438   12936 status.go:330] ha-917000 host status = "Stopped" (err=<nil>)
	I0307 10:00:33.854452   12936 status.go:343] host is not running, skipping remaining checks
	I0307 10:00:33.854459   12936 status.go:257] ha-917000 status: &{Name:ha-917000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr: exit status 7 (74.625778ms)

                                                
                                                
-- stdout --
	ha-917000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:00:36.423922   12939 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:00:36.424749   12939 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:36.424758   12939 out.go:304] Setting ErrFile to fd 2...
	I0307 10:00:36.424764   12939 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:36.425269   12939 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:00:36.425467   12939 out.go:298] Setting JSON to false
	I0307 10:00:36.425488   12939 mustload.go:65] Loading cluster: ha-917000
	I0307 10:00:36.425535   12939 notify.go:220] Checking for updates...
	I0307 10:00:36.425744   12939 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:00:36.425760   12939 status.go:255] checking status of ha-917000 ...
	I0307 10:00:36.426140   12939 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:00:36.426175   12939 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:00:36.434332   12939 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59378
	I0307 10:00:36.434645   12939 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:00:36.435024   12939 main.go:141] libmachine: Using API Version  1
	I0307 10:00:36.435032   12939 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:00:36.435254   12939 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:00:36.435350   12939 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:00:36.435426   12939 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:00:36.435468   12939 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:00:36.435489   12939 status.go:330] ha-917000 host status = "Stopped" (err=<nil>)
	I0307 10:00:36.435500   12939 status.go:343] host is not running, skipping remaining checks
	I0307 10:00:36.435500   12939 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:00:36.435507   12939 status.go:257] ha-917000 status: &{Name:ha-917000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr: exit status 7 (75.210688ms)

                                                
                                                
-- stdout --
	ha-917000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:00:40.333671   12943 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:00:40.333877   12943 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:40.333882   12943 out.go:304] Setting ErrFile to fd 2...
	I0307 10:00:40.333886   12943 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:40.334065   12943 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:00:40.334252   12943 out.go:298] Setting JSON to false
	I0307 10:00:40.334274   12943 mustload.go:65] Loading cluster: ha-917000
	I0307 10:00:40.334309   12943 notify.go:220] Checking for updates...
	I0307 10:00:40.335647   12943 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:00:40.335669   12943 status.go:255] checking status of ha-917000 ...
	I0307 10:00:40.336065   12943 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:00:40.336111   12943 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:00:40.344284   12943 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59381
	I0307 10:00:40.344613   12943 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:00:40.345090   12943 main.go:141] libmachine: Using API Version  1
	I0307 10:00:40.345111   12943 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:00:40.345300   12943 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:00:40.345398   12943 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:00:40.345481   12943 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:00:40.345495   12943 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:00:40.345504   12943 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:00:40.345532   12943 status.go:330] ha-917000 host status = "Stopped" (err=<nil>)
	I0307 10:00:40.345543   12943 status.go:343] host is not running, skipping remaining checks
	I0307 10:00:40.345549   12943 status.go:257] ha-917000 status: &{Name:ha-917000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr: exit status 7 (73.638149ms)

                                                
                                                
-- stdout --
	ha-917000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:00:46.744066   12950 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:00:46.744348   12950 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:46.744353   12950 out.go:304] Setting ErrFile to fd 2...
	I0307 10:00:46.744357   12950 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:46.744518   12950 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:00:46.744703   12950 out.go:298] Setting JSON to false
	I0307 10:00:46.744725   12950 mustload.go:65] Loading cluster: ha-917000
	I0307 10:00:46.744770   12950 notify.go:220] Checking for updates...
	I0307 10:00:46.745033   12950 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:00:46.745051   12950 status.go:255] checking status of ha-917000 ...
	I0307 10:00:46.745380   12950 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:00:46.745425   12950 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:00:46.753453   12950 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59384
	I0307 10:00:46.753766   12950 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:00:46.754163   12950 main.go:141] libmachine: Using API Version  1
	I0307 10:00:46.754173   12950 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:00:46.754433   12950 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:00:46.754558   12950 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:00:46.754645   12950 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:00:46.754668   12950 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:00:46.754678   12950 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:00:46.754729   12950 status.go:330] ha-917000 host status = "Stopped" (err=<nil>)
	I0307 10:00:46.754741   12950 status.go:343] host is not running, skipping remaining checks
	I0307 10:00:46.754747   12950 status.go:257] ha-917000 status: &{Name:ha-917000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr: exit status 7 (77.236931ms)

                                                
                                                
-- stdout --
	ha-917000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:00:50.878721   12955 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:00:50.878907   12955 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:50.878913   12955 out.go:304] Setting ErrFile to fd 2...
	I0307 10:00:50.878916   12955 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:00:50.879114   12955 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:00:50.879295   12955 out.go:298] Setting JSON to false
	I0307 10:00:50.879315   12955 mustload.go:65] Loading cluster: ha-917000
	I0307 10:00:50.879360   12955 notify.go:220] Checking for updates...
	I0307 10:00:50.880356   12955 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:00:50.880404   12955 status.go:255] checking status of ha-917000 ...
	I0307 10:00:50.880980   12955 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:00:50.881053   12955 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:00:50.889278   12955 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59387
	I0307 10:00:50.889610   12955 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:00:50.890062   12955 main.go:141] libmachine: Using API Version  1
	I0307 10:00:50.890082   12955 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:00:50.890335   12955 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:00:50.890452   12955 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:00:50.890552   12955 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:00:50.890566   12955 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:00:50.890576   12955 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:00:50.890592   12955 status.go:330] ha-917000 host status = "Stopped" (err=<nil>)
	I0307 10:00:50.890603   12955 status.go:343] host is not running, skipping remaining checks
	I0307 10:00:50.890610   12955 status.go:257] ha-917000 status: &{Name:ha-917000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr: exit status 7 (75.606092ms)

                                                
                                                
-- stdout --
	ha-917000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:01:02.310672   12970 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:01:02.310859   12970 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:02.310864   12970 out.go:304] Setting ErrFile to fd 2...
	I0307 10:01:02.310868   12970 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:02.311046   12970 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:01:02.311225   12970 out.go:298] Setting JSON to false
	I0307 10:01:02.311246   12970 mustload.go:65] Loading cluster: ha-917000
	I0307 10:01:02.311284   12970 notify.go:220] Checking for updates...
	I0307 10:01:02.311506   12970 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:01:02.311525   12970 status.go:255] checking status of ha-917000 ...
	I0307 10:01:02.311949   12970 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:02.311993   12970 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:01:02.320115   12970 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59390
	I0307 10:01:02.320437   12970 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:01:02.320861   12970 main.go:141] libmachine: Using API Version  1
	I0307 10:01:02.320895   12970 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:01:02.321141   12970 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:01:02.321258   12970 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:01:02.321344   12970 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:01:02.321363   12970 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:01:02.321371   12970 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:01:02.321421   12970 status.go:330] ha-917000 host status = "Stopped" (err=<nil>)
	I0307 10:01:02.321431   12970 status.go:343] host is not running, skipping remaining checks
	I0307 10:01:02.321438   12970 status.go:257] ha-917000 status: &{Name:ha-917000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr: exit status 7 (76.01126ms)

                                                
                                                
-- stdout --
	ha-917000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:01:24.889320   12984 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:01:24.889549   12984 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:24.889555   12984 out.go:304] Setting ErrFile to fd 2...
	I0307 10:01:24.889559   12984 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:24.889734   12984 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:01:24.889921   12984 out.go:298] Setting JSON to false
	I0307 10:01:24.889942   12984 mustload.go:65] Loading cluster: ha-917000
	I0307 10:01:24.889985   12984 notify.go:220] Checking for updates...
	I0307 10:01:24.890877   12984 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:01:24.890908   12984 status.go:255] checking status of ha-917000 ...
	I0307 10:01:24.891643   12984 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:24.891688   12984 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:01:24.899954   12984 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59393
	I0307 10:01:24.900292   12984 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:01:24.900682   12984 main.go:141] libmachine: Using API Version  1
	I0307 10:01:24.900698   12984 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:01:24.900904   12984 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:01:24.901028   12984 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:01:24.901102   12984 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:01:24.901114   12984 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:01:24.901125   12984 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:01:24.901160   12984 status.go:330] ha-917000 host status = "Stopped" (err=<nil>)
	I0307 10:01:24.901170   12984 status.go:343] host is not running, skipping remaining checks
	I0307 10:01:24.901176   12984 status.go:257] ha-917000 status: &{Name:ha-917000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:432: failed to run minikube status. args "out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (104.932068ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/RestartSecondaryNode (54.97s)

                                                
                                    
x
+
TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:304: expected profile "ha-917000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-917000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-917000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServe
rPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-917000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4\",\"Containe
rRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\"
:false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
ha_test.go:307: expected profile "ha-917000" in json of 'profile list' to have "HAppy" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-917000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-917000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-917000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4
\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000000
0},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (74.063912ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/RestartClusterKeepsNodes (9.86s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:456: (dbg) Run:  out/minikube-darwin-amd64 node list -p ha-917000 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Run:  out/minikube-darwin-amd64 stop -p ha-917000 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Done: out/minikube-darwin-amd64 stop -p ha-917000 -v=7 --alsologtostderr: (3.861904688s)
ha_test.go:467: (dbg) Run:  out/minikube-darwin-amd64 start -p ha-917000 --wait=true -v=7 --alsologtostderr
ha_test.go:467: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ha-917000 --wait=true -v=7 --alsologtostderr: exit status 60 (5.79715528s)

                                                
                                                
-- stdout --
	* [ha-917000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "ha-917000" primary control-plane node in "ha-917000" cluster
	* Restarting existing hyperkit VM for "ha-917000" ...
	* Restarting existing hyperkit VM for "ha-917000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:01:29.216328   13027 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:01:29.216590   13027 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:29.216595   13027 out.go:304] Setting ErrFile to fd 2...
	I0307 10:01:29.216599   13027 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:29.216793   13027 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:01:29.218231   13027 out.go:298] Setting JSON to false
	I0307 10:01:29.240301   13027 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7260,"bootTime":1709827229,"procs":433,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:01:29.240398   13027 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:01:29.261915   13027 out.go:177] * [ha-917000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:01:29.304360   13027 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:01:29.304393   13027 notify.go:220] Checking for updates...
	I0307 10:01:29.346170   13027 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:01:29.367372   13027 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:01:29.388323   13027 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:01:29.409151   13027 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:01:29.430345   13027 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:01:29.452061   13027 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:01:29.452228   13027 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:01:29.452904   13027 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:29.452989   13027 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:01:29.461994   13027 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59416
	I0307 10:01:29.462357   13027 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:01:29.462762   13027 main.go:141] libmachine: Using API Version  1
	I0307 10:01:29.462773   13027 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:01:29.462959   13027 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:01:29.463071   13027 main.go:141] libmachine: (ha-917000) Calling .DriverName
	I0307 10:01:29.491087   13027 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 10:01:29.533268   13027 start.go:297] selected driver: hyperkit
	I0307 10:01:29.533297   13027 start.go:901] validating driver "hyperkit" against &{Name:ha-917000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-917000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:01:29.533480   13027 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:01:29.533674   13027 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:01:29.533860   13027 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:01:29.542482   13027 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:01:29.546287   13027 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:29.546315   13027 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 10:01:29.548959   13027 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:01:29.549027   13027 cni.go:84] Creating CNI manager for ""
	I0307 10:01:29.549036   13027 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0307 10:01:29.549103   13027 start.go:340] cluster config:
	{Name:ha-917000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-917000 Namespace:default APIServerHAVIP: APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:01:29.549206   13027 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:01:29.591310   13027 out.go:177] * Starting "ha-917000" primary control-plane node in "ha-917000" cluster
	I0307 10:01:29.612344   13027 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:01:29.612484   13027 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:01:29.612515   13027 cache.go:56] Caching tarball of preloaded images
	I0307 10:01:29.612856   13027 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:01:29.612875   13027 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:01:29.613008   13027 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/ha-917000/config.json ...
	I0307 10:01:29.613887   13027 start.go:360] acquireMachinesLock for ha-917000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:01:29.614004   13027 start.go:364] duration metric: took 92.918µs to acquireMachinesLock for "ha-917000"
	I0307 10:01:29.614039   13027 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:01:29.614058   13027 fix.go:54] fixHost starting: 
	I0307 10:01:29.614479   13027 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:29.614505   13027 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:01:29.623005   13027 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59418
	I0307 10:01:29.623370   13027 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:01:29.623755   13027 main.go:141] libmachine: Using API Version  1
	I0307 10:01:29.623768   13027 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:01:29.623995   13027 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:01:29.624093   13027 main.go:141] libmachine: (ha-917000) Calling .DriverName
	I0307 10:01:29.624201   13027 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:01:29.624295   13027 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:01:29.624307   13027 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:01:29.624319   13027 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:01:29.624367   13027 fix.go:112] recreateIfNeeded on ha-917000: state=Stopped err=<nil>
	I0307 10:01:29.624383   13027 main.go:141] libmachine: (ha-917000) Calling .DriverName
	W0307 10:01:29.624458   13027 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:01:29.645241   13027 out.go:177] * Restarting existing hyperkit VM for "ha-917000" ...
	I0307 10:01:29.687275   13027 main.go:141] libmachine: (ha-917000) Calling .Start
	I0307 10:01:29.687472   13027 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:01:29.687523   13027 main.go:141] libmachine: (ha-917000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.pid
	I0307 10:01:29.687588   13027 main.go:141] libmachine: (ha-917000) DBG | Using UUID b6500542-58a0-4a13-83a2-bfd064822ec1
	I0307 10:01:29.725635   13027 main.go:141] libmachine: (ha-917000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:01:29.725740   13027 fix.go:56] duration metric: took 111.685228ms for fixHost
	I0307 10:01:29.725750   13027 start.go:83] releasing machines lock for "ha-917000", held for 111.733468ms
	W0307 10:01:29.725764   13027 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 10:01:29.725823   13027 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:01:29.725829   13027 start.go:728] Will try again in 5 seconds ...
	I0307 10:01:34.726530   13027 start.go:360] acquireMachinesLock for ha-917000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:01:34.726717   13027 start.go:364] duration metric: took 120.278µs to acquireMachinesLock for "ha-917000"
	I0307 10:01:34.726748   13027 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:01:34.726754   13027 fix.go:54] fixHost starting: 
	I0307 10:01:34.727114   13027 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:34.727149   13027 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:01:34.735849   13027 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59420
	I0307 10:01:34.736211   13027 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:01:34.736545   13027 main.go:141] libmachine: Using API Version  1
	I0307 10:01:34.736555   13027 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:01:34.736769   13027 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:01:34.736884   13027 main.go:141] libmachine: (ha-917000) Calling .DriverName
	I0307 10:01:34.736984   13027 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:01:34.737065   13027 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:01:34.737082   13027 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:01:34.737125   13027 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:01:34.737157   13027 fix.go:112] recreateIfNeeded on ha-917000: state=Stopped err=<nil>
	I0307 10:01:34.737177   13027 main.go:141] libmachine: (ha-917000) Calling .DriverName
	W0307 10:01:34.737271   13027 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:01:34.758837   13027 out.go:177] * Restarting existing hyperkit VM for "ha-917000" ...
	I0307 10:01:34.780448   13027 main.go:141] libmachine: (ha-917000) Calling .Start
	I0307 10:01:34.780657   13027 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:01:34.780716   13027 main.go:141] libmachine: (ha-917000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.pid
	I0307 10:01:34.780740   13027 main.go:141] libmachine: (ha-917000) DBG | Using UUID b6500542-58a0-4a13-83a2-bfd064822ec1
	I0307 10:01:34.782453   13027 main.go:141] libmachine: (ha-917000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:01:34.782529   13027 fix.go:56] duration metric: took 55.774872ms for fixHost
	I0307 10:01:34.782538   13027 start.go:83] releasing machines lock for "ha-917000", held for 55.810885ms
	W0307 10:01:34.782610   13027 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p ha-917000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p ha-917000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:01:34.824409   13027 out.go:177] 
	W0307 10:01:34.847512   13027 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:01:34.847581   13027 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:01:34.847603   13027 out.go:239] * Related issues:
	* Related issues:
	W0307 10:01:34.847640   13027 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:01:34.847672   13027 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:01:34.889441   13027 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:469: failed to run minikube start. args "out/minikube-darwin-amd64 node list -p ha-917000 -v=7 --alsologtostderr" : exit status 60
ha_test.go:472: (dbg) Run:  out/minikube-darwin-amd64 node list -p ha-917000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (74.756457ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/RestartClusterKeepsNodes (9.86s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DeleteSecondaryNode (0.29s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DeleteSecondaryNode
ha_test.go:487: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 node delete m03 -v=7 --alsologtostderr
ha_test.go:487: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 node delete m03 -v=7 --alsologtostderr: exit status 83 (137.571705ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-917000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-917000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:01:35.155189   13044 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:01:35.155493   13044 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:35.155499   13044 out.go:304] Setting ErrFile to fd 2...
	I0307 10:01:35.155503   13044 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:35.155690   13044 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:01:35.156067   13044 mustload.go:65] Loading cluster: ha-917000
	I0307 10:01:35.156393   13044 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:01:35.156738   13044 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:35.156778   13044 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:01:35.164398   13044 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59425
	I0307 10:01:35.164843   13044 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:01:35.165253   13044 main.go:141] libmachine: Using API Version  1
	I0307 10:01:35.165261   13044 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:01:35.165460   13044 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:01:35.165562   13044 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:01:35.165653   13044 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:01:35.165666   13044 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:01:35.165679   13044 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:01:35.187464   13044 out.go:177] * The control-plane node ha-917000 host is not running: state=Stopped
	I0307 10:01:35.207969   13044 out.go:177]   To start a cluster, run: "minikube start -p ha-917000"

                                                
                                                
** /stderr **
ha_test.go:489: node delete returned an error. args "out/minikube-darwin-amd64 -p ha-917000 node delete m03 -v=7 --alsologtostderr": exit status 83
ha_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr
ha_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr: exit status 7 (73.883353ms)

                                                
                                                
-- stdout --
	ha-917000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:01:35.292933   13047 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:01:35.293111   13047 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:35.293116   13047 out.go:304] Setting ErrFile to fd 2...
	I0307 10:01:35.293120   13047 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:35.293295   13047 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:01:35.293476   13047 out.go:298] Setting JSON to false
	I0307 10:01:35.293498   13047 mustload.go:65] Loading cluster: ha-917000
	I0307 10:01:35.293538   13047 notify.go:220] Checking for updates...
	I0307 10:01:35.293760   13047 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:01:35.293778   13047 status.go:255] checking status of ha-917000 ...
	I0307 10:01:35.294118   13047 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:35.294171   13047 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:01:35.302353   13047 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59428
	I0307 10:01:35.302721   13047 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:01:35.303170   13047 main.go:141] libmachine: Using API Version  1
	I0307 10:01:35.303187   13047 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:01:35.303397   13047 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:01:35.303502   13047 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:01:35.303574   13047 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:01:35.303598   13047 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:01:35.303617   13047 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:01:35.303623   13047 status.go:330] ha-917000 host status = "Stopped" (err=<nil>)
	I0307 10:01:35.303630   13047 status.go:343] host is not running, skipping remaining checks
	I0307 10:01:35.303637   13047 status.go:257] ha-917000 status: &{Name:ha-917000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:495: failed to run minikube status. args "out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (73.910387ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DeleteSecondaryNode (0.29s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:390: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:413: expected profile "ha-917000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-917000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-917000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACoun
t\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-917000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.2
8.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000
0000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (74.788733ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/StopCluster (3.73s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/StopCluster
ha_test.go:531: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 stop -v=7 --alsologtostderr
ha_test.go:531: (dbg) Done: out/minikube-darwin-amd64 -p ha-917000 stop -v=7 --alsologtostderr: (3.580145048s)
ha_test.go:537: (dbg) Run:  out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr
ha_test.go:537: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr: exit status 7 (74.81148ms)

                                                
                                                
-- stdout --
	ha-917000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:01:39.242855   13082 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:01:39.243135   13082 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:39.243140   13082 out.go:304] Setting ErrFile to fd 2...
	I0307 10:01:39.243144   13082 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:39.243865   13082 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:01:39.244300   13082 out.go:298] Setting JSON to false
	I0307 10:01:39.244329   13082 mustload.go:65] Loading cluster: ha-917000
	I0307 10:01:39.244381   13082 notify.go:220] Checking for updates...
	I0307 10:01:39.244618   13082 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:01:39.244635   13082 status.go:255] checking status of ha-917000 ...
	I0307 10:01:39.244989   13082 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:39.245028   13082 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:01:39.253197   13082 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59450
	I0307 10:01:39.253530   13082 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:01:39.253957   13082 main.go:141] libmachine: Using API Version  1
	I0307 10:01:39.253968   13082 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:01:39.254168   13082 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:01:39.254272   13082 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:01:39.254366   13082 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:01:39.254381   13082 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:01:39.254388   13082 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:01:39.254456   13082 status.go:330] ha-917000 host status = "Stopped" (err=<nil>)
	I0307 10:01:39.254473   13082 status.go:343] host is not running, skipping remaining checks
	I0307 10:01:39.254485   13082 status.go:257] ha-917000 status: &{Name:ha-917000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:543: status says not two control-plane nodes are present: args "out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr": ha-917000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:549: status says not three kubelets are stopped: args "out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr": ha-917000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:552: status says not two apiservers are stopped: args "out/minikube-darwin-amd64 -p ha-917000 status -v=7 --alsologtostderr": ha-917000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (74.805781ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/StopCluster (3.73s)

                                                
                                    
x
+
TestMutliControlPlane/serial/RestartCluster (5.9s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/RestartCluster
ha_test.go:560: (dbg) Run:  out/minikube-darwin-amd64 start -p ha-917000 --wait=true -v=7 --alsologtostderr --driver=hyperkit 
ha_test.go:560: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ha-917000 --wait=true -v=7 --alsologtostderr --driver=hyperkit : exit status 60 (5.827577046s)

                                                
                                                
-- stdout --
	* [ha-917000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "ha-917000" primary control-plane node in "ha-917000" cluster
	* Restarting existing hyperkit VM for "ha-917000" ...
	* Restarting existing hyperkit VM for "ha-917000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:01:39.391418   13088 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:01:39.391592   13088 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:39.391597   13088 out.go:304] Setting ErrFile to fd 2...
	I0307 10:01:39.391601   13088 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:39.391781   13088 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:01:39.393186   13088 out.go:298] Setting JSON to false
	I0307 10:01:39.416639   13088 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7270,"bootTime":1709827229,"procs":441,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:01:39.416736   13088 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:01:39.438677   13088 out.go:177] * [ha-917000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:01:39.480952   13088 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:01:39.481019   13088 notify.go:220] Checking for updates...
	I0307 10:01:39.522987   13088 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:01:39.543901   13088 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:01:39.565092   13088 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:01:39.586288   13088 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:01:39.606891   13088 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:01:39.628533   13088 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:01:39.628972   13088 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:39.629045   13088 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:01:39.637514   13088 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59456
	I0307 10:01:39.637878   13088 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:01:39.638332   13088 main.go:141] libmachine: Using API Version  1
	I0307 10:01:39.638351   13088 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:01:39.638544   13088 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:01:39.638655   13088 main.go:141] libmachine: (ha-917000) Calling .DriverName
	I0307 10:01:39.638845   13088 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:01:39.639084   13088 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:39.639116   13088 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:01:39.647135   13088 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59458
	I0307 10:01:39.647474   13088 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:01:39.647815   13088 main.go:141] libmachine: Using API Version  1
	I0307 10:01:39.647829   13088 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:01:39.648019   13088 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:01:39.648119   13088 main.go:141] libmachine: (ha-917000) Calling .DriverName
	I0307 10:01:39.676326   13088 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 10:01:39.718019   13088 start.go:297] selected driver: hyperkit
	I0307 10:01:39.718048   13088 start.go:901] validating driver "hyperkit" against &{Name:ha-917000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-917000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:01:39.718253   13088 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:01:39.718497   13088 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:01:39.718693   13088 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:01:39.728099   13088 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:01:39.732014   13088 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:39.732037   13088 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 10:01:39.734723   13088 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:01:39.734800   13088 cni.go:84] Creating CNI manager for ""
	I0307 10:01:39.734809   13088 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0307 10:01:39.734883   13088 start.go:340] cluster config:
	{Name:ha-917000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-917000 Namespace:default APIServerHAVIP: APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:01:39.734970   13088 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:01:39.776909   13088 out.go:177] * Starting "ha-917000" primary control-plane node in "ha-917000" cluster
	I0307 10:01:39.798212   13088 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:01:39.798292   13088 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:01:39.798317   13088 cache.go:56] Caching tarball of preloaded images
	I0307 10:01:39.798523   13088 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:01:39.798542   13088 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:01:39.798678   13088 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/ha-917000/config.json ...
	I0307 10:01:39.799491   13088 start.go:360] acquireMachinesLock for ha-917000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:01:39.799602   13088 start.go:364] duration metric: took 86.829µs to acquireMachinesLock for "ha-917000"
	I0307 10:01:39.799636   13088 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:01:39.799654   13088 fix.go:54] fixHost starting: 
	I0307 10:01:39.800019   13088 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:39.800054   13088 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:01:39.808601   13088 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59460
	I0307 10:01:39.808973   13088 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:01:39.809311   13088 main.go:141] libmachine: Using API Version  1
	I0307 10:01:39.809321   13088 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:01:39.809548   13088 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:01:39.809649   13088 main.go:141] libmachine: (ha-917000) Calling .DriverName
	I0307 10:01:39.809737   13088 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:01:39.809811   13088 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:01:39.809824   13088 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:01:39.809838   13088 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:01:39.809886   13088 fix.go:112] recreateIfNeeded on ha-917000: state=Stopped err=<nil>
	I0307 10:01:39.809955   13088 main.go:141] libmachine: (ha-917000) Calling .DriverName
	W0307 10:01:39.810045   13088 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:01:39.831101   13088 out.go:177] * Restarting existing hyperkit VM for "ha-917000" ...
	I0307 10:01:39.873093   13088 main.go:141] libmachine: (ha-917000) Calling .Start
	I0307 10:01:39.873373   13088 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:01:39.873447   13088 main.go:141] libmachine: (ha-917000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.pid
	I0307 10:01:39.873522   13088 main.go:141] libmachine: (ha-917000) DBG | Using UUID b6500542-58a0-4a13-83a2-bfd064822ec1
	I0307 10:01:39.875624   13088 main.go:141] libmachine: (ha-917000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:01:39.875729   13088 fix.go:56] duration metric: took 76.079789ms for fixHost
	I0307 10:01:39.875744   13088 start.go:83] releasing machines lock for "ha-917000", held for 76.129087ms
	W0307 10:01:39.875764   13088 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 10:01:39.875837   13088 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:01:39.875846   13088 start.go:728] Will try again in 5 seconds ...
	I0307 10:01:44.876201   13088 start.go:360] acquireMachinesLock for ha-917000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:01:44.876392   13088 start.go:364] duration metric: took 144.013µs to acquireMachinesLock for "ha-917000"
	I0307 10:01:44.876437   13088 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:01:44.876444   13088 fix.go:54] fixHost starting: 
	I0307 10:01:44.876907   13088 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:44.876949   13088 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:01:44.885599   13088 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59462
	I0307 10:01:44.885974   13088 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:01:44.886347   13088 main.go:141] libmachine: Using API Version  1
	I0307 10:01:44.886362   13088 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:01:44.886568   13088 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:01:44.886681   13088 main.go:141] libmachine: (ha-917000) Calling .DriverName
	I0307 10:01:44.886782   13088 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:01:44.886865   13088 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:01:44.886880   13088 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:01:44.886891   13088 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:01:44.886909   13088 fix.go:112] recreateIfNeeded on ha-917000: state=Stopped err=<nil>
	I0307 10:01:44.886921   13088 main.go:141] libmachine: (ha-917000) Calling .DriverName
	W0307 10:01:44.886994   13088 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:01:44.907786   13088 out.go:177] * Restarting existing hyperkit VM for "ha-917000" ...
	I0307 10:01:44.950418   13088 main.go:141] libmachine: (ha-917000) Calling .Start
	I0307 10:01:44.950679   13088 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:01:44.950748   13088 main.go:141] libmachine: (ha-917000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.pid
	I0307 10:01:44.950826   13088 main.go:141] libmachine: (ha-917000) DBG | Using UUID b6500542-58a0-4a13-83a2-bfd064822ec1
	I0307 10:01:44.989769   13088 main.go:141] libmachine: (ha-917000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:01:44.989862   13088 fix.go:56] duration metric: took 113.416437ms for fixHost
	I0307 10:01:44.989871   13088 start.go:83] releasing machines lock for "ha-917000", held for 113.466489ms
	W0307 10:01:44.989934   13088 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p ha-917000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p ha-917000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:01:45.032402   13088 out.go:177] 
	W0307 10:01:45.053302   13088 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:01:45.053387   13088 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:01:45.053403   13088 out.go:239] * Related issues:
	* Related issues:
	W0307 10:01:45.053427   13088 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:01:45.053449   13088 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:01:45.075424   13088 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:562: failed to start cluster. args "out/minikube-darwin-amd64 start -p ha-917000 --wait=true -v=7 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (75.125911ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/RestartCluster (5.90s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DegradedAfterClusterRestart (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:390: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:413: expected profile "ha-917000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-917000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-917000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACoun
t\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-917000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.2
8.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000
0000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (74.419057ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DegradedAfterClusterRestart (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/AddSecondaryNode (0.21s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/AddSecondaryNode
ha_test.go:605: (dbg) Run:  out/minikube-darwin-amd64 node add -p ha-917000 --control-plane -v=7 --alsologtostderr
ha_test.go:605: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p ha-917000 --control-plane -v=7 --alsologtostderr: exit status 83 (139.212549ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-917000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-917000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:01:45.519442   13116 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:01:45.519726   13116 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:45.519732   13116 out.go:304] Setting ErrFile to fd 2...
	I0307 10:01:45.519735   13116 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:01:45.519924   13116 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:01:45.520321   13116 mustload.go:65] Loading cluster: ha-917000
	I0307 10:01:45.520586   13116 config.go:182] Loaded profile config "ha-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:01:45.520911   13116 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:01:45.520953   13116 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:01:45.528759   13116 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59473
	I0307 10:01:45.529163   13116 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:01:45.529578   13116 main.go:141] libmachine: Using API Version  1
	I0307 10:01:45.529607   13116 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:01:45.529839   13116 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:01:45.529950   13116 main.go:141] libmachine: (ha-917000) Calling .GetState
	I0307 10:01:45.530039   13116 main.go:141] libmachine: (ha-917000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:01:45.530054   13116 main.go:141] libmachine: (ha-917000) DBG | hyperkit pid from json: 0
	I0307 10:01:45.530067   13116 main.go:141] libmachine: (ha-917000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/ha-917000/hyperkit.json: no such file or directory
	I0307 10:01:45.551662   13116 out.go:177] * The control-plane node ha-917000 host is not running: state=Stopped
	I0307 10:01:45.573454   13116 out.go:177]   To start a cluster, run: "minikube start -p ha-917000"

                                                
                                                
** /stderr **
ha_test.go:607: failed to add control-plane node to current ha (multi-control plane) cluster. args "out/minikube-darwin-amd64 node add -p ha-917000 --control-plane -v=7 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (74.592681ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/AddSecondaryNode (0.21s)

                                                
                                    
x
+
TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.25s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:304: expected profile "ha-917000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-917000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-917000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServe
rPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-917000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4\",\"Containe
rRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\"
:false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
ha_test.go:307: expected profile "ha-917000" in json of 'profile list' to have "HAppy" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-917000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-917000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-917000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4
\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000000
0},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-917000 -n ha-917000: exit status 7 (80.128679ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.25s)

                                                
                                    
x
+
TestImageBuild/serial/Setup (11.39s)

                                                
                                                
=== RUN   TestImageBuild/serial/Setup
image_test.go:69: (dbg) Run:  out/minikube-darwin-amd64 start -p image-301000 --driver=hyperkit 
image_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p image-301000 --driver=hyperkit : exit status 60 (11.317853181s)

                                                
                                                
-- stdout --
	* [image-301000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "image-301000" primary control-plane node in "image-301000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "image-301000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p image-301000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
image_test.go:70: failed to start minikube with args: "out/minikube-darwin-amd64 start -p image-301000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p image-301000 -n image-301000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p image-301000 -n image-301000: exit status 7 (74.405666ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "image-301000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestImageBuild/serial/Setup (11.39s)

                                                
                                    
x
+
TestJSONOutput/start/Command (11.04s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 start -p json-output-110000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit 
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p json-output-110000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit : exit status 60 (11.036328298s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"b816e8f2-40b8-414d-b58b-240cb281f909","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-110000] minikube v1.32.0 on Darwin 14.3.1","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"4fca48b7-f74d-4713-8a2a-31cd1f1929ee","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=18239"}}
	{"specversion":"1.0","id":"1880eb79-a8ba-462b-94d4-dedab7a46932","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig"}}
	{"specversion":"1.0","id":"8bb60811-5f92-4419-8c00-766da8fc0353","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-amd64"}}
	{"specversion":"1.0","id":"a6010ccd-e9ef-4f63-91a6-205c3538bb7c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"ad236c2c-2d7e-481e-a887-b3cf228ee106","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube"}}
	{"specversion":"1.0","id":"64d87809-5580-43dc-a767-97f2f6217e32","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"667f4e98-000b-4ed2-8004-854ef65aefcd","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the hyperkit driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"8661bb2d-2dfe-4894-bfa0-0c8a60935d65","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"json-output-110000\" primary control-plane node in \"json-output-110000\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"69b36cab-9751-4d15-9dc9-2da4f24e46b5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"d5cd93d1-f510-4551-9448-afde505a7e2d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Deleting \"json-output-110000\" in hyperkit ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"f1f4b653-c028-4457-b0da-4c7587113666","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"}}
	{"specversion":"1.0","id":"2e8ca3a1-e6de-4bff-ba69-fb9fb88fcb21","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"4bf96f9a-cf5b-44fc-b5bf-f07d5e959aa1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"Failed to start hyperkit VM. Running \"minikube delete -p json-output-110000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"}}
	{"specversion":"1.0","id":"24abc9f6-4184-4193-8e38-d32635049cde","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.","exitcode":"60","issues":"https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594","message":"Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1","name":"PR_HYPERKIT_VMNET_FRAMEWORK","url":""}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 start -p json-output-110000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit ": exit status 60
--- FAIL: TestJSONOutput/start/Command (11.04s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
json_output_test.go:114: step 9 has already been assigned to another step:
Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
Cannot use for:
Deleting "json-output-110000" in hyperkit ...
[Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: b816e8f2-40b8-414d-b58b-240cb281f909
datacontenttype: application/json
Data,
{
"currentstep": "0",
"message": "[json-output-110000] minikube v1.32.0 on Darwin 14.3.1",
"name": "Initial Minikube Setup",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 4fca48b7-f74d-4713-8a2a-31cd1f1929ee
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_LOCATION=18239"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 1880eb79-a8ba-462b-94d4-dedab7a46932
datacontenttype: application/json
Data,
{
"message": "KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 8bb60811-5f92-4419-8c00-766da8fc0353
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_BIN=out/minikube-darwin-amd64"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: a6010ccd-e9ef-4f63-91a6-205c3538bb7c
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: ad236c2c-2d7e-481e-a887-b3cf228ee106
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 64d87809-5580-43dc-a767-97f2f6217e32
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_FORCE_SYSTEMD="
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 667f4e98-000b-4ed2-8004-854ef65aefcd
datacontenttype: application/json
Data,
{
"currentstep": "1",
"message": "Using the hyperkit driver based on user configuration",
"name": "Selecting Driver",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 8661bb2d-2dfe-4894-bfa0-0c8a60935d65
datacontenttype: application/json
Data,
{
"currentstep": "3",
"message": "Starting \"json-output-110000\" primary control-plane node in \"json-output-110000\" cluster",
"name": "Starting Node",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 69b36cab-9751-4d15-9dc9-2da4f24e46b5
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: d5cd93d1-f510-4551-9448-afde505a7e2d
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Deleting \"json-output-110000\" in hyperkit ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: f1f4b653-c028-4457-b0da-4c7587113666
datacontenttype: application/json
Data,
{
"message": "StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 2e8ca3a1-e6de-4bff-ba69-fb9fb88fcb21
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 4bf96f9a-cf5b-44fc-b5bf-f07d5e959aa1
datacontenttype: application/json
Data,
{
"message": "Failed to start hyperkit VM. Running \"minikube delete -p json-output-110000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 24abc9f6-4184-4193-8e38-d32635049cde
datacontenttype: application/json
Data,
{
"advice": "Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.",
"exitcode": "60",
"issues": "https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594",
"message": "Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1",
"name": "PR_HYPERKIT_VMNET_FRAMEWORK",
"url": ""
}
]
--- FAIL: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
json_output_test.go:144: current step is not in increasing order: [Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: b816e8f2-40b8-414d-b58b-240cb281f909
datacontenttype: application/json
Data,
{
"currentstep": "0",
"message": "[json-output-110000] minikube v1.32.0 on Darwin 14.3.1",
"name": "Initial Minikube Setup",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 4fca48b7-f74d-4713-8a2a-31cd1f1929ee
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_LOCATION=18239"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 1880eb79-a8ba-462b-94d4-dedab7a46932
datacontenttype: application/json
Data,
{
"message": "KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 8bb60811-5f92-4419-8c00-766da8fc0353
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_BIN=out/minikube-darwin-amd64"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: a6010ccd-e9ef-4f63-91a6-205c3538bb7c
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: ad236c2c-2d7e-481e-a887-b3cf228ee106
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 64d87809-5580-43dc-a767-97f2f6217e32
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_FORCE_SYSTEMD="
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 667f4e98-000b-4ed2-8004-854ef65aefcd
datacontenttype: application/json
Data,
{
"currentstep": "1",
"message": "Using the hyperkit driver based on user configuration",
"name": "Selecting Driver",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 8661bb2d-2dfe-4894-bfa0-0c8a60935d65
datacontenttype: application/json
Data,
{
"currentstep": "3",
"message": "Starting \"json-output-110000\" primary control-plane node in \"json-output-110000\" cluster",
"name": "Starting Node",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 69b36cab-9751-4d15-9dc9-2da4f24e46b5
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: d5cd93d1-f510-4551-9448-afde505a7e2d
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Deleting \"json-output-110000\" in hyperkit ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: f1f4b653-c028-4457-b0da-4c7587113666
datacontenttype: application/json
Data,
{
"message": "StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 2e8ca3a1-e6de-4bff-ba69-fb9fb88fcb21
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 4bf96f9a-cf5b-44fc-b5bf-f07d5e959aa1
datacontenttype: application/json
Data,
{
"message": "Failed to start hyperkit VM. Running \"minikube delete -p json-output-110000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 24abc9f6-4184-4193-8e38-d32635049cde
datacontenttype: application/json
Data,
{
"advice": "Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.",
"exitcode": "60",
"issues": "https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594",
"message": "Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1",
"name": "PR_HYPERKIT_VMNET_FRAMEWORK",
"url": ""
}
]
--- FAIL: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.14s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 pause -p json-output-110000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p json-output-110000 --output=json --user=testUser: exit status 83 (138.181287ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"84279d49-eeb6-4e7f-bc8a-5caf31abc9a7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"The control-plane node json-output-110000 host is not running: state=Stopped"}}
	{"specversion":"1.0","id":"e4954e66-7121-4d91-9148-38c3ecca53a7","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"To start a cluster, run: \"minikube start -p json-output-110000\""}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 pause -p json-output-110000 --output=json --user=testUser": exit status 83
--- FAIL: TestJSONOutput/pause/Command (0.14s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.14s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 unpause -p json-output-110000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 unpause -p json-output-110000 --output=json --user=testUser: exit status 83 (138.367748ms)

                                                
                                                
-- stdout --
	* The control-plane node json-output-110000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p json-output-110000"

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 unpause -p json-output-110000 --output=json --user=testUser": exit status 83
json_output_test.go:213: unable to marshal output: * The control-plane node json-output-110000 host is not running: state=Stopped
json_output_test.go:70: converting to cloud events: invalid character '*' looking for beginning of value
--- FAIL: TestJSONOutput/unpause/Command (0.14s)

                                                
                                    
x
+
TestMinikubeProfile (11.95s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-amd64 start -p first-781000 --driver=hyperkit 
minikube_profile_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p first-781000 --driver=hyperkit : exit status 60 (11.096334678s)

                                                
                                                
-- stdout --
	* [first-781000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "first-781000" primary control-plane node in "first-781000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "first-781000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p first-781000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
minikube_profile_test.go:46: test pre-condition failed. args "out/minikube-darwin-amd64 start -p first-781000 --driver=hyperkit ": exit status 60
panic.go:626: *** TestMinikubeProfile FAILED at 2024-03-07 10:02:25.093483 -0800 PST m=+897.947918303
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p second-782000 -n second-782000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p second-782000 -n second-782000: exit status 85 (129.050291ms)

                                                
                                                
-- stdout --
	* Profile "second-782000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p second-782000"

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 85 (may be ok)
helpers_test.go:241: "second-782000" host is not running, skipping log retrieval (state="* Profile \"second-782000\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p second-782000\"")
helpers_test.go:175: Cleaning up "second-782000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p second-782000
panic.go:626: *** TestMinikubeProfile FAILED at 2024-03-07 10:02:25.606963 -0800 PST m=+898.461394993
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p first-781000 -n first-781000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p first-781000 -n first-781000: exit status 7 (74.354592ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "first-781000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "first-781000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p first-781000
--- FAIL: TestMinikubeProfile (11.95s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (11.52s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-amd64 start -p mount-start-1-722000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit 
mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p mount-start-1-722000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit : exit status 60 (11.44146766s)

                                                
                                                
-- stdout --
	* [mount-start-1-722000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting minikube without Kubernetes in cluster mount-start-1-722000
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "mount-start-1-722000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p mount-start-1-722000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-amd64 start -p mount-start-1-722000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p mount-start-1-722000 -n mount-start-1-722000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p mount-start-1-722000 -n mount-start-1-722000: exit status 7 (75.633009ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "mount-start-1-722000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMountStart/serial/StartWithMountFirst (11.52s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (11.66s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-949000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit 
E0307 10:02:44.446714   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
multinode_test.go:96: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-949000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit : exit status 60 (11.587481394s)

                                                
                                                
-- stdout --
	* [multinode-949000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "multinode-949000" primary control-plane node in "multinode-949000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "multinode-949000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:02:38.182776   13315 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:02:38.182954   13315 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:02:38.182959   13315 out.go:304] Setting ErrFile to fd 2...
	I0307 10:02:38.182963   13315 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:02:38.183143   13315 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:02:38.184634   13315 out.go:298] Setting JSON to false
	I0307 10:02:38.207882   13315 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7329,"bootTime":1709827229,"procs":433,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:02:38.207968   13315 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:02:38.229468   13315 out.go:177] * [multinode-949000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:02:38.270454   13315 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:02:38.270531   13315 notify.go:220] Checking for updates...
	I0307 10:02:38.313608   13315 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:02:38.334422   13315 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:02:38.359364   13315 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:02:38.380450   13315 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:02:38.401733   13315 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:02:38.423120   13315 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:02:38.452480   13315 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:02:38.494739   13315 start.go:297] selected driver: hyperkit
	I0307 10:02:38.494766   13315 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:02:38.494802   13315 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:02:38.499291   13315 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:02:38.499423   13315 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:02:38.507157   13315 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:02:38.511088   13315 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:02:38.511108   13315 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 10:02:38.511142   13315 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:02:38.511348   13315 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:02:38.511408   13315 cni.go:84] Creating CNI manager for ""
	I0307 10:02:38.511417   13315 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I0307 10:02:38.511423   13315 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0307 10:02:38.511496   13315 start.go:340] cluster config:
	{Name:multinode-949000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-949000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock:
SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:02:38.511607   13315 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:02:38.553432   13315 out.go:177] * Starting "multinode-949000" primary control-plane node in "multinode-949000" cluster
	I0307 10:02:38.574589   13315 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:02:38.574645   13315 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:02:38.574669   13315 cache.go:56] Caching tarball of preloaded images
	I0307 10:02:38.574801   13315 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:02:38.574814   13315 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:02:38.575215   13315 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/multinode-949000/config.json ...
	I0307 10:02:38.575245   13315 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/multinode-949000/config.json: {Name:mkfef66d38c2a46f127915e0f26d88147463b9de Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:02:38.575775   13315 start.go:360] acquireMachinesLock for multinode-949000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:02:38.575863   13315 start.go:364] duration metric: took 69.959µs to acquireMachinesLock for "multinode-949000"
	I0307 10:02:38.575894   13315 start.go:93] Provisioning new machine with config: &{Name:multinode-949000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-949000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:02:38.575952   13315 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:02:38.597261   13315 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:02:38.597538   13315 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:02:38.597626   13315 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:02:38.606877   13315 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59569
	I0307 10:02:38.607228   13315 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:02:38.607644   13315 main.go:141] libmachine: Using API Version  1
	I0307 10:02:38.607652   13315 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:02:38.607898   13315 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:02:38.608017   13315 main.go:141] libmachine: (multinode-949000) Calling .GetMachineName
	I0307 10:02:38.608108   13315 main.go:141] libmachine: (multinode-949000) Calling .DriverName
	I0307 10:02:38.608215   13315 start.go:159] libmachine.API.Create for "multinode-949000" (driver="hyperkit")
	I0307 10:02:38.608239   13315 client.go:168] LocalClient.Create starting
	I0307 10:02:38.608278   13315 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:02:38.608331   13315 main.go:141] libmachine: Decoding PEM data...
	I0307 10:02:38.608349   13315 main.go:141] libmachine: Parsing certificate...
	I0307 10:02:38.608413   13315 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:02:38.608449   13315 main.go:141] libmachine: Decoding PEM data...
	I0307 10:02:38.608461   13315 main.go:141] libmachine: Parsing certificate...
	I0307 10:02:38.608479   13315 main.go:141] libmachine: Running pre-create checks...
	I0307 10:02:38.608489   13315 main.go:141] libmachine: (multinode-949000) Calling .PreCreateCheck
	I0307 10:02:38.608589   13315 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:02:38.608745   13315 main.go:141] libmachine: (multinode-949000) Calling .GetConfigRaw
	I0307 10:02:38.609205   13315 main.go:141] libmachine: Creating machine...
	I0307 10:02:38.609213   13315 main.go:141] libmachine: (multinode-949000) Calling .Create
	I0307 10:02:38.609296   13315 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:02:38.609409   13315 main.go:141] libmachine: (multinode-949000) DBG | I0307 10:02:38.609284   13323 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:02:38.609496   13315 main.go:141] libmachine: (multinode-949000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:02:38.787289   13315 main.go:141] libmachine: (multinode-949000) DBG | I0307 10:02:38.787190   13323 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/id_rsa...
	I0307 10:02:39.079476   13315 main.go:141] libmachine: (multinode-949000) DBG | I0307 10:02:39.079377   13323 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/multinode-949000.rawdisk...
	I0307 10:02:39.079492   13315 main.go:141] libmachine: (multinode-949000) DBG | Writing magic tar header
	I0307 10:02:39.079502   13315 main.go:141] libmachine: (multinode-949000) DBG | Writing SSH key tar header
	I0307 10:02:39.080295   13315 main.go:141] libmachine: (multinode-949000) DBG | I0307 10:02:39.080206   13323 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000 ...
	I0307 10:02:39.442055   13315 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:02:39.442077   13315 main.go:141] libmachine: (multinode-949000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.pid
	I0307 10:02:39.442091   13315 main.go:141] libmachine: (multinode-949000) DBG | Using UUID 94bc9f84-2bc6-4517-8661-7fad991c8235
	I0307 10:02:39.480273   13315 main.go:141] libmachine: (multinode-949000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:02:39.480366   13315 client.go:171] duration metric: took 872.112479ms to LocalClient.Create
	I0307 10:02:41.480616   13315 start.go:128] duration metric: took 2.904631161s to createHost
	I0307 10:02:41.480635   13315 start.go:83] releasing machines lock for "multinode-949000", held for 2.904743759s
	W0307 10:02:41.480659   13315 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:02:41.481098   13315 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:02:41.481139   13315 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:02:41.489664   13315 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59571
	I0307 10:02:41.490012   13315 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:02:41.490368   13315 main.go:141] libmachine: Using API Version  1
	I0307 10:02:41.490381   13315 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:02:41.490612   13315 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:02:41.490960   13315 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:02:41.490982   13315 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:02:41.499085   13315 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59573
	I0307 10:02:41.499437   13315 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:02:41.499798   13315 main.go:141] libmachine: Using API Version  1
	I0307 10:02:41.499818   13315 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:02:41.500028   13315 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:02:41.500135   13315 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:02:41.500212   13315 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:02:41.500249   13315 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:02:41.500267   13315 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:02:41.500284   13315 main.go:141] libmachine: (multinode-949000) Calling .DriverName
	I0307 10:02:41.542732   13315 out.go:177] * Deleting "multinode-949000" in hyperkit ...
	I0307 10:02:41.565578   13315 main.go:141] libmachine: (multinode-949000) Calling .Remove
	I0307 10:02:41.565779   13315 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:02:41.565793   13315 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:02:41.565805   13315 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:02:41.565934   13315 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	W0307 10:02:41.581785   13315 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:02:41.581807   13315 start.go:728] Will try again in 5 seconds ...
	I0307 10:02:46.583941   13315 start.go:360] acquireMachinesLock for multinode-949000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:02:46.584116   13315 start.go:364] duration metric: took 136.919µs to acquireMachinesLock for "multinode-949000"
	I0307 10:02:46.584144   13315 start.go:93] Provisioning new machine with config: &{Name:multinode-949000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-949000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:02:46.584261   13315 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:02:46.627986   13315 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:02:46.628097   13315 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:02:46.628150   13315 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:02:46.637289   13315 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59575
	I0307 10:02:46.637653   13315 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:02:46.638034   13315 main.go:141] libmachine: Using API Version  1
	I0307 10:02:46.638048   13315 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:02:46.638246   13315 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:02:46.638357   13315 main.go:141] libmachine: (multinode-949000) Calling .GetMachineName
	I0307 10:02:46.638449   13315 main.go:141] libmachine: (multinode-949000) Calling .DriverName
	I0307 10:02:46.638551   13315 start.go:159] libmachine.API.Create for "multinode-949000" (driver="hyperkit")
	I0307 10:02:46.638569   13315 client.go:168] LocalClient.Create starting
	I0307 10:02:46.638599   13315 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:02:46.638648   13315 main.go:141] libmachine: Decoding PEM data...
	I0307 10:02:46.638658   13315 main.go:141] libmachine: Parsing certificate...
	I0307 10:02:46.638698   13315 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:02:46.638733   13315 main.go:141] libmachine: Decoding PEM data...
	I0307 10:02:46.638748   13315 main.go:141] libmachine: Parsing certificate...
	I0307 10:02:46.638760   13315 main.go:141] libmachine: Running pre-create checks...
	I0307 10:02:46.638765   13315 main.go:141] libmachine: (multinode-949000) Calling .PreCreateCheck
	I0307 10:02:46.638852   13315 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:02:46.638897   13315 main.go:141] libmachine: (multinode-949000) Calling .GetConfigRaw
	I0307 10:02:46.639356   13315 main.go:141] libmachine: Creating machine...
	I0307 10:02:46.639364   13315 main.go:141] libmachine: (multinode-949000) Calling .Create
	I0307 10:02:46.639429   13315 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:02:46.639556   13315 main.go:141] libmachine: (multinode-949000) DBG | I0307 10:02:46.639424   13328 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:02:46.639615   13315 main.go:141] libmachine: (multinode-949000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:02:46.816142   13315 main.go:141] libmachine: (multinode-949000) DBG | I0307 10:02:46.816077   13328 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/id_rsa...
	I0307 10:02:47.141042   13315 main.go:141] libmachine: (multinode-949000) DBG | I0307 10:02:47.140970   13328 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/multinode-949000.rawdisk...
	I0307 10:02:47.141059   13315 main.go:141] libmachine: (multinode-949000) DBG | Writing magic tar header
	I0307 10:02:47.141073   13315 main.go:141] libmachine: (multinode-949000) DBG | Writing SSH key tar header
	I0307 10:02:47.142046   13315 main.go:141] libmachine: (multinode-949000) DBG | I0307 10:02:47.141934   13328 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000 ...
	I0307 10:02:47.500820   13315 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:02:47.500841   13315 main.go:141] libmachine: (multinode-949000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.pid
	I0307 10:02:47.500882   13315 main.go:141] libmachine: (multinode-949000) DBG | Using UUID b2991d39-2573-4d18-88c8-c83dcfbd8c5d
	I0307 10:02:47.538161   13315 main.go:141] libmachine: (multinode-949000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:02:47.538239   13315 client.go:171] duration metric: took 899.657371ms to LocalClient.Create
	I0307 10:02:49.538821   13315 start.go:128] duration metric: took 2.954524648s to createHost
	I0307 10:02:49.538848   13315 start.go:83] releasing machines lock for "multinode-949000", held for 2.954698789s
	W0307 10:02:49.538984   13315 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-949000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-949000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:02:49.559912   13315 out.go:177] 
	W0307 10:02:49.581493   13315 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:02:49.581613   13315 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:02:49.581636   13315 out.go:239] * Related issues:
	* Related issues:
	W0307 10:02:49.581673   13315 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:02:49.581706   13315 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:02:49.626425   13315 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:98: failed to start cluster. args "out/minikube-darwin-amd64 start -p multinode-949000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000: exit status 7 (74.214454ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-949000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/FreshStart2Nodes (11.66s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (119.97s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (102.20421ms)

                                                
                                                
** stderr ** 
	error: cluster "multinode-949000" does not exist

                                                
                                                
** /stderr **
multinode_test.go:495: failed to create busybox deployment to multinode cluster
multinode_test.go:498: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- rollout status deployment/busybox: exit status 1 (100.802023ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:500: failed to deploy busybox to multinode cluster
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.447107ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.747512ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.650266ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.715175ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (99.492449ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.85555ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
E0307 10:03:12.144764   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.497169ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.769546ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (107.510661ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.704674ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (106.540459ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:524: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:528: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:528: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (99.820615ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:530: failed get Pod names
multinode_test.go:536: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- exec  -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- exec  -- nslookup kubernetes.io: exit status 1 (100.07472ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:538: Pod  could not resolve 'kubernetes.io': exit status 1
multinode_test.go:546: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- exec  -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- exec  -- nslookup kubernetes.default: exit status 1 (99.838937ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:548: Pod  could not resolve 'kubernetes.default': exit status 1
multinode_test.go:554: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- exec  -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (99.702719ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:556: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000: exit status 7 (75.083557ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-949000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeployApp2Nodes (119.97s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.17s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:564: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-949000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (100.312044ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:566: failed to get Pod names: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000: exit status 7 (73.790419ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-949000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.17s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (0.21s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run:  out/minikube-darwin-amd64 node add -p multinode-949000 -v 3 --alsologtostderr
multinode_test.go:121: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p multinode-949000 -v 3 --alsologtostderr: exit status 83 (136.581791ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-949000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-949000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:04:49.995238   13456 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:04:49.995432   13456 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:49.995437   13456 out.go:304] Setting ErrFile to fd 2...
	I0307 10:04:49.995441   13456 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:49.995653   13456 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:04:49.995988   13456 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:04:49.996250   13456 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:04:49.996593   13456 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:04:49.996633   13456 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:04:50.004376   13456 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59586
	I0307 10:04:50.004758   13456 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:04:50.005170   13456 main.go:141] libmachine: Using API Version  1
	I0307 10:04:50.005202   13456 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:04:50.005383   13456 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:04:50.005478   13456 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:04:50.005560   13456 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:04:50.005592   13456 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:04:50.005601   13456 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:04:50.026624   13456 out.go:177] * The control-plane node multinode-949000 host is not running: state=Stopped
	I0307 10:04:50.047704   13456 out.go:177]   To start a cluster, run: "minikube start -p multinode-949000"

                                                
                                                
** /stderr **
multinode_test.go:123: failed to add node to current cluster. args "out/minikube-darwin-amd64 node add -p multinode-949000 -v 3 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000: exit status 7 (73.288181ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-949000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/AddNode (0.21s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.11s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run:  kubectl --context multinode-949000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
multinode_test.go:221: (dbg) Non-zero exit: kubectl --context multinode-949000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (36.892508ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: multinode-949000

                                                
                                                
** /stderr **
multinode_test.go:223: failed to 'kubectl get nodes' with args "kubectl --context multinode-949000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1
multinode_test.go:230: failed to decode json from label list: args "kubectl --context multinode-949000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000: exit status 7 (73.749032ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-949000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/MultiNodeLabels (0.11s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.22s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
multinode_test.go:166: expected profile "multinode-949000" in json of 'profile list' include 3 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"multinode-949000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"multinode-949000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KV
MNUMACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"multinode-949000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"Kubernetes
Version\":\"v1.28.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseIn
terval\":60000000000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000: exit status 7 (73.558821ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-949000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ProfileList (0.22s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (0.15s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status --output json --alsologtostderr
multinode_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status --output json --alsologtostderr: exit status 7 (73.68583ms)

                                                
                                                
-- stdout --
	{"Name":"multinode-949000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:04:50.537400   13474 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:04:50.537677   13474 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:50.537682   13474 out.go:304] Setting ErrFile to fd 2...
	I0307 10:04:50.537686   13474 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:50.537857   13474 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:04:50.538039   13474 out.go:298] Setting JSON to true
	I0307 10:04:50.538059   13474 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:04:50.538100   13474 notify.go:220] Checking for updates...
	I0307 10:04:50.538319   13474 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:04:50.538336   13474 status.go:255] checking status of multinode-949000 ...
	I0307 10:04:50.538723   13474 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:04:50.538772   13474 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:04:50.546810   13474 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59601
	I0307 10:04:50.547173   13474 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:04:50.547589   13474 main.go:141] libmachine: Using API Version  1
	I0307 10:04:50.547603   13474 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:04:50.547792   13474 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:04:50.547903   13474 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:04:50.547992   13474 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:04:50.548029   13474 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:04:50.548044   13474 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:04:50.548049   13474 status.go:330] multinode-949000 host status = "Stopped" (err=<nil>)
	I0307 10:04:50.548061   13474 status.go:343] host is not running, skipping remaining checks
	I0307 10:04:50.548068   13474 status.go:257] multinode-949000 status: &{Name:multinode-949000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:191: failed to decode json from status: args "out/minikube-darwin-amd64 -p multinode-949000 status --output json --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000: exit status 7 (74.295328ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-949000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/CopyFile (0.15s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (0.38s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 node stop m03
multinode_test.go:248: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 node stop m03: exit status 85 (154.3695ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_295f67d8757edd996fe5c1e7ccde72c355ccf4dc_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:250: node stop returned an error. args "out/minikube-darwin-amd64 -p multinode-949000 node stop m03": exit status 85
multinode_test.go:254: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status: exit status 7 (74.236209ms)

                                                
                                                
-- stdout --
	multinode-949000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:261: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status --alsologtostderr: exit status 7 (73.378933ms)

                                                
                                                
-- stdout --
	multinode-949000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:04:50.913842   13485 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:04:50.914100   13485 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:50.914106   13485 out.go:304] Setting ErrFile to fd 2...
	I0307 10:04:50.914110   13485 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:50.914289   13485 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:04:50.914476   13485 out.go:298] Setting JSON to false
	I0307 10:04:50.914497   13485 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:04:50.914537   13485 notify.go:220] Checking for updates...
	I0307 10:04:50.914781   13485 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:04:50.914798   13485 status.go:255] checking status of multinode-949000 ...
	I0307 10:04:50.915147   13485 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:04:50.915200   13485 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:04:50.924311   13485 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59610
	I0307 10:04:50.924646   13485 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:04:50.925032   13485 main.go:141] libmachine: Using API Version  1
	I0307 10:04:50.925041   13485 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:04:50.925229   13485 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:04:50.925367   13485 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:04:50.925446   13485 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:04:50.925464   13485 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:04:50.925474   13485 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:04:50.925498   13485 status.go:330] multinode-949000 host status = "Stopped" (err=<nil>)
	I0307 10:04:50.925504   13485 status.go:343] host is not running, skipping remaining checks
	I0307 10:04:50.925513   13485 status.go:257] multinode-949000 status: &{Name:multinode-949000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:267: incorrect number of running kubelets: args "out/minikube-darwin-amd64 -p multinode-949000 status --alsologtostderr": multinode-949000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000: exit status 7 (73.589532ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-949000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopNode (0.38s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (47.08s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 node start m03 -v=7 --alsologtostderr
multinode_test.go:282: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 node start m03 -v=7 --alsologtostderr: exit status 85 (153.563947ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:04:51.061980   13491 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:04:51.062642   13491 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:51.062651   13491 out.go:304] Setting ErrFile to fd 2...
	I0307 10:04:51.062657   13491 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:51.063205   13491 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:04:51.063568   13491 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:04:51.063818   13491 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:04:51.084883   13491 out.go:177] 
	W0307 10:04:51.106552   13491 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	W0307 10:04:51.106570   13491 out.go:239] * 
	* 
	W0307 10:04:51.110484   13491 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I0307 10:04:51.131701   13491 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:284: I0307 10:04:51.061980   13491 out.go:291] Setting OutFile to fd 1 ...
I0307 10:04:51.062642   13491 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 10:04:51.062651   13491 out.go:304] Setting ErrFile to fd 2...
I0307 10:04:51.062657   13491 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 10:04:51.063205   13491 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
I0307 10:04:51.063568   13491 mustload.go:65] Loading cluster: multinode-949000
I0307 10:04:51.063818   13491 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 10:04:51.084883   13491 out.go:177] 
W0307 10:04:51.106552   13491 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
W0307 10:04:51.106570   13491 out.go:239] * 
* 
W0307 10:04:51.110484   13491 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I0307 10:04:51.131701   13491 out.go:177] 
multinode_test.go:285: node start returned an error. args "out/minikube-darwin-amd64 -p multinode-949000 node start m03 -v=7 --alsologtostderr": exit status 85
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr: exit status 7 (75.800065ms)

                                                
                                                
-- stdout --
	multinode-949000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:04:51.217188   13493 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:04:51.217470   13493 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:51.217476   13493 out.go:304] Setting ErrFile to fd 2...
	I0307 10:04:51.217480   13493 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:51.217664   13493 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:04:51.217857   13493 out.go:298] Setting JSON to false
	I0307 10:04:51.217882   13493 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:04:51.217923   13493 notify.go:220] Checking for updates...
	I0307 10:04:51.218795   13493 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:04:51.218878   13493 status.go:255] checking status of multinode-949000 ...
	I0307 10:04:51.219569   13493 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:04:51.219615   13493 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:04:51.227822   13493 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59616
	I0307 10:04:51.228133   13493 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:04:51.228540   13493 main.go:141] libmachine: Using API Version  1
	I0307 10:04:51.228550   13493 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:04:51.228789   13493 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:04:51.228910   13493 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:04:51.229001   13493 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:04:51.229024   13493 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:04:51.229036   13493 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:04:51.229076   13493 status.go:330] multinode-949000 host status = "Stopped" (err=<nil>)
	I0307 10:04:51.229088   13493 status.go:343] host is not running, skipping remaining checks
	I0307 10:04:51.229104   13493 status.go:257] multinode-949000 status: &{Name:multinode-949000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr: exit status 7 (74.936951ms)

                                                
                                                
-- stdout --
	multinode-949000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:04:52.487962   13496 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:04:52.488235   13496 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:52.488240   13496 out.go:304] Setting ErrFile to fd 2...
	I0307 10:04:52.488243   13496 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:52.488419   13496 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:04:52.488597   13496 out.go:298] Setting JSON to false
	I0307 10:04:52.488618   13496 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:04:52.489061   13496 notify.go:220] Checking for updates...
	I0307 10:04:52.489872   13496 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:04:52.489896   13496 status.go:255] checking status of multinode-949000 ...
	I0307 10:04:52.490244   13496 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:04:52.490285   13496 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:04:52.498609   13496 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59619
	I0307 10:04:52.499009   13496 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:04:52.499427   13496 main.go:141] libmachine: Using API Version  1
	I0307 10:04:52.499445   13496 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:04:52.499644   13496 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:04:52.499749   13496 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:04:52.499839   13496 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:04:52.499863   13496 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:04:52.499879   13496 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:04:52.499932   13496 status.go:330] multinode-949000 host status = "Stopped" (err=<nil>)
	I0307 10:04:52.499945   13496 status.go:343] host is not running, skipping remaining checks
	I0307 10:04:52.499952   13496 status.go:257] multinode-949000 status: &{Name:multinode-949000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr: exit status 7 (75.641406ms)

                                                
                                                
-- stdout --
	multinode-949000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:04:54.175609   13499 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:04:54.175783   13499 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:54.175789   13499 out.go:304] Setting ErrFile to fd 2...
	I0307 10:04:54.175792   13499 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:54.175962   13499 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:04:54.176142   13499 out.go:298] Setting JSON to false
	I0307 10:04:54.176163   13499 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:04:54.176207   13499 notify.go:220] Checking for updates...
	I0307 10:04:54.176435   13499 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:04:54.176452   13499 status.go:255] checking status of multinode-949000 ...
	I0307 10:04:54.176837   13499 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:04:54.176884   13499 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:04:54.185294   13499 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59622
	I0307 10:04:54.185650   13499 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:04:54.186060   13499 main.go:141] libmachine: Using API Version  1
	I0307 10:04:54.186070   13499 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:04:54.186313   13499 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:04:54.186424   13499 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:04:54.186507   13499 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:04:54.186550   13499 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:04:54.186578   13499 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:04:54.186573   13499 status.go:330] multinode-949000 host status = "Stopped" (err=<nil>)
	I0307 10:04:54.186588   13499 status.go:343] host is not running, skipping remaining checks
	I0307 10:04:54.186603   13499 status.go:257] multinode-949000 status: &{Name:multinode-949000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr: exit status 7 (75.63447ms)

                                                
                                                
-- stdout --
	multinode-949000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:04:56.820672   13502 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:04:56.821409   13502 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:56.821418   13502 out.go:304] Setting ErrFile to fd 2...
	I0307 10:04:56.821425   13502 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:04:56.821976   13502 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:04:56.822175   13502 out.go:298] Setting JSON to false
	I0307 10:04:56.822199   13502 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:04:56.822235   13502 notify.go:220] Checking for updates...
	I0307 10:04:56.822452   13502 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:04:56.822470   13502 status.go:255] checking status of multinode-949000 ...
	I0307 10:04:56.822800   13502 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:04:56.822843   13502 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:04:56.831014   13502 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59624
	I0307 10:04:56.831395   13502 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:04:56.831798   13502 main.go:141] libmachine: Using API Version  1
	I0307 10:04:56.831815   13502 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:04:56.832046   13502 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:04:56.832169   13502 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:04:56.832253   13502 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:04:56.832287   13502 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:04:56.832308   13502 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:04:56.832309   13502 status.go:330] multinode-949000 host status = "Stopped" (err=<nil>)
	I0307 10:04:56.832317   13502 status.go:343] host is not running, skipping remaining checks
	I0307 10:04:56.832324   13502 status.go:257] multinode-949000 status: &{Name:multinode-949000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr: exit status 7 (75.253637ms)

                                                
                                                
-- stdout --
	multinode-949000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:05:00.391799   13506 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:05:00.392076   13506 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:00.392082   13506 out.go:304] Setting ErrFile to fd 2...
	I0307 10:05:00.392086   13506 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:00.392268   13506 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:05:00.392449   13506 out.go:298] Setting JSON to false
	I0307 10:05:00.392470   13506 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:05:00.392510   13506 notify.go:220] Checking for updates...
	I0307 10:05:00.393761   13506 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:05:00.393785   13506 status.go:255] checking status of multinode-949000 ...
	I0307 10:05:00.394131   13506 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:00.394177   13506 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:05:00.402470   13506 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59626
	I0307 10:05:00.402851   13506 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:05:00.403256   13506 main.go:141] libmachine: Using API Version  1
	I0307 10:05:00.403265   13506 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:05:00.403489   13506 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:05:00.403598   13506 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:05:00.403673   13506 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:00.403697   13506 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:05:00.403710   13506 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:05:00.403742   13506 status.go:330] multinode-949000 host status = "Stopped" (err=<nil>)
	I0307 10:05:00.403752   13506 status.go:343] host is not running, skipping remaining checks
	I0307 10:05:00.403759   13506 status.go:257] multinode-949000 status: &{Name:multinode-949000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr: exit status 7 (74.835051ms)

                                                
                                                
-- stdout --
	multinode-949000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:05:04.774059   13515 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:05:04.774323   13515 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:04.774329   13515 out.go:304] Setting ErrFile to fd 2...
	I0307 10:05:04.774332   13515 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:04.774507   13515 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:05:04.774697   13515 out.go:298] Setting JSON to false
	I0307 10:05:04.774718   13515 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:05:04.774766   13515 notify.go:220] Checking for updates...
	I0307 10:05:04.774978   13515 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:05:04.774995   13515 status.go:255] checking status of multinode-949000 ...
	I0307 10:05:04.775339   13515 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:04.775404   13515 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:05:04.783555   13515 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59629
	I0307 10:05:04.783893   13515 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:05:04.784335   13515 main.go:141] libmachine: Using API Version  1
	I0307 10:05:04.784346   13515 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:05:04.784552   13515 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:05:04.784647   13515 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:05:04.784729   13515 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:04.784790   13515 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:05:04.784808   13515 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:05:04.784834   13515 status.go:330] multinode-949000 host status = "Stopped" (err=<nil>)
	I0307 10:05:04.784848   13515 status.go:343] host is not running, skipping remaining checks
	I0307 10:05:04.784854   13515 status.go:257] multinode-949000 status: &{Name:multinode-949000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr: exit status 7 (77.349206ms)

                                                
                                                
-- stdout --
	multinode-949000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:05:11.971147   13524 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:05:11.971425   13524 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:11.971431   13524 out.go:304] Setting ErrFile to fd 2...
	I0307 10:05:11.971435   13524 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:11.971608   13524 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:05:11.971779   13524 out.go:298] Setting JSON to false
	I0307 10:05:11.971802   13524 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:05:11.971843   13524 notify.go:220] Checking for updates...
	I0307 10:05:11.972074   13524 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:05:11.972093   13524 status.go:255] checking status of multinode-949000 ...
	I0307 10:05:11.972464   13524 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:11.972507   13524 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:05:11.980507   13524 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59632
	I0307 10:05:11.980826   13524 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:05:11.981237   13524 main.go:141] libmachine: Using API Version  1
	I0307 10:05:11.981246   13524 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:05:11.981476   13524 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:05:11.981619   13524 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:05:11.981708   13524 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:11.981723   13524 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:05:11.981738   13524 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:05:11.981747   13524 status.go:330] multinode-949000 host status = "Stopped" (err=<nil>)
	I0307 10:05:11.981756   13524 status.go:343] host is not running, skipping remaining checks
	I0307 10:05:11.981764   13524 status.go:257] multinode-949000 status: &{Name:multinode-949000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr: exit status 7 (75.657812ms)

                                                
                                                
-- stdout --
	multinode-949000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:05:26.435394   13535 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:05:26.435662   13535 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:26.435668   13535 out.go:304] Setting ErrFile to fd 2...
	I0307 10:05:26.435672   13535 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:26.435849   13535 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:05:26.436026   13535 out.go:298] Setting JSON to false
	I0307 10:05:26.436048   13535 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:05:26.436084   13535 notify.go:220] Checking for updates...
	I0307 10:05:26.436310   13535 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:05:26.436326   13535 status.go:255] checking status of multinode-949000 ...
	I0307 10:05:26.436737   13535 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:26.436776   13535 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:05:26.444887   13535 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59635
	I0307 10:05:26.445224   13535 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:05:26.445634   13535 main.go:141] libmachine: Using API Version  1
	I0307 10:05:26.445643   13535 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:05:26.445864   13535 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:05:26.446004   13535 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:05:26.446109   13535 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:26.446128   13535 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:05:26.446143   13535 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:05:26.446201   13535 status.go:330] multinode-949000 host status = "Stopped" (err=<nil>)
	I0307 10:05:26.446215   13535 status.go:343] host is not running, skipping remaining checks
	I0307 10:05:26.446221   13535 status.go:257] multinode-949000 status: &{Name:multinode-949000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr: exit status 7 (74.610401ms)

                                                
                                                
-- stdout --
	multinode-949000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:05:38.071505   13549 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:05:38.071707   13549 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:38.071713   13549 out.go:304] Setting ErrFile to fd 2...
	I0307 10:05:38.071717   13549 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:38.071892   13549 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:05:38.072076   13549 out.go:298] Setting JSON to false
	I0307 10:05:38.072097   13549 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:05:38.072138   13549 notify.go:220] Checking for updates...
	I0307 10:05:38.072398   13549 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:05:38.072415   13549 status.go:255] checking status of multinode-949000 ...
	I0307 10:05:38.072788   13549 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:38.072850   13549 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:05:38.081051   13549 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59638
	I0307 10:05:38.081360   13549 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:05:38.081773   13549 main.go:141] libmachine: Using API Version  1
	I0307 10:05:38.081801   13549 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:05:38.082050   13549 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:05:38.082170   13549 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:05:38.082255   13549 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:38.082278   13549 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:05:38.082295   13549 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:05:38.082324   13549 status.go:330] multinode-949000 host status = "Stopped" (err=<nil>)
	I0307 10:05:38.082333   13549 status.go:343] host is not running, skipping remaining checks
	I0307 10:05:38.082339   13549 status.go:257] multinode-949000 status: &{Name:multinode-949000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:294: failed to run minikube status. args "out/minikube-darwin-amd64 -p multinode-949000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000: exit status 7 (73.614029ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-949000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StartAfterStop (47.08s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (9.45s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-949000
multinode_test.go:321: (dbg) Run:  out/minikube-darwin-amd64 stop -p multinode-949000
multinode_test.go:321: (dbg) Done: out/minikube-darwin-amd64 stop -p multinode-949000: (3.426196991s)
multinode_test.go:326: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-949000 --wait=true -v=8 --alsologtostderr
multinode_test.go:326: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-949000 --wait=true -v=8 --alsologtostderr: exit status 60 (5.82350534s)

                                                
                                                
-- stdout --
	* [multinode-949000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "multinode-949000" primary control-plane node in "multinode-949000" cluster
	* Restarting existing hyperkit VM for "multinode-949000" ...
	* Restarting existing hyperkit VM for "multinode-949000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:05:41.709535   13580 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:05:41.709741   13580 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:41.709747   13580 out.go:304] Setting ErrFile to fd 2...
	I0307 10:05:41.709751   13580 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:41.709956   13580 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:05:41.711474   13580 out.go:298] Setting JSON to false
	I0307 10:05:41.733733   13580 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7512,"bootTime":1709827229,"procs":441,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:05:41.733820   13580 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:05:41.756060   13580 out.go:177] * [multinode-949000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:05:41.798843   13580 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:05:41.798873   13580 notify.go:220] Checking for updates...
	I0307 10:05:41.841617   13580 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:05:41.864563   13580 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:05:41.885677   13580 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:05:41.906725   13580 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:05:41.927689   13580 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:05:41.949267   13580 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:05:41.949436   13580 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:05:41.949955   13580 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:41.950017   13580 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:05:41.958813   13580 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59654
	I0307 10:05:41.959171   13580 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:05:41.959594   13580 main.go:141] libmachine: Using API Version  1
	I0307 10:05:41.959606   13580 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:05:41.959853   13580 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:05:41.959975   13580 main.go:141] libmachine: (multinode-949000) Calling .DriverName
	I0307 10:05:41.988701   13580 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 10:05:42.030590   13580 start.go:297] selected driver: hyperkit
	I0307 10:05:42.030619   13580 start.go:901] validating driver "hyperkit" against &{Name:multinode-949000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-949000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:05:42.030826   13580 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:05:42.031016   13580 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:05:42.031234   13580 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:05:42.040481   13580 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:05:42.044357   13580 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:42.044382   13580 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 10:05:42.047100   13580 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:05:42.047171   13580 cni.go:84] Creating CNI manager for ""
	I0307 10:05:42.047180   13580 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0307 10:05:42.047260   13580 start.go:340] cluster config:
	{Name:multinode-949000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-949000 Namespace:default APIServ
erHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disable
Metrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:05:42.047348   13580 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:05:42.089502   13580 out.go:177] * Starting "multinode-949000" primary control-plane node in "multinode-949000" cluster
	I0307 10:05:42.110428   13580 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:05:42.110488   13580 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:05:42.110515   13580 cache.go:56] Caching tarball of preloaded images
	I0307 10:05:42.110689   13580 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:05:42.110706   13580 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:05:42.110836   13580 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/multinode-949000/config.json ...
	I0307 10:05:42.111584   13580 start.go:360] acquireMachinesLock for multinode-949000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:05:42.111684   13580 start.go:364] duration metric: took 77.962µs to acquireMachinesLock for "multinode-949000"
	I0307 10:05:42.111716   13580 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:05:42.111733   13580 fix.go:54] fixHost starting: 
	I0307 10:05:42.112085   13580 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:42.112116   13580 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:05:42.120518   13580 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59656
	I0307 10:05:42.120857   13580 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:05:42.121186   13580 main.go:141] libmachine: Using API Version  1
	I0307 10:05:42.121197   13580 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:05:42.121426   13580 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:05:42.121546   13580 main.go:141] libmachine: (multinode-949000) Calling .DriverName
	I0307 10:05:42.121650   13580 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:05:42.121730   13580 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:42.121750   13580 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:05:42.121758   13580 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:05:42.121804   13580 fix.go:112] recreateIfNeeded on multinode-949000: state=Stopped err=<nil>
	I0307 10:05:42.121829   13580 main.go:141] libmachine: (multinode-949000) Calling .DriverName
	W0307 10:05:42.121902   13580 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:05:42.142655   13580 out.go:177] * Restarting existing hyperkit VM for "multinode-949000" ...
	I0307 10:05:42.184588   13580 main.go:141] libmachine: (multinode-949000) Calling .Start
	I0307 10:05:42.184846   13580 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:42.184876   13580 main.go:141] libmachine: (multinode-949000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.pid
	I0307 10:05:42.184945   13580 main.go:141] libmachine: (multinode-949000) DBG | Using UUID b2991d39-2573-4d18-88c8-c83dcfbd8c5d
	I0307 10:05:42.223610   13580 main.go:141] libmachine: (multinode-949000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:05:42.223721   13580 fix.go:56] duration metric: took 111.989926ms for fixHost
	I0307 10:05:42.223732   13580 start.go:83] releasing machines lock for "multinode-949000", held for 112.035631ms
	W0307 10:05:42.223746   13580 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 10:05:42.223794   13580 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:05:42.223801   13580 start.go:728] Will try again in 5 seconds ...
	I0307 10:05:47.224651   13580 start.go:360] acquireMachinesLock for multinode-949000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:05:47.224813   13580 start.go:364] duration metric: took 107.767µs to acquireMachinesLock for "multinode-949000"
	I0307 10:05:47.224846   13580 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:05:47.224853   13580 fix.go:54] fixHost starting: 
	I0307 10:05:47.225286   13580 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:47.225325   13580 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:05:47.235121   13580 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59658
	I0307 10:05:47.235566   13580 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:05:47.235897   13580 main.go:141] libmachine: Using API Version  1
	I0307 10:05:47.235908   13580 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:05:47.236120   13580 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:05:47.236220   13580 main.go:141] libmachine: (multinode-949000) Calling .DriverName
	I0307 10:05:47.236301   13580 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:05:47.236377   13580 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:47.236399   13580 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:05:47.236411   13580 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:05:47.236445   13580 fix.go:112] recreateIfNeeded on multinode-949000: state=Stopped err=<nil>
	I0307 10:05:47.236454   13580 main.go:141] libmachine: (multinode-949000) Calling .DriverName
	W0307 10:05:47.236527   13580 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:05:47.258234   13580 out.go:177] * Restarting existing hyperkit VM for "multinode-949000" ...
	I0307 10:05:47.300855   13580 main.go:141] libmachine: (multinode-949000) Calling .Start
	I0307 10:05:47.301125   13580 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:47.301211   13580 main.go:141] libmachine: (multinode-949000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.pid
	I0307 10:05:47.301274   13580 main.go:141] libmachine: (multinode-949000) DBG | Using UUID b2991d39-2573-4d18-88c8-c83dcfbd8c5d
	I0307 10:05:47.303281   13580 main.go:141] libmachine: (multinode-949000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:05:47.303381   13580 fix.go:56] duration metric: took 78.525029ms for fixHost
	I0307 10:05:47.303391   13580 start.go:83] releasing machines lock for "multinode-949000", held for 78.564331ms
	W0307 10:05:47.303467   13580 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-949000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-949000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:05:47.345813   13580 out.go:177] 
	W0307 10:05:47.366961   13580 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:05:47.366998   13580 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:05:47.367007   13580 out.go:239] * Related issues:
	* Related issues:
	W0307 10:05:47.367020   13580 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:05:47.367029   13580 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:05:47.387908   13580 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:328: failed to run minikube start. args "out/minikube-darwin-amd64 node list -p multinode-949000" : exit status 60
multinode_test.go:331: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-949000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000: exit status 7 (74.297346ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-949000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartKeepsNodes (9.45s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (0.29s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 node delete m03
multinode_test.go:416: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 node delete m03: exit status 83 (140.843279ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-949000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-949000"

                                                
                                                
-- /stdout --
multinode_test.go:418: node delete returned an error. args "out/minikube-darwin-amd64 -p multinode-949000 node delete m03": exit status 83
multinode_test.go:422: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status --alsologtostderr
multinode_test.go:422: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status --alsologtostderr: exit status 7 (74.768574ms)

                                                
                                                
-- stdout --
	multinode-949000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:05:47.815582   13602 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:05:47.815864   13602 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:47.815870   13602 out.go:304] Setting ErrFile to fd 2...
	I0307 10:05:47.815873   13602 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:47.816061   13602 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:05:47.816256   13602 out.go:298] Setting JSON to false
	I0307 10:05:47.816277   13602 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:05:47.816312   13602 notify.go:220] Checking for updates...
	I0307 10:05:47.816541   13602 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:05:47.816559   13602 status.go:255] checking status of multinode-949000 ...
	I0307 10:05:47.816966   13602 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:47.817011   13602 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:05:47.825006   13602 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59666
	I0307 10:05:47.825342   13602 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:05:47.825744   13602 main.go:141] libmachine: Using API Version  1
	I0307 10:05:47.825754   13602 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:05:47.825990   13602 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:05:47.826101   13602 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:05:47.826187   13602 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:47.826208   13602 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:05:47.826219   13602 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:05:47.826277   13602 status.go:330] multinode-949000 host status = "Stopped" (err=<nil>)
	I0307 10:05:47.826291   13602 status.go:343] host is not running, skipping remaining checks
	I0307 10:05:47.826297   13602 status.go:257] multinode-949000 status: &{Name:multinode-949000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:424: failed to run minikube status. args "out/minikube-darwin-amd64 -p multinode-949000 status --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000: exit status 7 (74.290987ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-949000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeleteNode (0.29s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (3.83s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 stop
multinode_test.go:345: (dbg) Done: out/minikube-darwin-amd64 -p multinode-949000 stop: (3.610968654s)
multinode_test.go:351: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status: exit status 7 (74.313226ms)

                                                
                                                
-- stdout --
	multinode-949000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:358: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-949000 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-949000 status --alsologtostderr: exit status 7 (74.07922ms)

                                                
                                                
-- stdout --
	multinode-949000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:05:51.649803   13631 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:05:51.650069   13631 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:51.650075   13631 out.go:304] Setting ErrFile to fd 2...
	I0307 10:05:51.650079   13631 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:51.650259   13631 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:05:51.650454   13631 out.go:298] Setting JSON to false
	I0307 10:05:51.650476   13631 mustload.go:65] Loading cluster: multinode-949000
	I0307 10:05:51.650514   13631 notify.go:220] Checking for updates...
	I0307 10:05:51.650743   13631 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:05:51.650760   13631 status.go:255] checking status of multinode-949000 ...
	I0307 10:05:51.651108   13631 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:51.651150   13631 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:05:51.659252   13631 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59685
	I0307 10:05:51.659581   13631 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:05:51.659996   13631 main.go:141] libmachine: Using API Version  1
	I0307 10:05:51.660006   13631 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:05:51.660208   13631 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:05:51.660319   13631 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:05:51.660401   13631 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:51.660427   13631 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:05:51.660448   13631 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:05:51.660487   13631 status.go:330] multinode-949000 host status = "Stopped" (err=<nil>)
	I0307 10:05:51.660501   13631 status.go:343] host is not running, skipping remaining checks
	I0307 10:05:51.660508   13631 status.go:257] multinode-949000 status: &{Name:multinode-949000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:364: incorrect number of stopped hosts: args "out/minikube-darwin-amd64 -p multinode-949000 status --alsologtostderr": multinode-949000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
multinode_test.go:368: incorrect number of stopped kubelets: args "out/minikube-darwin-amd64 -p multinode-949000 status --alsologtostderr": multinode-949000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000: exit status 7 (73.432484ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-949000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopMultiNode (3.83s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (5.9s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-949000 --wait=true -v=8 --alsologtostderr --driver=hyperkit 
multinode_test.go:376: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-949000 --wait=true -v=8 --alsologtostderr --driver=hyperkit : exit status 60 (5.825079987s)

                                                
                                                
-- stdout --
	* [multinode-949000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "multinode-949000" primary control-plane node in "multinode-949000" cluster
	* Restarting existing hyperkit VM for "multinode-949000" ...
	* Restarting existing hyperkit VM for "multinode-949000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:05:51.795670   13637 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:05:51.795838   13637 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:51.795843   13637 out.go:304] Setting ErrFile to fd 2...
	I0307 10:05:51.795847   13637 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:05:51.796024   13637 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:05:51.797418   13637 out.go:298] Setting JSON to false
	I0307 10:05:51.820770   13637 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7522,"bootTime":1709827229,"procs":445,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:05:51.820858   13637 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:05:51.842775   13637 out.go:177] * [multinode-949000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:05:51.884305   13637 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:05:51.884332   13637 notify.go:220] Checking for updates...
	I0307 10:05:51.905235   13637 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:05:51.926350   13637 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:05:51.968099   13637 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:05:51.989411   13637 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:05:52.010295   13637 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:05:52.031619   13637 config.go:182] Loaded profile config "multinode-949000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:05:52.032082   13637 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:52.032170   13637 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:05:52.040751   13637 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59691
	I0307 10:05:52.041101   13637 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:05:52.041523   13637 main.go:141] libmachine: Using API Version  1
	I0307 10:05:52.041547   13637 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:05:52.041786   13637 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:05:52.041895   13637 main.go:141] libmachine: (multinode-949000) Calling .DriverName
	I0307 10:05:52.042104   13637 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:05:52.042350   13637 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:52.042375   13637 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:05:52.050136   13637 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59693
	I0307 10:05:52.050525   13637 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:05:52.050890   13637 main.go:141] libmachine: Using API Version  1
	I0307 10:05:52.050905   13637 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:05:52.051134   13637 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:05:52.051253   13637 main.go:141] libmachine: (multinode-949000) Calling .DriverName
	I0307 10:05:52.079361   13637 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 10:05:52.121066   13637 start.go:297] selected driver: hyperkit
	I0307 10:05:52.121086   13637 start.go:901] validating driver "hyperkit" against &{Name:multinode-949000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-949000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:05:52.121242   13637 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:05:52.121401   13637 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:05:52.121520   13637 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:05:52.129915   13637 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:05:52.133742   13637 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:52.133763   13637 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 10:05:52.136425   13637 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:05:52.136497   13637 cni.go:84] Creating CNI manager for ""
	I0307 10:05:52.136506   13637 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0307 10:05:52.136580   13637 start.go:340] cluster config:
	{Name:multinode-949000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-949000 Namespace:default APIServ
erHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disable
Metrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:05:52.136660   13637 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:05:52.178447   13637 out.go:177] * Starting "multinode-949000" primary control-plane node in "multinode-949000" cluster
	I0307 10:05:52.199211   13637 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:05:52.199283   13637 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:05:52.199312   13637 cache.go:56] Caching tarball of preloaded images
	I0307 10:05:52.199477   13637 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:05:52.199495   13637 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:05:52.199632   13637 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/multinode-949000/config.json ...
	I0307 10:05:52.200593   13637 start.go:360] acquireMachinesLock for multinode-949000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:05:52.200696   13637 start.go:364] duration metric: took 75.14µs to acquireMachinesLock for "multinode-949000"
	I0307 10:05:52.200730   13637 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:05:52.200745   13637 fix.go:54] fixHost starting: 
	I0307 10:05:52.201185   13637 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:52.201226   13637 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:05:52.209914   13637 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59695
	I0307 10:05:52.210276   13637 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:05:52.210667   13637 main.go:141] libmachine: Using API Version  1
	I0307 10:05:52.210685   13637 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:05:52.210909   13637 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:05:52.211038   13637 main.go:141] libmachine: (multinode-949000) Calling .DriverName
	I0307 10:05:52.211126   13637 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:05:52.211211   13637 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:52.211239   13637 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:05:52.211255   13637 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:05:52.211276   13637 fix.go:112] recreateIfNeeded on multinode-949000: state=Stopped err=<nil>
	I0307 10:05:52.211295   13637 main.go:141] libmachine: (multinode-949000) Calling .DriverName
	W0307 10:05:52.211374   13637 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:05:52.253294   13637 out.go:177] * Restarting existing hyperkit VM for "multinode-949000" ...
	I0307 10:05:52.274088   13637 main.go:141] libmachine: (multinode-949000) Calling .Start
	I0307 10:05:52.274289   13637 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:52.274317   13637 main.go:141] libmachine: (multinode-949000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.pid
	I0307 10:05:52.274405   13637 main.go:141] libmachine: (multinode-949000) DBG | Using UUID b2991d39-2573-4d18-88c8-c83dcfbd8c5d
	I0307 10:05:52.276010   13637 main.go:141] libmachine: (multinode-949000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:05:52.276135   13637 fix.go:56] duration metric: took 75.387519ms for fixHost
	I0307 10:05:52.276148   13637 start.go:83] releasing machines lock for "multinode-949000", held for 75.439695ms
	W0307 10:05:52.276167   13637 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 10:05:52.276222   13637 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:05:52.276232   13637 start.go:728] Will try again in 5 seconds ...
	I0307 10:05:57.276877   13637 start.go:360] acquireMachinesLock for multinode-949000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:05:57.277072   13637 start.go:364] duration metric: took 136.923µs to acquireMachinesLock for "multinode-949000"
	I0307 10:05:57.277106   13637 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:05:57.277115   13637 fix.go:54] fixHost starting: 
	I0307 10:05:57.277586   13637 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:05:57.277623   13637 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:05:57.286846   13637 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59697
	I0307 10:05:57.287205   13637 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:05:57.287588   13637 main.go:141] libmachine: Using API Version  1
	I0307 10:05:57.287605   13637 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:05:57.287817   13637 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:05:57.287922   13637 main.go:141] libmachine: (multinode-949000) Calling .DriverName
	I0307 10:05:57.288015   13637 main.go:141] libmachine: (multinode-949000) Calling .GetState
	I0307 10:05:57.288104   13637 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:57.288117   13637 main.go:141] libmachine: (multinode-949000) DBG | hyperkit pid from json: 0
	I0307 10:05:57.288144   13637 main.go:141] libmachine: (multinode-949000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.json: no such file or directory
	I0307 10:05:57.288167   13637 fix.go:112] recreateIfNeeded on multinode-949000: state=Stopped err=<nil>
	I0307 10:05:57.288179   13637 main.go:141] libmachine: (multinode-949000) Calling .DriverName
	W0307 10:05:57.288265   13637 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:05:57.330584   13637 out.go:177] * Restarting existing hyperkit VM for "multinode-949000" ...
	I0307 10:05:57.351469   13637 main.go:141] libmachine: (multinode-949000) Calling .Start
	I0307 10:05:57.351735   13637 main.go:141] libmachine: (multinode-949000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:05:57.351815   13637 main.go:141] libmachine: (multinode-949000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/multinode-949000/hyperkit.pid
	I0307 10:05:57.351886   13637 main.go:141] libmachine: (multinode-949000) DBG | Using UUID b2991d39-2573-4d18-88c8-c83dcfbd8c5d
	I0307 10:05:57.392687   13637 main.go:141] libmachine: (multinode-949000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:05:57.392777   13637 fix.go:56] duration metric: took 115.660411ms for fixHost
	I0307 10:05:57.392787   13637 start.go:83] releasing machines lock for "multinode-949000", held for 115.700938ms
	W0307 10:05:57.392853   13637 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-949000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-949000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:05:57.434484   13637 out.go:177] 
	W0307 10:05:57.455639   13637 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:05:57.455706   13637 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:05:57.455738   13637 out.go:239] * Related issues:
	* Related issues:
	W0307 10:05:57.455764   13637 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:05:57.455787   13637 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:05:57.477463   13637 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:378: failed to start cluster. args "out/minikube-darwin-amd64 start -p multinode-949000 --wait=true -v=8 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000: exit status 7 (75.724607ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-949000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartMultiNode (5.90s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (22.96s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-949000
multinode_test.go:464: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-949000-m01 --driver=hyperkit 
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-949000-m01 --driver=hyperkit : exit status 60 (11.130271603s)

                                                
                                                
-- stdout --
	* [multinode-949000-m01] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "multinode-949000-m01" primary control-plane node in "multinode-949000-m01" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "multinode-949000-m01" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-949000-m01" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-949000-m02 --driver=hyperkit 
multinode_test.go:472: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-949000-m02 --driver=hyperkit : exit status 60 (11.290183s)

                                                
                                                
-- stdout --
	* [multinode-949000-m02] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "multinode-949000-m02" primary control-plane node in "multinode-949000-m02" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "multinode-949000-m02" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-949000-m02" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
multinode_test.go:474: failed to start profile. args "out/minikube-darwin-amd64 start -p multinode-949000-m02 --driver=hyperkit " : exit status 60
multinode_test.go:479: (dbg) Run:  out/minikube-darwin-amd64 node add -p multinode-949000
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p multinode-949000: exit status 83 (140.221673ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-949000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-949000"

                                                
                                                
-- /stdout --
multinode_test.go:484: (dbg) Run:  out/minikube-darwin-amd64 delete -p multinode-949000-m02
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-949000 -n multinode-949000: exit status 7 (74.171028ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-949000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ValidateNameConflict (22.96s)

                                                
                                    
x
+
TestPreload (11.52s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-darwin-amd64 start -p test-preload-226000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4
preload_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p test-preload-226000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4: exit status 60 (11.177564788s)

                                                
                                                
-- stdout --
	* [test-preload-226000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "test-preload-226000" primary control-plane node in "test-preload-226000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "test-preload-226000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:06:21.006196   13709 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:06:21.006443   13709 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:06:21.006448   13709 out.go:304] Setting ErrFile to fd 2...
	I0307 10:06:21.006452   13709 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:06:21.006637   13709 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:06:21.007998   13709 out.go:298] Setting JSON to false
	I0307 10:06:21.030421   13709 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7552,"bootTime":1709827229,"procs":437,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:06:21.030520   13709 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:06:21.052921   13709 out.go:177] * [test-preload-226000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:06:21.093888   13709 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:06:21.093875   13709 notify.go:220] Checking for updates...
	I0307 10:06:21.116042   13709 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:06:21.136970   13709 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:06:21.157757   13709 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:06:21.200010   13709 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:06:21.220910   13709 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:06:21.242634   13709 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:06:21.242764   13709 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:06:21.272094   13709 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:06:21.313944   13709 start.go:297] selected driver: hyperkit
	I0307 10:06:21.313970   13709 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:06:21.313994   13709 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:06:21.318145   13709 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:06:21.318257   13709 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:06:21.326041   13709 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:06:21.329949   13709 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:06:21.329971   13709 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 10:06:21.330006   13709 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:06:21.330212   13709 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:06:21.330267   13709 cni.go:84] Creating CNI manager for ""
	I0307 10:06:21.330286   13709 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:06:21.330293   13709 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 10:06:21.330362   13709 start.go:340] cluster config:
	{Name:test-preload-226000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-226000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAu
thSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:06:21.330447   13709 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:06:21.351989   13709 out.go:177] * Starting "test-preload-226000" primary control-plane node in "test-preload-226000" cluster
	I0307 10:06:21.372896   13709 preload.go:132] Checking if preload exists for k8s version v1.24.4 and runtime docker
	I0307 10:06:21.373118   13709 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/test-preload-226000/config.json ...
	I0307 10:06:21.373178   13709 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/test-preload-226000/config.json: {Name:mk9b19fac03240175ae9609e8697af43c66fff14 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:06:21.373203   13709 cache.go:107] acquiring lock: {Name:mk23a88b2566792987733168dde9a45e7d23012e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:06:21.373271   13709 cache.go:107] acquiring lock: {Name:mk5bbd1675de6feeb096bdf4ddedb0e7e1a7d5bf Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:06:21.373304   13709 cache.go:107] acquiring lock: {Name:mk02158cf6dda4a1a38d42db93011e791e062eec Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:06:21.373438   13709 cache.go:107] acquiring lock: {Name:mk50d8b6da41aeb5a46fb9841708ab1be5e132ef Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:06:21.373533   13709 cache.go:107] acquiring lock: {Name:mk9bf1345e0d994a176a676d1b8bca50f5e6a326 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:06:21.373548   13709 cache.go:107] acquiring lock: {Name:mkdd5f7c3366585fbd1b6c837f0a0cf4d6d36603 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:06:21.373664   13709 cache.go:107] acquiring lock: {Name:mk3510a83b0607a7158514eac100ad7657b88903 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:06:21.373711   13709 cache.go:107] acquiring lock: {Name:mkaa158b60e9e3c33fff35d00c8b58b2ece807bd Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:06:21.374165   13709 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0307 10:06:21.374147   13709 start.go:360] acquireMachinesLock for test-preload-226000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:06:21.374162   13709 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.4
	I0307 10:06:21.374161   13709 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.24.4
	I0307 10:06:21.374314   13709 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I0307 10:06:21.374328   13709 start.go:364] duration metric: took 126.175µs to acquireMachinesLock for "test-preload-226000"
	I0307 10:06:21.374391   13709 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.24.4
	I0307 10:06:21.374392   13709 start.go:93] Provisioning new machine with config: &{Name:test-preload-226000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCon
fig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-226000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]
MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:06:21.374532   13709 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I0307 10:06:21.374542   13709 image.go:134] retrieving image: registry.k8s.io/pause:3.7
	I0307 10:06:21.374543   13709 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:06:21.374579   13709 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.24.4
	I0307 10:06:21.396088   13709 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:06:21.396364   13709 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:06:21.396511   13709 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:06:21.405540   13709 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59737
	I0307 10:06:21.405865   13709 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:06:21.406250   13709 main.go:141] libmachine: Using API Version  1
	I0307 10:06:21.406281   13709 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:06:21.406481   13709 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:06:21.406580   13709 main.go:141] libmachine: (test-preload-226000) Calling .GetMachineName
	I0307 10:06:21.406659   13709 main.go:141] libmachine: (test-preload-226000) Calling .DriverName
	I0307 10:06:21.406748   13709 start.go:159] libmachine.API.Create for "test-preload-226000" (driver="hyperkit")
	I0307 10:06:21.406771   13709 client.go:168] LocalClient.Create starting
	I0307 10:06:21.406806   13709 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:06:21.406861   13709 main.go:141] libmachine: Decoding PEM data...
	I0307 10:06:21.406874   13709 main.go:141] libmachine: Parsing certificate...
	I0307 10:06:21.406931   13709 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:06:21.406966   13709 main.go:141] libmachine: Decoding PEM data...
	I0307 10:06:21.406978   13709 main.go:141] libmachine: Parsing certificate...
	I0307 10:06:21.406991   13709 main.go:141] libmachine: Running pre-create checks...
	I0307 10:06:21.407002   13709 main.go:141] libmachine: (test-preload-226000) Calling .PreCreateCheck
	I0307 10:06:21.407096   13709 main.go:141] libmachine: (test-preload-226000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:06:21.407275   13709 main.go:141] libmachine: (test-preload-226000) Calling .GetConfigRaw
	I0307 10:06:21.417453   13709 main.go:141] libmachine: Creating machine...
	I0307 10:06:21.417479   13709 main.go:141] libmachine: (test-preload-226000) Calling .Create
	I0307 10:06:21.417723   13709 main.go:141] libmachine: (test-preload-226000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:06:21.418111   13709 main.go:141] libmachine: (test-preload-226000) DBG | I0307 10:06:21.417749   13717 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:06:21.418222   13709 main.go:141] libmachine: (test-preload-226000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:06:21.421306   13709 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0307 10:06:21.421618   13709 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.4
	I0307 10:06:21.423430   13709 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.4
	I0307 10:06:21.423519   13709 image.go:177] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I0307 10:06:21.424135   13709 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.4
	I0307 10:06:21.423940   13709 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I0307 10:06:21.424357   13709 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.4
	I0307 10:06:21.424397   13709 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I0307 10:06:21.603866   13709 main.go:141] libmachine: (test-preload-226000) DBG | I0307 10:06:21.603628   13717 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/test-preload-226000/id_rsa...
	I0307 10:06:21.673262   13709 main.go:141] libmachine: (test-preload-226000) DBG | I0307 10:06:21.673209   13717 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/test-preload-226000/test-preload-226000.rawdisk...
	I0307 10:06:21.673292   13709 main.go:141] libmachine: (test-preload-226000) DBG | Writing magic tar header
	I0307 10:06:21.673303   13709 main.go:141] libmachine: (test-preload-226000) DBG | Writing SSH key tar header
	I0307 10:06:21.673851   13709 main.go:141] libmachine: (test-preload-226000) DBG | I0307 10:06:21.673777   13717 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/test-preload-226000 ...
	I0307 10:06:21.914114   13709 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7
	I0307 10:06:21.918999   13709 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4
	I0307 10:06:21.942102   13709 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4
	I0307 10:06:21.943668   13709 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4
	I0307 10:06:21.947602   13709 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6
	I0307 10:06:22.016317   13709 cache.go:157] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7 exists
	I0307 10:06:22.016343   13709 cache.go:96] cache image "registry.k8s.io/pause:3.7" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7" took 642.74464ms
	I0307 10:06:22.016353   13709 cache.go:80] save to tar file registry.k8s.io/pause:3.7 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7 succeeded
	I0307 10:06:22.036733   13709 main.go:141] libmachine: (test-preload-226000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:06:22.036760   13709 main.go:141] libmachine: (test-preload-226000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/test-preload-226000/hyperkit.pid
	I0307 10:06:22.036804   13709 main.go:141] libmachine: (test-preload-226000) DBG | Using UUID ee56f3d5-222e-43ca-9b5f-005bebdcd757
	I0307 10:06:22.061109   13709 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4
	I0307 10:06:22.074264   13709 main.go:141] libmachine: (test-preload-226000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:06:22.074358   13709 client.go:171] duration metric: took 667.56621ms to LocalClient.Create
	I0307 10:06:22.080574   13709 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.3-0
	I0307 10:06:22.082261   13709 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5
	I0307 10:06:22.348191   13709 cache.go:157] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0307 10:06:22.348212   13709 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 975.011189ms
	I0307 10:06:22.348220   13709 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0307 10:06:23.659213   13709 cache.go:157] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6 exists
	I0307 10:06:23.659229   13709 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.8.6" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6" took 2.285631086s
	I0307 10:06:23.659237   13709 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.8.6 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6 succeeded
	I0307 10:06:23.978617   13709 cache.go:157] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4 exists
	I0307 10:06:23.978635   13709 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.24.4" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4" took 2.605164226s
	I0307 10:06:23.978644   13709 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.24.4 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4 succeeded
	I0307 10:06:24.074505   13709 start.go:128] duration metric: took 2.699894597s to createHost
	I0307 10:06:24.074519   13709 start.go:83] releasing machines lock for "test-preload-226000", held for 2.700136155s
	W0307 10:06:24.074539   13709 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:06:24.074831   13709 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:06:24.074859   13709 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:06:24.083000   13709 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59751
	I0307 10:06:24.083325   13709 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:06:24.083636   13709 main.go:141] libmachine: Using API Version  1
	I0307 10:06:24.083647   13709 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:06:24.083860   13709 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:06:24.084246   13709 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:06:24.084274   13709 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:06:24.092577   13709 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59753
	I0307 10:06:24.092908   13709 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:06:24.093281   13709 main.go:141] libmachine: Using API Version  1
	I0307 10:06:24.093297   13709 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:06:24.093481   13709 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:06:24.093576   13709 main.go:141] libmachine: (test-preload-226000) Calling .GetState
	I0307 10:06:24.093656   13709 main.go:141] libmachine: (test-preload-226000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:06:24.093710   13709 main.go:141] libmachine: (test-preload-226000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/test-preload-226000/hyperkit.json: no such file or directory
	I0307 10:06:24.093738   13709 main.go:141] libmachine: (test-preload-226000) DBG | hyperkit pid from json: 0
	I0307 10:06:24.093756   13709 main.go:141] libmachine: (test-preload-226000) Calling .DriverName
	I0307 10:06:24.142935   13709 out.go:177] * Deleting "test-preload-226000" in hyperkit ...
	I0307 10:06:24.165013   13709 main.go:141] libmachine: (test-preload-226000) Calling .Remove
	I0307 10:06:24.165176   13709 main.go:141] libmachine: (test-preload-226000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:06:24.165193   13709 main.go:141] libmachine: (test-preload-226000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:06:24.165219   13709 main.go:141] libmachine: (test-preload-226000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/test-preload-226000/hyperkit.json: no such file or directory
	I0307 10:06:24.165231   13709 main.go:141] libmachine: (test-preload-226000) DBG | hyperkit pid from json: 0
	W0307 10:06:24.181907   13709 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:06:24.181923   13709 start.go:728] Will try again in 5 seconds ...
	I0307 10:06:25.363573   13709 cache.go:157] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4 exists
	I0307 10:06:25.363594   13709 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.24.4" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4" took 3.990260954s
	I0307 10:06:25.363613   13709 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.24.4 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4 succeeded
	I0307 10:06:27.238085   13709 cache.go:157] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4 exists
	I0307 10:06:27.238102   13709 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.24.4" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4" took 5.86465851s
	I0307 10:06:27.238110   13709 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.24.4 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4 succeeded
	I0307 10:06:27.715298   13709 cache.go:157] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4 exists
	I0307 10:06:27.715317   13709 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.24.4" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4" took 6.34197654s
	I0307 10:06:27.715326   13709 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.24.4 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4 succeeded
	I0307 10:06:29.182378   13709 start.go:360] acquireMachinesLock for test-preload-226000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:06:29.182461   13709 start.go:364] duration metric: took 65.605µs to acquireMachinesLock for "test-preload-226000"
	I0307 10:06:29.182477   13709 start.go:93] Provisioning new machine with config: &{Name:test-preload-226000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCon
fig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-226000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]
MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:06:29.182542   13709 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:06:29.209978   13709 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:06:29.210112   13709 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 10:06:29.210174   13709 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:06:29.219353   13709 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59755
	I0307 10:06:29.219685   13709 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:06:29.220044   13709 main.go:141] libmachine: Using API Version  1
	I0307 10:06:29.220058   13709 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:06:29.220308   13709 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:06:29.220423   13709 main.go:141] libmachine: (test-preload-226000) Calling .GetMachineName
	I0307 10:06:29.220505   13709 main.go:141] libmachine: (test-preload-226000) Calling .DriverName
	I0307 10:06:29.220609   13709 start.go:159] libmachine.API.Create for "test-preload-226000" (driver="hyperkit")
	I0307 10:06:29.220627   13709 client.go:168] LocalClient.Create starting
	I0307 10:06:29.220657   13709 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:06:29.220710   13709 main.go:141] libmachine: Decoding PEM data...
	I0307 10:06:29.220722   13709 main.go:141] libmachine: Parsing certificate...
	I0307 10:06:29.220769   13709 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:06:29.220805   13709 main.go:141] libmachine: Decoding PEM data...
	I0307 10:06:29.220821   13709 main.go:141] libmachine: Parsing certificate...
	I0307 10:06:29.220833   13709 main.go:141] libmachine: Running pre-create checks...
	I0307 10:06:29.220838   13709 main.go:141] libmachine: (test-preload-226000) Calling .PreCreateCheck
	I0307 10:06:29.220922   13709 main.go:141] libmachine: (test-preload-226000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:06:29.220943   13709 main.go:141] libmachine: (test-preload-226000) Calling .GetConfigRaw
	I0307 10:06:29.221369   13709 main.go:141] libmachine: Creating machine...
	I0307 10:06:29.221378   13709 main.go:141] libmachine: (test-preload-226000) Calling .Create
	I0307 10:06:29.221445   13709 main.go:141] libmachine: (test-preload-226000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:06:29.221565   13709 main.go:141] libmachine: (test-preload-226000) DBG | I0307 10:06:29.221441   13757 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:06:29.221647   13709 main.go:141] libmachine: (test-preload-226000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:06:29.400445   13709 main.go:141] libmachine: (test-preload-226000) DBG | I0307 10:06:29.400383   13757 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/test-preload-226000/id_rsa...
	I0307 10:06:29.540348   13709 main.go:141] libmachine: (test-preload-226000) DBG | I0307 10:06:29.540307   13757 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/test-preload-226000/test-preload-226000.rawdisk...
	I0307 10:06:29.540368   13709 main.go:141] libmachine: (test-preload-226000) DBG | Writing magic tar header
	I0307 10:06:29.540382   13709 main.go:141] libmachine: (test-preload-226000) DBG | Writing SSH key tar header
	I0307 10:06:29.540703   13709 main.go:141] libmachine: (test-preload-226000) DBG | I0307 10:06:29.540680   13757 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/test-preload-226000 ...
	I0307 10:06:29.901334   13709 main.go:141] libmachine: (test-preload-226000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 10:06:29.901355   13709 main.go:141] libmachine: (test-preload-226000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/test-preload-226000/hyperkit.pid
	I0307 10:06:29.901365   13709 main.go:141] libmachine: (test-preload-226000) DBG | Using UUID 63ac2610-e024-4117-ae53-37ccf3c780e6
	I0307 10:06:29.939039   13709 main.go:141] libmachine: (test-preload-226000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:06:29.939120   13709 client.go:171] duration metric: took 718.474961ms to LocalClient.Create
	I0307 10:06:31.939245   13709 start.go:128] duration metric: took 2.756642243s to createHost
	I0307 10:06:31.939261   13709 start.go:83] releasing machines lock for "test-preload-226000", held for 2.756748488s
	W0307 10:06:31.939359   13709 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p test-preload-226000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p test-preload-226000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:06:31.981417   13709 out.go:177] 
	W0307 10:06:32.002400   13709 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:06:32.002489   13709 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:06:32.002521   13709 out.go:239] * Related issues:
	* Related issues:
	W0307 10:06:32.002563   13709 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:06:32.002594   13709 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:06:32.044397   13709 out.go:177] 

                                                
                                                
** /stderr **
preload_test.go:46: out/minikube-darwin-amd64 start -p test-preload-226000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4 failed: exit status 60
panic.go:626: *** TestPreload FAILED at 2024-03-07 10:06:32.125108 -0800 PST m=+1144.903501571
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p test-preload-226000 -n test-preload-226000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p test-preload-226000 -n test-preload-226000: exit status 7 (74.13266ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "test-preload-226000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "test-preload-226000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p test-preload-226000
--- FAIL: TestPreload (11.52s)

                                                
                                    
x
+
TestScheduledStopUnix (11.53s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-darwin-amd64 start -p scheduled-stop-631000 --memory=2048 --driver=hyperkit 
scheduled_stop_test.go:128: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p scheduled-stop-631000 --memory=2048 --driver=hyperkit : exit status 60 (11.184686316s)

                                                
                                                
-- stdout --
	* [scheduled-stop-631000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "scheduled-stop-631000" primary control-plane node in "scheduled-stop-631000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "scheduled-stop-631000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p scheduled-stop-631000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
scheduled_stop_test.go:130: starting minikube: exit status 60

                                                
                                                
-- stdout --
	* [scheduled-stop-631000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "scheduled-stop-631000" primary control-plane node in "scheduled-stop-631000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "scheduled-stop-631000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p scheduled-stop-631000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
panic.go:626: *** TestScheduledStopUnix FAILED at 2024-03-07 10:06:43.649792 -0800 PST m=+1156.428005377
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p scheduled-stop-631000 -n scheduled-stop-631000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p scheduled-stop-631000 -n scheduled-stop-631000: exit status 7 (75.028409ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "scheduled-stop-631000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "scheduled-stop-631000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p scheduled-stop-631000
--- FAIL: TestScheduledStopUnix (11.53s)

                                                
                                    
x
+
TestSkaffold (14s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:59: (dbg) Run:  /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/skaffold.exe2436543116 version
skaffold_test.go:63: skaffold version: v2.10.0
skaffold_test.go:66: (dbg) Run:  out/minikube-darwin-amd64 start -p skaffold-276000 --memory=2600 --driver=hyperkit 
skaffold_test.go:66: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p skaffold-276000 --memory=2600 --driver=hyperkit : exit status 60 (11.171778494s)

                                                
                                                
-- stdout --
	* [skaffold-276000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "skaffold-276000" primary control-plane node in "skaffold-276000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	* Deleting "skaffold-276000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p skaffold-276000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
skaffold_test.go:68: starting minikube: exit status 60

                                                
                                                
-- stdout --
	* [skaffold-276000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "skaffold-276000" primary control-plane node in "skaffold-276000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	* Deleting "skaffold-276000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p skaffold-276000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
panic.go:626: *** TestSkaffold FAILED at 2024-03-07 10:06:57.650215 -0800 PST m=+1170.428210737
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p skaffold-276000 -n skaffold-276000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p skaffold-276000 -n skaffold-276000: exit status 7 (74.134821ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "skaffold-276000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "skaffold-276000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p skaffold-276000
--- FAIL: TestSkaffold (14.00s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (45.1s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.3883137588 start -p running-upgrade-566000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:120: (dbg) Non-zero exit: /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.3883137588 start -p running-upgrade-566000 --memory=2200 --vm-driver=hyperkit : exit status 60 (28.195750802s)

                                                
                                                
-- stdout --
	* [running-upgrade-566000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* minikube 1.32.0 is available! Download it: https://github.com/kubernetes/minikube/releases/tag/v1.32.0
	* To disable this notice, run: 'minikube config set WantUpdateNotification false'
	
	  - KUBECONFIG=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/legacy_kubeconfig4231327834
	* Using the hyperkit driver based on user configuration
	* Downloading VM boot image ...
	* Starting control plane node running-upgrade-566000 in cluster running-upgrade-566000
	* Downloading Kubernetes v1.24.1 preload ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "running-upgrade-566000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p running-upgrade-566000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:120: (dbg) Run:  /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.3883137588 start -p running-upgrade-566000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:120: (dbg) Non-zero exit: /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.3883137588 start -p running-upgrade-566000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.809032385s)

                                                
                                                
-- stdout --
	* [running-upgrade-566000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/legacy_kubeconfig2619507578
	* Using the hyperkit driver based on existing profile
	* Starting control plane node running-upgrade-566000 in cluster running-upgrade-566000
	* Restarting existing hyperkit VM for "running-upgrade-566000" ...
	* Restarting existing hyperkit VM for "running-upgrade-566000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p running-upgrade-566000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:120: (dbg) Run:  /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.3883137588 start -p running-upgrade-566000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:120: (dbg) Non-zero exit: /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.3883137588 start -p running-upgrade-566000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.785015095s)

                                                
                                                
-- stdout --
	* [running-upgrade-566000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/legacy_kubeconfig3090589646
	* Using the hyperkit driver based on existing profile
	* Starting control plane node running-upgrade-566000 in cluster running-upgrade-566000
	* Restarting existing hyperkit VM for "running-upgrade-566000" ...
	* Restarting existing hyperkit VM for "running-upgrade-566000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p running-upgrade-566000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:126: legacy v1.26.0 start failed: exit status 60
panic.go:626: *** TestRunningBinaryUpgrade FAILED at 2024-03-07 10:08:41.115022 -0800 PST m=+1273.891409416
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p running-upgrade-566000 -n running-upgrade-566000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p running-upgrade-566000 -n running-upgrade-566000: exit status 7 (74.169959ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "running-upgrade-566000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "running-upgrade-566000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p running-upgrade-566000
--- FAIL: TestRunningBinaryUpgrade (45.10s)

                                                
                                    
x
+
TestKubernetesUpgrade (21.18s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-darwin-amd64 start -p kubernetes-upgrade-667000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=hyperkit 
version_upgrade_test.go:222: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubernetes-upgrade-667000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=hyperkit : exit status 60 (11.313915183s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-667000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "kubernetes-upgrade-667000" primary control-plane node in "kubernetes-upgrade-667000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "kubernetes-upgrade-667000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:08:41.518109   14224 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:08:41.518276   14224 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:08:41.518281   14224 out.go:304] Setting ErrFile to fd 2...
	I0307 10:08:41.518285   14224 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:08:41.518460   14224 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:08:41.519826   14224 out.go:298] Setting JSON to false
	I0307 10:08:41.542144   14224 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7692,"bootTime":1709827229,"procs":436,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:08:41.542262   14224 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:08:41.564008   14224 out.go:177] * [kubernetes-upgrade-667000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:08:41.627548   14224 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:08:41.605849   14224 notify.go:220] Checking for updates...
	I0307 10:08:41.669707   14224 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:08:41.690476   14224 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:08:41.711697   14224 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:08:41.732794   14224 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:08:41.753576   14224 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:08:41.775588   14224 config.go:182] Loaded profile config "cert-expiration-787000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:08:41.775804   14224 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:08:41.775970   14224 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:08:41.805662   14224 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:08:41.847715   14224 start.go:297] selected driver: hyperkit
	I0307 10:08:41.847735   14224 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:08:41.847749   14224 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:08:41.851674   14224 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:08:41.851773   14224 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:08:41.859613   14224 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:08:41.863479   14224 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:08:41.863500   14224 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:08:41.863534   14224 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:08:41.863728   14224 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0307 10:08:41.863784   14224 cni.go:84] Creating CNI manager for ""
	I0307 10:08:41.863800   14224 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0307 10:08:41.863868   14224 start.go:340] cluster config:
	{Name:kubernetes-upgrade-667000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-667000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:08:41.863951   14224 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:08:41.884802   14224 out.go:177] * Starting "kubernetes-upgrade-667000" primary control-plane node in "kubernetes-upgrade-667000" cluster
	I0307 10:08:41.926781   14224 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0307 10:08:41.926854   14224 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0307 10:08:41.926888   14224 cache.go:56] Caching tarball of preloaded images
	I0307 10:08:41.927082   14224 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:08:41.927101   14224 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0307 10:08:41.927246   14224 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/kubernetes-upgrade-667000/config.json ...
	I0307 10:08:41.927283   14224 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/kubernetes-upgrade-667000/config.json: {Name:mk22f5274b6b5013a52f497213c057732af80b0f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:08:41.928055   14224 start.go:360] acquireMachinesLock for kubernetes-upgrade-667000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:08:41.928188   14224 start.go:364] duration metric: took 101.443µs to acquireMachinesLock for "kubernetes-upgrade-667000"
	I0307 10:08:41.928234   14224 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-667000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-667000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt
imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:08:41.928324   14224 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:08:41.949726   14224 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:08:41.950004   14224 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:08:41.950079   14224 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:08:41.959191   14224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59992
	I0307 10:08:41.959550   14224 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:08:41.959994   14224 main.go:141] libmachine: Using API Version  1
	I0307 10:08:41.960011   14224 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:08:41.960265   14224 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:08:41.960389   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .GetMachineName
	I0307 10:08:41.960481   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .DriverName
	I0307 10:08:41.960572   14224 start.go:159] libmachine.API.Create for "kubernetes-upgrade-667000" (driver="hyperkit")
	I0307 10:08:41.960598   14224 client.go:168] LocalClient.Create starting
	I0307 10:08:41.960629   14224 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:08:41.960681   14224 main.go:141] libmachine: Decoding PEM data...
	I0307 10:08:41.960697   14224 main.go:141] libmachine: Parsing certificate...
	I0307 10:08:41.960753   14224 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:08:41.960801   14224 main.go:141] libmachine: Decoding PEM data...
	I0307 10:08:41.960813   14224 main.go:141] libmachine: Parsing certificate...
	I0307 10:08:41.960827   14224 main.go:141] libmachine: Running pre-create checks...
	I0307 10:08:41.960837   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .PreCreateCheck
	I0307 10:08:41.960972   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:08:41.961186   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .GetConfigRaw
	I0307 10:08:41.970657   14224 main.go:141] libmachine: Creating machine...
	I0307 10:08:41.970666   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .Create
	I0307 10:08:41.970755   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:08:41.970868   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | I0307 10:08:41.970740   14232 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:08:41.970939   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:08:42.146390   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | I0307 10:08:42.146282   14232 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubernetes-upgrade-667000/id_rsa...
	I0307 10:08:42.282220   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | I0307 10:08:42.282129   14232 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubernetes-upgrade-667000/kubernetes-upgrade-667000.rawdisk...
	I0307 10:08:42.282233   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | Writing magic tar header
	I0307 10:08:42.282243   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | Writing SSH key tar header
	I0307 10:08:42.283039   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | I0307 10:08:42.282944   14232 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubernetes-upgrade-667000 ...
	I0307 10:08:42.643313   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:08:42.643337   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubernetes-upgrade-667000/hyperkit.pid
	I0307 10:08:42.643351   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | Using UUID 1fbf2108-3ceb-4049-ba0f-74b326983f09
	I0307 10:08:42.679076   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:08:42.679166   14224 client.go:171] duration metric: took 718.548019ms to LocalClient.Create
	I0307 10:08:44.679432   14224 start.go:128] duration metric: took 2.751048888s to createHost
	I0307 10:08:44.679461   14224 start.go:83] releasing machines lock for "kubernetes-upgrade-667000", held for 2.7512115s
	W0307 10:08:44.679501   14224 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:08:44.679862   14224 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:08:44.679901   14224 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:08:44.688643   14224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59994
	I0307 10:08:44.689100   14224 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:08:44.689426   14224 main.go:141] libmachine: Using API Version  1
	I0307 10:08:44.689436   14224 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:08:44.689683   14224 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:08:44.690071   14224 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:08:44.690094   14224 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:08:44.697983   14224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59996
	I0307 10:08:44.698309   14224 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:08:44.698642   14224 main.go:141] libmachine: Using API Version  1
	I0307 10:08:44.698656   14224 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:08:44.698869   14224 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:08:44.698973   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .GetState
	I0307 10:08:44.699051   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:08:44.699082   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | hyperkit pid from json: 0
	I0307 10:08:44.699098   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubernetes-upgrade-667000/hyperkit.json: no such file or directory
	I0307 10:08:44.699126   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .DriverName
	I0307 10:08:44.735754   14224 out.go:177] * Deleting "kubernetes-upgrade-667000" in hyperkit ...
	I0307 10:08:44.755326   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .Remove
	I0307 10:08:44.755566   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:08:44.755579   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:08:44.755602   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubernetes-upgrade-667000/hyperkit.json: no such file or directory
	I0307 10:08:44.755609   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | hyperkit pid from json: 0
	W0307 10:08:44.772423   14224 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:08:44.772436   14224 start.go:728] Will try again in 5 seconds ...
	I0307 10:08:49.772654   14224 start.go:360] acquireMachinesLock for kubernetes-upgrade-667000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:08:49.772891   14224 start.go:364] duration metric: took 185.919µs to acquireMachinesLock for "kubernetes-upgrade-667000"
	I0307 10:08:49.772928   14224 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-667000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-667000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt
imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:08:49.773064   14224 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:08:49.796425   14224 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:08:49.796626   14224 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:08:49.796676   14224 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:08:49.806455   14224 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59998
	I0307 10:08:49.806839   14224 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:08:49.807216   14224 main.go:141] libmachine: Using API Version  1
	I0307 10:08:49.807228   14224 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:08:49.807442   14224 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:08:49.807563   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .GetMachineName
	I0307 10:08:49.807658   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .DriverName
	I0307 10:08:49.807802   14224 start.go:159] libmachine.API.Create for "kubernetes-upgrade-667000" (driver="hyperkit")
	I0307 10:08:49.807817   14224 client.go:168] LocalClient.Create starting
	I0307 10:08:49.807843   14224 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:08:49.807899   14224 main.go:141] libmachine: Decoding PEM data...
	I0307 10:08:49.807910   14224 main.go:141] libmachine: Parsing certificate...
	I0307 10:08:49.807946   14224 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:08:49.807989   14224 main.go:141] libmachine: Decoding PEM data...
	I0307 10:08:49.807999   14224 main.go:141] libmachine: Parsing certificate...
	I0307 10:08:49.808016   14224 main.go:141] libmachine: Running pre-create checks...
	I0307 10:08:49.808021   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .PreCreateCheck
	I0307 10:08:49.808131   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:08:49.808156   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .GetConfigRaw
	I0307 10:08:49.808612   14224 main.go:141] libmachine: Creating machine...
	I0307 10:08:49.808621   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .Create
	I0307 10:08:49.808705   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:08:49.808815   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | I0307 10:08:49.808690   14236 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:08:49.808886   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:08:49.988648   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | I0307 10:08:49.988540   14236 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubernetes-upgrade-667000/id_rsa...
	I0307 10:08:50.220256   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | I0307 10:08:50.220172   14236 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubernetes-upgrade-667000/kubernetes-upgrade-667000.rawdisk...
	I0307 10:08:50.220281   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | Writing magic tar header
	I0307 10:08:50.220294   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | Writing SSH key tar header
	I0307 10:08:50.220714   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | I0307 10:08:50.220652   14236 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubernetes-upgrade-667000 ...
	I0307 10:08:50.579792   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:08:50.579813   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubernetes-upgrade-667000/hyperkit.pid
	I0307 10:08:50.579824   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | Using UUID 376ad22b-7d25-41c5-adc8-3924ae9f02a0
	I0307 10:08:50.616724   14224 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:08:50.616812   14224 client.go:171] duration metric: took 808.975114ms to LocalClient.Create
	I0307 10:08:52.619006   14224 start.go:128] duration metric: took 2.845875701s to createHost
	I0307 10:08:52.619035   14224 start.go:83] releasing machines lock for "kubernetes-upgrade-667000", held for 2.846085494s
	W0307 10:08:52.619175   14224 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-667000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-667000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:08:52.639648   14224 out.go:177] 
	W0307 10:08:52.662640   14224 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:08:52.662687   14224 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:08:52.662700   14224 out.go:239] * Related issues:
	* Related issues:
	W0307 10:08:52.662714   14224 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:08:52.662753   14224 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:08:52.685823   14224 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:224: failed to start minikube HEAD with oldest k8s version: out/minikube-darwin-amd64 start -p kubernetes-upgrade-667000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=hyperkit : exit status 60
version_upgrade_test.go:227: (dbg) Run:  out/minikube-darwin-amd64 stop -p kubernetes-upgrade-667000
version_upgrade_test.go:227: (dbg) Done: out/minikube-darwin-amd64 stop -p kubernetes-upgrade-667000: (3.576460729s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-darwin-amd64 -p kubernetes-upgrade-667000 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p kubernetes-upgrade-667000 status --format={{.Host}}: exit status 7 (73.939729ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 start -p kubernetes-upgrade-667000 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=hyperkit 
version_upgrade_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubernetes-upgrade-667000 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=hyperkit : exit status 60 (5.827190957s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-667000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "kubernetes-upgrade-667000" primary control-plane node in "kubernetes-upgrade-667000" cluster
	* Restarting existing hyperkit VM for "kubernetes-upgrade-667000" ...
	* Restarting existing hyperkit VM for "kubernetes-upgrade-667000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:08:56.485125   14270 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:08:56.485389   14270 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:08:56.485394   14270 out.go:304] Setting ErrFile to fd 2...
	I0307 10:08:56.485398   14270 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:08:56.485556   14270 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:08:56.486944   14270 out.go:298] Setting JSON to false
	I0307 10:08:56.509371   14270 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7707,"bootTime":1709827229,"procs":439,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:08:56.509493   14270 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:08:56.531094   14270 out.go:177] * [kubernetes-upgrade-667000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:08:56.573069   14270 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:08:56.573101   14270 notify.go:220] Checking for updates...
	I0307 10:08:56.614623   14270 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:08:56.635847   14270 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:08:56.657019   14270 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:08:56.677901   14270 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:08:56.698829   14270 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:08:56.720361   14270 config.go:182] Loaded profile config "kubernetes-upgrade-667000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0307 10:08:56.720834   14270 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:08:56.720904   14270 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:08:56.729654   14270 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60015
	I0307 10:08:56.730016   14270 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:08:56.730608   14270 main.go:141] libmachine: Using API Version  1
	I0307 10:08:56.730619   14270 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:08:56.730891   14270 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:08:56.731013   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .DriverName
	I0307 10:08:56.731218   14270 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:08:56.731460   14270 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:08:56.731490   14270 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:08:56.739187   14270 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60017
	I0307 10:08:56.739519   14270 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:08:56.739846   14270 main.go:141] libmachine: Using API Version  1
	I0307 10:08:56.739855   14270 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:08:56.740043   14270 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:08:56.740137   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .DriverName
	I0307 10:08:56.768807   14270 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 10:08:56.810883   14270 start.go:297] selected driver: hyperkit
	I0307 10:08:56.810911   14270 start.go:901] validating driver "hyperkit" against &{Name:kubernetes-upgrade-667000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-667000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt
imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:08:56.811107   14270 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:08:56.815433   14270 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:08:56.815546   14270 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:08:56.823381   14270 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:08:56.827219   14270 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:08:56.827242   14270 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:08:56.827411   14270 cni.go:84] Creating CNI manager for ""
	I0307 10:08:56.827428   14270 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:08:56.827483   14270 start.go:340] cluster config:
	{Name:kubernetes-upgrade-667000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:kubernetes-upgrade-667000 Na
mespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMne
tClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:08:56.827594   14270 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:08:56.869934   14270 out.go:177] * Starting "kubernetes-upgrade-667000" primary control-plane node in "kubernetes-upgrade-667000" cluster
	I0307 10:08:56.891128   14270 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 10:08:56.891201   14270 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0307 10:08:56.891244   14270 cache.go:56] Caching tarball of preloaded images
	I0307 10:08:56.891457   14270 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:08:56.891476   14270 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0307 10:08:56.891601   14270 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/kubernetes-upgrade-667000/config.json ...
	I0307 10:08:56.892495   14270 start.go:360] acquireMachinesLock for kubernetes-upgrade-667000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:08:56.892592   14270 start.go:364] duration metric: took 69.767µs to acquireMachinesLock for "kubernetes-upgrade-667000"
	I0307 10:08:56.892627   14270 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:08:56.892646   14270 fix.go:54] fixHost starting: 
	I0307 10:08:56.893065   14270 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:08:56.893119   14270 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:08:56.901925   14270 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60019
	I0307 10:08:56.902305   14270 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:08:56.902694   14270 main.go:141] libmachine: Using API Version  1
	I0307 10:08:56.902712   14270 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:08:56.902922   14270 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:08:56.903051   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .DriverName
	I0307 10:08:56.903158   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .GetState
	I0307 10:08:56.903239   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:08:56.903250   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | hyperkit pid from json: 0
	I0307 10:08:56.903296   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubernetes-upgrade-667000/hyperkit.json: no such file or directory
	I0307 10:08:56.903303   14270 fix.go:112] recreateIfNeeded on kubernetes-upgrade-667000: state=Stopped err=<nil>
	I0307 10:08:56.903320   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .DriverName
	W0307 10:08:56.903413   14270 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:08:56.944758   14270 out.go:177] * Restarting existing hyperkit VM for "kubernetes-upgrade-667000" ...
	I0307 10:08:56.966190   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .Start
	I0307 10:08:56.966603   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:08:56.966633   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubernetes-upgrade-667000/hyperkit.pid
	I0307 10:08:56.966709   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | Using UUID 376ad22b-7d25-41c5-adc8-3924ae9f02a0
	I0307 10:08:56.969086   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:08:56.969256   14270 fix.go:56] duration metric: took 76.608084ms for fixHost
	I0307 10:08:56.969275   14270 start.go:83] releasing machines lock for "kubernetes-upgrade-667000", held for 76.669511ms
	W0307 10:08:56.969300   14270 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 10:08:56.969431   14270 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:08:56.969448   14270 start.go:728] Will try again in 5 seconds ...
	I0307 10:09:01.969704   14270 start.go:360] acquireMachinesLock for kubernetes-upgrade-667000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:09:01.969848   14270 start.go:364] duration metric: took 104.142µs to acquireMachinesLock for "kubernetes-upgrade-667000"
	I0307 10:09:01.969882   14270 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:09:01.969889   14270 fix.go:54] fixHost starting: 
	I0307 10:09:01.970246   14270 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:09:01.970307   14270 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:09:01.979859   14270 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60021
	I0307 10:09:01.980239   14270 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:09:01.980567   14270 main.go:141] libmachine: Using API Version  1
	I0307 10:09:01.980583   14270 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:09:01.980806   14270 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:09:01.980900   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .DriverName
	I0307 10:09:01.980998   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .GetState
	I0307 10:09:01.981087   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:09:01.981119   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubernetes-upgrade-667000/hyperkit.json: no such file or directory
	I0307 10:09:01.981129   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | hyperkit pid from json: 0
	I0307 10:09:01.981137   14270 fix.go:112] recreateIfNeeded on kubernetes-upgrade-667000: state=Stopped err=<nil>
	I0307 10:09:01.981145   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .DriverName
	W0307 10:09:01.981226   14270 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:09:02.022339   14270 out.go:177] * Restarting existing hyperkit VM for "kubernetes-upgrade-667000" ...
	I0307 10:09:02.043800   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) Calling .Start
	I0307 10:09:02.044110   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:09:02.044140   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubernetes-upgrade-667000/hyperkit.pid
	I0307 10:09:02.044236   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | Using UUID 376ad22b-7d25-41c5-adc8-3924ae9f02a0
	I0307 10:09:02.082667   14270 main.go:141] libmachine: (kubernetes-upgrade-667000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:09:02.082779   14270 fix.go:56] duration metric: took 112.887821ms for fixHost
	I0307 10:09:02.082788   14270 start.go:83] releasing machines lock for "kubernetes-upgrade-667000", held for 112.926486ms
	W0307 10:09:02.082861   14270 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-667000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-667000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:09:02.124364   14270 out.go:177] 
	W0307 10:09:02.145875   14270 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:09:02.145936   14270 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:09:02.145950   14270 out.go:239] * Related issues:
	* Related issues:
	W0307 10:09:02.146054   14270 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:09:02.146096   14270 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:09:02.188433   14270 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:245: failed to upgrade with newest k8s version. args: out/minikube-darwin-amd64 start -p kubernetes-upgrade-667000 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=hyperkit  : exit status 60
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-667000 version --output=json
version_upgrade_test.go:248: (dbg) Non-zero exit: kubectl --context kubernetes-upgrade-667000 version --output=json: exit status 1 (37.955779ms)

                                                
                                                
** stderr ** 
	error: context "kubernetes-upgrade-667000" does not exist

                                                
                                                
** /stderr **
version_upgrade_test.go:250: error running kubectl: exit status 1
panic.go:626: *** TestKubernetesUpgrade FAILED at 2024-03-07 10:09:02.291404 -0800 PST m=+1295.067462218
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p kubernetes-upgrade-667000 -n kubernetes-upgrade-667000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p kubernetes-upgrade-667000 -n kubernetes-upgrade-667000: exit status 7 (74.550518ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "kubernetes-upgrade-667000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "kubernetes-upgrade-667000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p kubernetes-upgrade-667000
--- FAIL: TestKubernetesUpgrade (21.18s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (25.46s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.384114949 start -p stopped-upgrade-114000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:183: (dbg) Non-zero exit: /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.384114949 start -p stopped-upgrade-114000 --memory=2200 --vm-driver=hyperkit : exit status 60 (11.566103585s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-114000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/legacy_kubeconfig2414551770
	* Using the hyperkit driver based on user configuration
	* Starting control plane node stopped-upgrade-114000 in cluster stopped-upgrade-114000
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "stopped-upgrade-114000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-114000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:183: (dbg) Run:  /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.384114949 start -p stopped-upgrade-114000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:183: (dbg) Non-zero exit: /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.384114949 start -p stopped-upgrade-114000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.791146713s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-114000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/legacy_kubeconfig2860904914
	* Using the hyperkit driver based on existing profile
	* Starting control plane node stopped-upgrade-114000 in cluster stopped-upgrade-114000
	* Restarting existing hyperkit VM for "stopped-upgrade-114000" ...
	* Restarting existing hyperkit VM for "stopped-upgrade-114000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-114000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:183: (dbg) Run:  /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.384114949 start -p stopped-upgrade-114000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:183: (dbg) Non-zero exit: /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.384114949 start -p stopped-upgrade-114000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.806956236s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-114000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/legacy_kubeconfig4292447740
	* Using the hyperkit driver based on existing profile
	* Starting control plane node stopped-upgrade-114000 in cluster stopped-upgrade-114000
	* Restarting existing hyperkit VM for "stopped-upgrade-114000" ...
	* Restarting existing hyperkit VM for "stopped-upgrade-114000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-114000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:189: legacy v1.26.0 start failed: exit status 60
--- FAIL: TestStoppedBinaryUpgrade/Upgrade (25.46s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (0.32s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-darwin-amd64 logs -p stopped-upgrade-114000
version_upgrade_test.go:206: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p stopped-upgrade-114000: exit status 83 (313.695165ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| Command |                         Args                         |          Profile          |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| ssh     | -p cilium-094000 sudo cat                            | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:06 PST |                     |
	|         | /etc/hosts                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo cat                            | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:06 PST |                     |
	|         | /etc/resolv.conf                                     |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo crictl                         | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:06 PST |                     |
	|         | pods                                                 |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo crictl                         | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:06 PST |                     |
	|         | ps --all                                             |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo find                           | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:06 PST |                     |
	|         | /etc/cni -type f -exec sh -c                         |                           |         |         |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo ip a s                         | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:06 PST |                     |
	| ssh     | -p cilium-094000 sudo ip r s                         | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:06 PST |                     |
	| ssh     | -p cilium-094000 sudo                                | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | iptables-save                                        |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo iptables                       | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | -t nat -L -n -v                                      |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo                                | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | systemctl status kubelet --all                       |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo                                | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | systemctl cat kubelet                                |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo                                | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | journalctl -xeu kubelet --all                        |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo cat                            | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | /etc/kubernetes/kubelet.conf                         |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo cat                            | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | /var/lib/kubelet/config.yaml                         |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo                                | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | systemctl status docker --all                        |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo                                | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | systemctl cat docker                                 |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo cat                            | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | /etc/docker/daemon.json                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo docker                         | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | system info                                          |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo                                | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | systemctl status cri-docker                          |                           |         |         |                     |                     |
	|         | --all --full --no-pager                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo                                | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | systemctl cat cri-docker                             |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo cat                            | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | /etc/systemd/system/cri-docker.service.d/10-cni.conf |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo cat                            | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | /usr/lib/systemd/system/cri-docker.service           |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo                                | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | cri-dockerd --version                                |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo                                | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | systemctl status containerd                          |                           |         |         |                     |                     |
	|         | --all --full --no-pager                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo                                | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | systemctl cat containerd                             |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo cat                            | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | /lib/systemd/system/containerd.service               |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo cat                            | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | /etc/containerd/config.toml                          |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo                                | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | containerd config dump                               |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo                                | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | systemctl status crio --all                          |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo                                | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | systemctl cat crio --no-pager                        |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo find                           | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | /etc/crio -type f -exec sh -c                        |                           |         |         |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                           |         |         |                     |                     |
	| ssh     | -p cilium-094000 sudo crio                           | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | config                                               |                           |         |         |                     |                     |
	| delete  | -p cilium-094000                                     | cilium-094000             | jenkins | v1.32.0 | 07 Mar 24 10:07 PST | 07 Mar 24 10:07 PST |
	| delete  | -p offline-docker-243000                             | offline-docker-243000     | jenkins | v1.32.0 | 07 Mar 24 10:07 PST | 07 Mar 24 10:07 PST |
	| start   | -p force-systemd-env-752000                          | force-systemd-env-752000  | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| start   | -p force-systemd-flag-568000                         | force-systemd-flag-568000 | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | --memory=2048 --force-systemd                        |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | force-systemd-env-752000                             | force-systemd-env-752000  | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | ssh docker info --format                             |                           |         |         |                     |                     |
	|         | {{.CgroupDriver}}                                    |                           |         |         |                     |                     |
	| delete  | -p force-systemd-env-752000                          | force-systemd-env-752000  | jenkins | v1.32.0 | 07 Mar 24 10:07 PST | 07 Mar 24 10:07 PST |
	| start   | -p docker-flags-466000                               | docker-flags-466000       | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | --cache-images=false                                 |                           |         |         |                     |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --install-addons=false                               |                           |         |         |                     |                     |
	|         | --wait=false                                         |                           |         |         |                     |                     |
	|         | --docker-env=FOO=BAR                                 |                           |         |         |                     |                     |
	|         | --docker-env=BAZ=BAT                                 |                           |         |         |                     |                     |
	|         | --docker-opt=debug                                   |                           |         |         |                     |                     |
	|         | --docker-opt=icc=true                                |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | force-systemd-flag-568000                            | force-systemd-flag-568000 | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | ssh docker info --format                             |                           |         |         |                     |                     |
	|         | {{.CgroupDriver}}                                    |                           |         |         |                     |                     |
	| delete  | -p force-systemd-flag-568000                         | force-systemd-flag-568000 | jenkins | v1.32.0 | 07 Mar 24 10:07 PST | 07 Mar 24 10:07 PST |
	| start   | -p cert-expiration-787000                            | cert-expiration-787000    | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --cert-expiration=3m                                 |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | docker-flags-466000 ssh                              | docker-flags-466000       | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | sudo systemctl show docker                           |                           |         |         |                     |                     |
	|         | --property=Environment                               |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | docker-flags-466000 ssh                              | docker-flags-466000       | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | sudo systemctl show docker                           |                           |         |         |                     |                     |
	|         | --property=ExecStart                                 |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| delete  | -p docker-flags-466000                               | docker-flags-466000       | jenkins | v1.32.0 | 07 Mar 24 10:07 PST | 07 Mar 24 10:07 PST |
	| start   | -p cert-options-514000                               | cert-options-514000       | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --apiserver-ips=127.0.0.1                            |                           |         |         |                     |                     |
	|         | --apiserver-ips=192.168.15.15                        |                           |         |         |                     |                     |
	|         | --apiserver-names=localhost                          |                           |         |         |                     |                     |
	|         | --apiserver-names=www.google.com                     |                           |         |         |                     |                     |
	|         | --apiserver-port=8555                                |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | cert-options-514000 ssh                              | cert-options-514000       | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | openssl x509 -text -noout -in                        |                           |         |         |                     |                     |
	|         | /var/lib/minikube/certs/apiserver.crt                |                           |         |         |                     |                     |
	| ssh     | -p cert-options-514000 -- sudo                       | cert-options-514000       | jenkins | v1.32.0 | 07 Mar 24 10:07 PST |                     |
	|         | cat /etc/kubernetes/admin.conf                       |                           |         |         |                     |                     |
	| delete  | -p cert-options-514000                               | cert-options-514000       | jenkins | v1.32.0 | 07 Mar 24 10:07 PST | 07 Mar 24 10:07 PST |
	| start   | -p running-upgrade-566000                            | minikube                  | jenkins | v1.26.0 | 07 Mar 24 10:07 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p running-upgrade-566000                            | minikube                  | jenkins | v1.26.0 | 07 Mar 24 10:08 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p running-upgrade-566000                            | minikube                  | jenkins | v1.26.0 | 07 Mar 24 10:08 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| delete  | -p running-upgrade-566000                            | running-upgrade-566000    | jenkins | v1.32.0 | 07 Mar 24 10:08 PST | 07 Mar 24 10:08 PST |
	| start   | -p kubernetes-upgrade-667000                         | kubernetes-upgrade-667000 | jenkins | v1.32.0 | 07 Mar 24 10:08 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                         |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| stop    | -p kubernetes-upgrade-667000                         | kubernetes-upgrade-667000 | jenkins | v1.32.0 | 07 Mar 24 10:08 PST | 07 Mar 24 10:08 PST |
	| start   | -p kubernetes-upgrade-667000                         | kubernetes-upgrade-667000 | jenkins | v1.32.0 | 07 Mar 24 10:08 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.29.0-rc.2                    |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| delete  | -p kubernetes-upgrade-667000                         | kubernetes-upgrade-667000 | jenkins | v1.32.0 | 07 Mar 24 10:09 PST | 07 Mar 24 10:09 PST |
	| start   | -p stopped-upgrade-114000                            | minikube                  | jenkins | v1.26.0 | 07 Mar 24 10:09 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p stopped-upgrade-114000                            | minikube                  | jenkins | v1.26.0 | 07 Mar 24 10:09 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p stopped-upgrade-114000                            | minikube                  | jenkins | v1.26.0 | 07 Mar 24 10:09 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/07 10:09:23
	Running on machine: MacOS-Agent-2
	Binary: Built with gc go1.18.3 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0307 10:09:23.609640   14343 out.go:296] Setting OutFile to fd 1 ...
	I0307 10:09:23.609814   14343 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0307 10:09:23.609817   14343 out.go:309] Setting ErrFile to fd 2...
	I0307 10:09:23.609820   14343 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0307 10:09:23.610150   14343 root.go:329] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:09:23.610413   14343 out.go:303] Setting JSON to false
	I0307 10:09:23.632448   14343 start.go:115] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7734,"bootTime":1709827229,"procs":437,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:09:23.632552   14343 start.go:123] gopshost.Virtualization returned error: not implemented yet
	I0307 10:09:23.654500   14343 out.go:177] * [stopped-upgrade-114000] minikube v1.26.0 on Darwin 14.3.1
	I0307 10:09:23.696398   14343 notify.go:193] Checking for updates...
	I0307 10:09:23.718039   14343 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:09:23.738877   14343 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:09:23.760074   14343 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:09:23.781446   14343 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:09:23.801959   14343 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:09:23.823183   14343 out.go:177]   - KUBECONFIG=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/legacy_kubeconfig4292447740
	I0307 10:09:23.844851   14343 config.go:178] Loaded profile config "stopped-upgrade-114000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0307 10:09:23.845474   14343 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:09:23.845538   14343 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0307 10:09:23.854325   14343 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:60057
	I0307 10:09:23.854682   14343 main.go:134] libmachine: () Calling .GetVersion
	I0307 10:09:23.855119   14343 main.go:134] libmachine: Using API Version  1
	I0307 10:09:23.855127   14343 main.go:134] libmachine: () Calling .SetConfigRaw
	I0307 10:09:23.855344   14343 main.go:134] libmachine: () Calling .GetMachineName
	I0307 10:09:23.855428   14343 main.go:134] libmachine: (stopped-upgrade-114000) Calling .DriverName
	I0307 10:09:23.855545   14343 driver.go:360] Setting default libvirt URI to qemu:///system
	I0307 10:09:23.855798   14343 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:09:23.855816   14343 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0307 10:09:23.863447   14343 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:60059
	I0307 10:09:23.863764   14343 main.go:134] libmachine: () Calling .GetVersion
	I0307 10:09:23.864106   14343 main.go:134] libmachine: Using API Version  1
	I0307 10:09:23.864116   14343 main.go:134] libmachine: () Calling .SetConfigRaw
	I0307 10:09:23.864303   14343 main.go:134] libmachine: () Calling .GetMachineName
	I0307 10:09:23.864389   14343 main.go:134] libmachine: (stopped-upgrade-114000) Calling .DriverName
	I0307 10:09:23.892940   14343 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 10:09:23.914110   14343 start.go:284] selected driver: hyperkit
	I0307 10:09:23.914129   14343 start.go:805] validating driver "hyperkit" against &{Name:stopped-upgrade-114000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:s
topped-upgrade-114000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath:}
	I0307 10:09:23.914391   14343 start.go:816] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:09:23.918424   14343 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:09:23.918521   14343 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:09:23.926273   14343 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:09:23.930029   14343 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:09:23.930044   14343 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:09:23.930129   14343 cni.go:95] Creating CNI manager for ""
	I0307 10:09:23.930137   14343 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
	I0307 10:09:23.930145   14343 start_flags.go:310] config:
	{Name:stopped-upgrade-114000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:stopped-upgrade-114000 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0307 10:09:23.930260   14343 iso.go:128] acquiring lock: {Name:mk60d4646d3091ecdccf2d24c31793c95ea5828f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:09:23.971944   14343 out.go:177] * Starting control plane node stopped-upgrade-114000 in cluster stopped-upgrade-114000
	I0307 10:09:23.993128   14343 preload.go:132] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I0307 10:09:23.993194   14343 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4
	I0307 10:09:23.993221   14343 cache.go:57] Caching tarball of preloaded images
	I0307 10:09:23.993394   14343 preload.go:174] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:09:23.993410   14343 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.1 on docker
	I0307 10:09:23.993571   14343 profile.go:148] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/stopped-upgrade-114000/config.json ...
	I0307 10:09:23.994355   14343 cache.go:208] Successfully downloaded all kic artifacts
	I0307 10:09:23.994425   14343 start.go:352] acquiring machines lock for stopped-upgrade-114000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:09:23.994495   14343 start.go:356] acquired machines lock for "stopped-upgrade-114000" in 55.942µs
	I0307 10:09:23.994540   14343 start.go:94] Skipping create...Using existing machine configuration
	I0307 10:09:23.994547   14343 fix.go:55] fixHost starting: 
	I0307 10:09:23.995751   14343 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:09:23.995788   14343 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0307 10:09:24.004390   14343 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:60061
	I0307 10:09:24.004739   14343 main.go:134] libmachine: () Calling .GetVersion
	I0307 10:09:24.005160   14343 main.go:134] libmachine: Using API Version  1
	I0307 10:09:24.005186   14343 main.go:134] libmachine: () Calling .SetConfigRaw
	I0307 10:09:24.005396   14343 main.go:134] libmachine: () Calling .GetMachineName
	I0307 10:09:24.005506   14343 main.go:134] libmachine: (stopped-upgrade-114000) Calling .DriverName
	I0307 10:09:24.005596   14343 main.go:134] libmachine: (stopped-upgrade-114000) Calling .GetState
	I0307 10:09:24.005680   14343 main.go:134] libmachine: (stopped-upgrade-114000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:09:24.005726   14343 main.go:134] libmachine: (stopped-upgrade-114000) DBG | hyperkit pid from json: 0
	I0307 10:09:24.005743   14343 main.go:134] libmachine: (stopped-upgrade-114000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/stopped-upgrade-114000/hyperkit.json: no such file or directory
	I0307 10:09:24.005751   14343 fix.go:103] recreateIfNeeded on stopped-upgrade-114000: state=Stopped err=<nil>
	I0307 10:09:24.005789   14343 main.go:134] libmachine: (stopped-upgrade-114000) Calling .DriverName
	W0307 10:09:24.005875   14343 fix.go:129] unexpected machine state, will restart: <nil>
	I0307 10:09:24.047930   14343 out.go:177] * Restarting existing hyperkit VM for "stopped-upgrade-114000" ...
	I0307 10:09:24.069089   14343 main.go:134] libmachine: (stopped-upgrade-114000) Calling .Start
	I0307 10:09:24.069380   14343 main.go:134] libmachine: (stopped-upgrade-114000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:09:24.069425   14343 main.go:134] libmachine: (stopped-upgrade-114000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/stopped-upgrade-114000/hyperkit.pid
	I0307 10:09:24.069495   14343 main.go:134] libmachine: (stopped-upgrade-114000) DBG | Using UUID cd4be072-dcad-11ee-9047-f01898ef957c
	I0307 10:09:24.109561   14343 main.go:134] libmachine: (stopped-upgrade-114000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:09:24.109669   14343 fix.go:57] fixHost completed within 115.117347ms
	I0307 10:09:24.109675   14343 start.go:81] releasing machines lock for "stopped-upgrade-114000", held for 115.173521ms
	W0307 10:09:24.109687   14343 start.go:599] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 10:09:24.109777   14343 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:09:24.109785   14343 start.go:614] Will try again in 5 seconds ...
	I0307 10:09:29.110962   14343 start.go:352] acquiring machines lock for stopped-upgrade-114000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:09:29.111125   14343 start.go:356] acquired machines lock for "stopped-upgrade-114000" in 120.74µs
	I0307 10:09:29.111162   14343 start.go:94] Skipping create...Using existing machine configuration
	I0307 10:09:29.111167   14343 fix.go:55] fixHost starting: 
	I0307 10:09:29.111625   14343 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:09:29.111661   14343 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0307 10:09:29.121476   14343 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:60063
	I0307 10:09:29.121934   14343 main.go:134] libmachine: () Calling .GetVersion
	I0307 10:09:29.122308   14343 main.go:134] libmachine: Using API Version  1
	I0307 10:09:29.122321   14343 main.go:134] libmachine: () Calling .SetConfigRaw
	I0307 10:09:29.122592   14343 main.go:134] libmachine: () Calling .GetMachineName
	I0307 10:09:29.122704   14343 main.go:134] libmachine: (stopped-upgrade-114000) Calling .DriverName
	I0307 10:09:29.122799   14343 main.go:134] libmachine: (stopped-upgrade-114000) Calling .GetState
	I0307 10:09:29.122877   14343 main.go:134] libmachine: (stopped-upgrade-114000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:09:29.122894   14343 main.go:134] libmachine: (stopped-upgrade-114000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/stopped-upgrade-114000/hyperkit.json: no such file or directory
	I0307 10:09:29.122906   14343 main.go:134] libmachine: (stopped-upgrade-114000) DBG | hyperkit pid from json: 0
	I0307 10:09:29.122932   14343 fix.go:103] recreateIfNeeded on stopped-upgrade-114000: state=Stopped err=<nil>
	I0307 10:09:29.122951   14343 main.go:134] libmachine: (stopped-upgrade-114000) Calling .DriverName
	W0307 10:09:29.123027   14343 fix.go:129] unexpected machine state, will restart: <nil>
	I0307 10:09:29.144473   14343 out.go:177] * Restarting existing hyperkit VM for "stopped-upgrade-114000" ...
	I0307 10:09:29.165285   14343 main.go:134] libmachine: (stopped-upgrade-114000) Calling .Start
	I0307 10:09:29.165573   14343 main.go:134] libmachine: (stopped-upgrade-114000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:09:29.165628   14343 main.go:134] libmachine: (stopped-upgrade-114000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/stopped-upgrade-114000/hyperkit.pid
	I0307 10:09:29.165717   14343 main.go:134] libmachine: (stopped-upgrade-114000) DBG | Using UUID cd4be072-dcad-11ee-9047-f01898ef957c
	I0307 10:09:29.167684   14343 main.go:134] libmachine: (stopped-upgrade-114000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:09:29.167778   14343 fix.go:57] fixHost completed within 56.609638ms
	I0307 10:09:29.167785   14343 start.go:81] releasing machines lock for "stopped-upgrade-114000", held for 56.651409ms
	W0307 10:09:29.167954   14343 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-114000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:09:29.210140   14343 out.go:177] 
	W0307 10:09:29.231624   14343 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:09:29.231777   14343 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:09:29.231787   14343 out.go:239] * Related issues:
	W0307 10:09:29.231835   14343 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:09:29.232014   14343 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:09:29.274096   14343 out.go:177] 
	
	
	* The control-plane node stopped-upgrade-114000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p stopped-upgrade-114000"

                                                
                                                
-- /stdout --
version_upgrade_test.go:208: `minikube logs` after upgrade to HEAD from v1.26.0 failed: exit status 83
--- FAIL: TestStoppedBinaryUpgrade/MinikubeLogs (0.32s)

                                                
                                    
x
+
TestPause/serial/Start (11.29s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-darwin-amd64 start -p pause-955000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit 
pause_test.go:80: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p pause-955000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit : exit status 60 (11.211503435s)

                                                
                                                
-- stdout --
	* [pause-955000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "pause-955000" primary control-plane node in "pause-955000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "pause-955000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p pause-955000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
pause_test.go:82: failed to start minikube with args: "out/minikube-darwin-amd64 start -p pause-955000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-955000 -n pause-955000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-955000 -n pause-955000: exit status 7 (76.067361ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "pause-955000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestPause/serial/Start (11.29s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (11.25s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-787000 --driver=hyperkit 
no_kubernetes_test.go:95: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-787000 --driver=hyperkit : exit status 60 (11.176238673s)

                                                
                                                
-- stdout --
	* [NoKubernetes-787000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "NoKubernetes-787000" primary control-plane node in "NoKubernetes-787000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "NoKubernetes-787000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-787000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:97: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-787000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-787000 -n NoKubernetes-787000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-787000 -n NoKubernetes-787000: exit status 7 (74.889285ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-787000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithK8s (11.25s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (5.89s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-787000 --no-kubernetes --driver=hyperkit 
no_kubernetes_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-787000 --no-kubernetes --driver=hyperkit : exit status 60 (5.81008237s)

                                                
                                                
-- stdout --
	* [NoKubernetes-787000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-787000
	* Restarting existing hyperkit VM for "NoKubernetes-787000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-787000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-787000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:114: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-787000 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-787000 -n NoKubernetes-787000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-787000 -n NoKubernetes-787000: exit status 7 (74.572988ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-787000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithStopK8s (5.89s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (5.95s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-787000 --no-kubernetes --driver=hyperkit 
no_kubernetes_test.go:136: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-787000 --no-kubernetes --driver=hyperkit : exit status 60 (5.87010255s)

                                                
                                                
-- stdout --
	* [NoKubernetes-787000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-787000
	* Restarting existing hyperkit VM for "NoKubernetes-787000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-787000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-787000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:138: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-787000 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-787000 -n NoKubernetes-787000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-787000 -n NoKubernetes-787000: exit status 7 (74.710535ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-787000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/Start (5.95s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (5.91s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-787000 --driver=hyperkit 
no_kubernetes_test.go:191: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-787000 --driver=hyperkit : exit status 60 (5.834537404s)

                                                
                                                
-- stdout --
	* [NoKubernetes-787000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-787000
	* Restarting existing hyperkit VM for "NoKubernetes-787000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-787000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-787000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:193: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-787000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-787000 -n NoKubernetes-787000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-787000 -n NoKubernetes-787000: exit status 7 (74.826712ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-787000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartNoArgs (5.91s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (11.32s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p auto-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p auto-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=hyperkit : exit status 60 (11.317821858s)

                                                
                                                
-- stdout --
	* [auto-094000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "auto-094000" primary control-plane node in "auto-094000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "auto-094000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:10:15.180478   14521 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:10:15.180728   14521 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:10:15.180734   14521 out.go:304] Setting ErrFile to fd 2...
	I0307 10:10:15.180738   14521 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:10:15.181463   14521 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:10:15.183207   14521 out.go:298] Setting JSON to false
	I0307 10:10:15.205729   14521 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7786,"bootTime":1709827229,"procs":436,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:10:15.205830   14521 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:10:15.226387   14521 out.go:177] * [auto-094000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:10:15.268334   14521 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:10:15.268408   14521 notify.go:220] Checking for updates...
	I0307 10:10:15.290300   14521 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:10:15.311173   14521 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:10:15.353055   14521 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:10:15.374236   14521 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:10:15.395232   14521 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:10:15.417225   14521 config.go:182] Loaded profile config "cert-expiration-787000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:10:15.417441   14521 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:10:15.417604   14521 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:10:15.447123   14521 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:10:15.489152   14521 start.go:297] selected driver: hyperkit
	I0307 10:10:15.489178   14521 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:10:15.489198   14521 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:10:15.493289   14521 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:10:15.493391   14521 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:10:15.501333   14521 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:10:15.505360   14521 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:15.505384   14521 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:10:15.505423   14521 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:10:15.505639   14521 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:10:15.505689   14521 cni.go:84] Creating CNI manager for ""
	I0307 10:10:15.505706   14521 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:10:15.505713   14521 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 10:10:15.505782   14521 start.go:340] cluster config:
	{Name:auto-094000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:auto-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:d
ocker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgen
tPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:10:15.505865   14521 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:10:15.548119   14521 out.go:177] * Starting "auto-094000" primary control-plane node in "auto-094000" cluster
	I0307 10:10:15.569153   14521 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:10:15.569212   14521 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:10:15.569235   14521 cache.go:56] Caching tarball of preloaded images
	I0307 10:10:15.569381   14521 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:10:15.569394   14521 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:10:15.569511   14521 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/auto-094000/config.json ...
	I0307 10:10:15.569536   14521 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/auto-094000/config.json: {Name:mk2d0e7703345a63c53621361a8eb282e905194a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:10:15.570109   14521 start.go:360] acquireMachinesLock for auto-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:10:15.570208   14521 start.go:364] duration metric: took 79.946µs to acquireMachinesLock for "auto-094000"
	I0307 10:10:15.570244   14521 start.go:93] Provisioning new machine with config: &{Name:auto-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.28.4 ClusterName:auto-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mou
ntType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:10:15.570310   14521 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:10:15.612283   14521 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:10:15.612578   14521 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:15.612649   14521 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:10:15.621120   14521 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60172
	I0307 10:10:15.621502   14521 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:10:15.621950   14521 main.go:141] libmachine: Using API Version  1
	I0307 10:10:15.621962   14521 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:10:15.622178   14521 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:10:15.622266   14521 main.go:141] libmachine: (auto-094000) Calling .GetMachineName
	I0307 10:10:15.622362   14521 main.go:141] libmachine: (auto-094000) Calling .DriverName
	I0307 10:10:15.622474   14521 start.go:159] libmachine.API.Create for "auto-094000" (driver="hyperkit")
	I0307 10:10:15.622500   14521 client.go:168] LocalClient.Create starting
	I0307 10:10:15.622529   14521 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:10:15.622578   14521 main.go:141] libmachine: Decoding PEM data...
	I0307 10:10:15.622593   14521 main.go:141] libmachine: Parsing certificate...
	I0307 10:10:15.622646   14521 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:10:15.622682   14521 main.go:141] libmachine: Decoding PEM data...
	I0307 10:10:15.622694   14521 main.go:141] libmachine: Parsing certificate...
	I0307 10:10:15.622707   14521 main.go:141] libmachine: Running pre-create checks...
	I0307 10:10:15.622718   14521 main.go:141] libmachine: (auto-094000) Calling .PreCreateCheck
	I0307 10:10:15.622808   14521 main.go:141] libmachine: (auto-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:15.623018   14521 main.go:141] libmachine: (auto-094000) Calling .GetConfigRaw
	I0307 10:10:15.623511   14521 main.go:141] libmachine: Creating machine...
	I0307 10:10:15.623522   14521 main.go:141] libmachine: (auto-094000) Calling .Create
	I0307 10:10:15.623594   14521 main.go:141] libmachine: (auto-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:15.623702   14521 main.go:141] libmachine: (auto-094000) DBG | I0307 10:10:15.623581   14529 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:10:15.623778   14521 main.go:141] libmachine: (auto-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:10:15.799678   14521 main.go:141] libmachine: (auto-094000) DBG | I0307 10:10:15.799606   14529 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/auto-094000/id_rsa...
	I0307 10:10:16.122202   14521 main.go:141] libmachine: (auto-094000) DBG | I0307 10:10:16.122110   14529 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/auto-094000/auto-094000.rawdisk...
	I0307 10:10:16.122215   14521 main.go:141] libmachine: (auto-094000) DBG | Writing magic tar header
	I0307 10:10:16.122224   14521 main.go:141] libmachine: (auto-094000) DBG | Writing SSH key tar header
	I0307 10:10:16.123004   14521 main.go:141] libmachine: (auto-094000) DBG | I0307 10:10:16.122921   14529 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/auto-094000 ...
	I0307 10:10:16.485619   14521 main.go:141] libmachine: (auto-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:16.485640   14521 main.go:141] libmachine: (auto-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/auto-094000/hyperkit.pid
	I0307 10:10:16.485675   14521 main.go:141] libmachine: (auto-094000) DBG | Using UUID 5fd48c21-eb34-4a81-a42f-efd5760fbf61
	I0307 10:10:16.520442   14521 main.go:141] libmachine: (auto-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:10:16.520525   14521 client.go:171] duration metric: took 898.001588ms to LocalClient.Create
	I0307 10:10:18.521104   14521 start.go:128] duration metric: took 2.950728824s to createHost
	I0307 10:10:18.521129   14521 start.go:83] releasing machines lock for "auto-094000", held for 2.950865124s
	W0307 10:10:18.521159   14521 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:10:18.521720   14521 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:18.521761   14521 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:10:18.530832   14521 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60174
	I0307 10:10:18.531221   14521 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:10:18.531552   14521 main.go:141] libmachine: Using API Version  1
	I0307 10:10:18.531560   14521 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:10:18.531765   14521 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:10:18.532124   14521 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:18.532148   14521 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:10:18.540011   14521 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60176
	I0307 10:10:18.540375   14521 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:10:18.540699   14521 main.go:141] libmachine: Using API Version  1
	I0307 10:10:18.540708   14521 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:10:18.540910   14521 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:10:18.541009   14521 main.go:141] libmachine: (auto-094000) Calling .GetState
	I0307 10:10:18.541089   14521 main.go:141] libmachine: (auto-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:18.541114   14521 main.go:141] libmachine: (auto-094000) DBG | hyperkit pid from json: 0
	I0307 10:10:18.541157   14521 main.go:141] libmachine: (auto-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/auto-094000/hyperkit.json: no such file or directory
	I0307 10:10:18.541198   14521 main.go:141] libmachine: (auto-094000) Calling .DriverName
	I0307 10:10:18.573469   14521 out.go:177] * Deleting "auto-094000" in hyperkit ...
	I0307 10:10:18.594486   14521 main.go:141] libmachine: (auto-094000) Calling .Remove
	I0307 10:10:18.594777   14521 main.go:141] libmachine: (auto-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:18.594800   14521 main.go:141] libmachine: (auto-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:18.594817   14521 main.go:141] libmachine: (auto-094000) DBG | hyperkit pid from json: 0
	I0307 10:10:18.594833   14521 main.go:141] libmachine: (auto-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/auto-094000/hyperkit.json: no such file or directory
	W0307 10:10:18.612711   14521 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:10:18.612731   14521 start.go:728] Will try again in 5 seconds ...
	I0307 10:10:23.613778   14521 start.go:360] acquireMachinesLock for auto-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:10:23.613948   14521 start.go:364] duration metric: took 137.558µs to acquireMachinesLock for "auto-094000"
	I0307 10:10:23.614004   14521 start.go:93] Provisioning new machine with config: &{Name:auto-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.28.4 ClusterName:auto-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mou
ntType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:10:23.614103   14521 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:10:23.659353   14521 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:10:23.659547   14521 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:23.659600   14521 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:10:23.669134   14521 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60178
	I0307 10:10:23.669534   14521 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:10:23.669938   14521 main.go:141] libmachine: Using API Version  1
	I0307 10:10:23.669953   14521 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:10:23.670195   14521 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:10:23.670294   14521 main.go:141] libmachine: (auto-094000) Calling .GetMachineName
	I0307 10:10:23.670370   14521 main.go:141] libmachine: (auto-094000) Calling .DriverName
	I0307 10:10:23.670473   14521 start.go:159] libmachine.API.Create for "auto-094000" (driver="hyperkit")
	I0307 10:10:23.670510   14521 client.go:168] LocalClient.Create starting
	I0307 10:10:23.670538   14521 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:10:23.670584   14521 main.go:141] libmachine: Decoding PEM data...
	I0307 10:10:23.670595   14521 main.go:141] libmachine: Parsing certificate...
	I0307 10:10:23.670642   14521 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:10:23.670680   14521 main.go:141] libmachine: Decoding PEM data...
	I0307 10:10:23.670694   14521 main.go:141] libmachine: Parsing certificate...
	I0307 10:10:23.670708   14521 main.go:141] libmachine: Running pre-create checks...
	I0307 10:10:23.670714   14521 main.go:141] libmachine: (auto-094000) Calling .PreCreateCheck
	I0307 10:10:23.670794   14521 main.go:141] libmachine: (auto-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:23.670821   14521 main.go:141] libmachine: (auto-094000) Calling .GetConfigRaw
	I0307 10:10:23.671258   14521 main.go:141] libmachine: Creating machine...
	I0307 10:10:23.671266   14521 main.go:141] libmachine: (auto-094000) Calling .Create
	I0307 10:10:23.671331   14521 main.go:141] libmachine: (auto-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:23.671442   14521 main.go:141] libmachine: (auto-094000) DBG | I0307 10:10:23.671317   14538 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:10:23.671487   14521 main.go:141] libmachine: (auto-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:10:23.847590   14521 main.go:141] libmachine: (auto-094000) DBG | I0307 10:10:23.847525   14538 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/auto-094000/id_rsa...
	I0307 10:10:23.886797   14521 main.go:141] libmachine: (auto-094000) DBG | I0307 10:10:23.886722   14538 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/auto-094000/auto-094000.rawdisk...
	I0307 10:10:23.886807   14521 main.go:141] libmachine: (auto-094000) DBG | Writing magic tar header
	I0307 10:10:23.886815   14521 main.go:141] libmachine: (auto-094000) DBG | Writing SSH key tar header
	I0307 10:10:23.887291   14521 main.go:141] libmachine: (auto-094000) DBG | I0307 10:10:23.887253   14538 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/auto-094000 ...
	I0307 10:10:24.247631   14521 main.go:141] libmachine: (auto-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:24.247650   14521 main.go:141] libmachine: (auto-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/auto-094000/hyperkit.pid
	I0307 10:10:24.247692   14521 main.go:141] libmachine: (auto-094000) DBG | Using UUID 7bd4119c-3b97-49bd-a3ad-dea2122234e1
	I0307 10:10:24.286473   14521 main.go:141] libmachine: (auto-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:10:24.286565   14521 client.go:171] duration metric: took 616.0379ms to LocalClient.Create
	I0307 10:10:26.286758   14521 start.go:128] duration metric: took 2.672600606s to createHost
	I0307 10:10:26.286779   14521 start.go:83] releasing machines lock for "auto-094000", held for 2.672776553s
	W0307 10:10:26.286847   14521 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p auto-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p auto-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:10:26.308610   14521 out.go:177] 
	W0307 10:10:26.332595   14521 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:10:26.332651   14521 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:10:26.332666   14521 out.go:239] * Related issues:
	* Related issues:
	W0307 10:10:26.332702   14521 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:10:26.332722   14521 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:10:26.354228   14521 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/auto/Start (11.32s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (11.2s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p kindnet-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kindnet-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=hyperkit : exit status 60 (11.198175958s)

                                                
                                                
-- stdout --
	* [kindnet-094000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "kindnet-094000" primary control-plane node in "kindnet-094000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "kindnet-094000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:10:32.407924   14673 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:10:32.408082   14673 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:10:32.408087   14673 out.go:304] Setting ErrFile to fd 2...
	I0307 10:10:32.408091   14673 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:10:32.408280   14673 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:10:32.409714   14673 out.go:298] Setting JSON to false
	I0307 10:10:32.432069   14673 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7803,"bootTime":1709827229,"procs":465,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:10:32.432155   14673 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:10:32.454657   14673 out.go:177] * [kindnet-094000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:10:32.495582   14673 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:10:32.495660   14673 notify.go:220] Checking for updates...
	I0307 10:10:32.538487   14673 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:10:32.559362   14673 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:10:32.580502   14673 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:10:32.601681   14673 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:10:32.622627   14673 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:10:32.644400   14673 config.go:182] Loaded profile config "cert-expiration-787000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:10:32.644598   14673 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:10:32.644758   14673 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:10:32.674732   14673 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:10:32.716603   14673 start.go:297] selected driver: hyperkit
	I0307 10:10:32.716650   14673 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:10:32.716688   14673 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:10:32.720884   14673 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:10:32.720989   14673 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:10:32.728857   14673 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:10:32.732694   14673 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:32.732726   14673 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:10:32.732765   14673 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:10:32.732980   14673 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:10:32.733039   14673 cni.go:84] Creating CNI manager for "kindnet"
	I0307 10:10:32.733046   14673 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0307 10:10:32.733113   14673 start.go:340] cluster config:
	{Name:kindnet-094000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:kindnet-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:10:32.733200   14673 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:10:32.775358   14673 out.go:177] * Starting "kindnet-094000" primary control-plane node in "kindnet-094000" cluster
	I0307 10:10:32.796685   14673 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:10:32.796745   14673 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:10:32.796769   14673 cache.go:56] Caching tarball of preloaded images
	I0307 10:10:32.796921   14673 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:10:32.796935   14673 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:10:32.797044   14673 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/kindnet-094000/config.json ...
	I0307 10:10:32.797070   14673 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/kindnet-094000/config.json: {Name:mkbd76980312ec30b867583218db18cdd9cfa12c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:10:32.797525   14673 start.go:360] acquireMachinesLock for kindnet-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:10:32.797606   14673 start.go:364] duration metric: took 64.37µs to acquireMachinesLock for "kindnet-094000"
	I0307 10:10:32.797651   14673 start.go:93] Provisioning new machine with config: &{Name:kindnet-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kindnet-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:10:32.797717   14673 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:10:32.818643   14673 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:10:32.818908   14673 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:32.818976   14673 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:10:32.827842   14673 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60254
	I0307 10:10:32.828260   14673 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:10:32.828705   14673 main.go:141] libmachine: Using API Version  1
	I0307 10:10:32.828722   14673 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:10:32.828952   14673 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:10:32.829056   14673 main.go:141] libmachine: (kindnet-094000) Calling .GetMachineName
	I0307 10:10:32.829179   14673 main.go:141] libmachine: (kindnet-094000) Calling .DriverName
	I0307 10:10:32.829304   14673 start.go:159] libmachine.API.Create for "kindnet-094000" (driver="hyperkit")
	I0307 10:10:32.829330   14673 client.go:168] LocalClient.Create starting
	I0307 10:10:32.829367   14673 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:10:32.829419   14673 main.go:141] libmachine: Decoding PEM data...
	I0307 10:10:32.829436   14673 main.go:141] libmachine: Parsing certificate...
	I0307 10:10:32.829497   14673 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:10:32.829534   14673 main.go:141] libmachine: Decoding PEM data...
	I0307 10:10:32.829546   14673 main.go:141] libmachine: Parsing certificate...
	I0307 10:10:32.829561   14673 main.go:141] libmachine: Running pre-create checks...
	I0307 10:10:32.829571   14673 main.go:141] libmachine: (kindnet-094000) Calling .PreCreateCheck
	I0307 10:10:32.829641   14673 main.go:141] libmachine: (kindnet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:32.829781   14673 main.go:141] libmachine: (kindnet-094000) Calling .GetConfigRaw
	I0307 10:10:32.839851   14673 main.go:141] libmachine: Creating machine...
	I0307 10:10:32.839867   14673 main.go:141] libmachine: (kindnet-094000) Calling .Create
	I0307 10:10:32.840064   14673 main.go:141] libmachine: (kindnet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:32.840278   14673 main.go:141] libmachine: (kindnet-094000) DBG | I0307 10:10:32.840028   14681 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:10:32.840381   14673 main.go:141] libmachine: (kindnet-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:10:33.017039   14673 main.go:141] libmachine: (kindnet-094000) DBG | I0307 10:10:33.016980   14681 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kindnet-094000/id_rsa...
	I0307 10:10:33.192596   14673 main.go:141] libmachine: (kindnet-094000) DBG | I0307 10:10:33.192502   14681 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kindnet-094000/kindnet-094000.rawdisk...
	I0307 10:10:33.192614   14673 main.go:141] libmachine: (kindnet-094000) DBG | Writing magic tar header
	I0307 10:10:33.192624   14673 main.go:141] libmachine: (kindnet-094000) DBG | Writing SSH key tar header
	I0307 10:10:33.193323   14673 main.go:141] libmachine: (kindnet-094000) DBG | I0307 10:10:33.193274   14681 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kindnet-094000 ...
	I0307 10:10:33.555997   14673 main.go:141] libmachine: (kindnet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:33.556018   14673 main.go:141] libmachine: (kindnet-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kindnet-094000/hyperkit.pid
	I0307 10:10:33.556116   14673 main.go:141] libmachine: (kindnet-094000) DBG | Using UUID 6db43371-5795-4d28-830f-adce358dc62a
	I0307 10:10:33.592927   14673 main.go:141] libmachine: (kindnet-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:10:33.592995   14673 client.go:171] duration metric: took 763.643204ms to LocalClient.Create
	I0307 10:10:35.593384   14673 start.go:128] duration metric: took 2.795606606s to createHost
	I0307 10:10:35.593408   14673 start.go:83] releasing machines lock for "kindnet-094000", held for 2.795747161s
	W0307 10:10:35.593441   14673 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:10:35.594013   14673 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:35.594060   14673 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:10:35.604506   14673 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60256
	I0307 10:10:35.605043   14673 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:10:35.605488   14673 main.go:141] libmachine: Using API Version  1
	I0307 10:10:35.605496   14673 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:10:35.605759   14673 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:10:35.606133   14673 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:35.606167   14673 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:10:35.614496   14673 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60258
	I0307 10:10:35.614950   14673 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:10:35.615341   14673 main.go:141] libmachine: Using API Version  1
	I0307 10:10:35.615373   14673 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:10:35.615614   14673 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:10:35.615715   14673 main.go:141] libmachine: (kindnet-094000) Calling .GetState
	I0307 10:10:35.615798   14673 main.go:141] libmachine: (kindnet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:35.615827   14673 main.go:141] libmachine: (kindnet-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kindnet-094000/hyperkit.json: no such file or directory
	I0307 10:10:35.615834   14673 main.go:141] libmachine: (kindnet-094000) DBG | hyperkit pid from json: 0
	I0307 10:10:35.615877   14673 main.go:141] libmachine: (kindnet-094000) Calling .DriverName
	I0307 10:10:35.657379   14673 out.go:177] * Deleting "kindnet-094000" in hyperkit ...
	I0307 10:10:35.680338   14673 main.go:141] libmachine: (kindnet-094000) Calling .Remove
	I0307 10:10:35.680659   14673 main.go:141] libmachine: (kindnet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:35.680683   14673 main.go:141] libmachine: (kindnet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:35.680712   14673 main.go:141] libmachine: (kindnet-094000) DBG | hyperkit pid from json: 0
	I0307 10:10:35.680738   14673 main.go:141] libmachine: (kindnet-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kindnet-094000/hyperkit.json: no such file or directory
	W0307 10:10:35.700570   14673 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:10:35.700585   14673 start.go:728] Will try again in 5 seconds ...
	I0307 10:10:40.700937   14673 start.go:360] acquireMachinesLock for kindnet-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:10:40.701102   14673 start.go:364] duration metric: took 140.927µs to acquireMachinesLock for "kindnet-094000"
	I0307 10:10:40.701127   14673 start.go:93] Provisioning new machine with config: &{Name:kindnet-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kindnet-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:10:40.701211   14673 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:10:40.724411   14673 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:10:40.724552   14673 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:40.724616   14673 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:10:40.734488   14673 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60260
	I0307 10:10:40.734859   14673 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:10:40.735217   14673 main.go:141] libmachine: Using API Version  1
	I0307 10:10:40.735241   14673 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:10:40.735441   14673 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:10:40.735542   14673 main.go:141] libmachine: (kindnet-094000) Calling .GetMachineName
	I0307 10:10:40.735625   14673 main.go:141] libmachine: (kindnet-094000) Calling .DriverName
	I0307 10:10:40.735728   14673 start.go:159] libmachine.API.Create for "kindnet-094000" (driver="hyperkit")
	I0307 10:10:40.735744   14673 client.go:168] LocalClient.Create starting
	I0307 10:10:40.735771   14673 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:10:40.735827   14673 main.go:141] libmachine: Decoding PEM data...
	I0307 10:10:40.735837   14673 main.go:141] libmachine: Parsing certificate...
	I0307 10:10:40.735879   14673 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:10:40.735914   14673 main.go:141] libmachine: Decoding PEM data...
	I0307 10:10:40.735930   14673 main.go:141] libmachine: Parsing certificate...
	I0307 10:10:40.735942   14673 main.go:141] libmachine: Running pre-create checks...
	I0307 10:10:40.735947   14673 main.go:141] libmachine: (kindnet-094000) Calling .PreCreateCheck
	I0307 10:10:40.736014   14673 main.go:141] libmachine: (kindnet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:40.736054   14673 main.go:141] libmachine: (kindnet-094000) Calling .GetConfigRaw
	I0307 10:10:40.736494   14673 main.go:141] libmachine: Creating machine...
	I0307 10:10:40.736503   14673 main.go:141] libmachine: (kindnet-094000) Calling .Create
	I0307 10:10:40.736590   14673 main.go:141] libmachine: (kindnet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:40.736716   14673 main.go:141] libmachine: (kindnet-094000) DBG | I0307 10:10:40.736580   14685 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:10:40.736755   14673 main.go:141] libmachine: (kindnet-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:10:40.914711   14673 main.go:141] libmachine: (kindnet-094000) DBG | I0307 10:10:40.914587   14685 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kindnet-094000/id_rsa...
	I0307 10:10:40.971028   14673 main.go:141] libmachine: (kindnet-094000) DBG | I0307 10:10:40.970962   14685 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kindnet-094000/kindnet-094000.rawdisk...
	I0307 10:10:40.971042   14673 main.go:141] libmachine: (kindnet-094000) DBG | Writing magic tar header
	I0307 10:10:40.971054   14673 main.go:141] libmachine: (kindnet-094000) DBG | Writing SSH key tar header
	I0307 10:10:40.971652   14673 main.go:141] libmachine: (kindnet-094000) DBG | I0307 10:10:40.971613   14685 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kindnet-094000 ...
	I0307 10:10:41.335088   14673 main.go:141] libmachine: (kindnet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:41.335110   14673 main.go:141] libmachine: (kindnet-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kindnet-094000/hyperkit.pid
	I0307 10:10:41.335164   14673 main.go:141] libmachine: (kindnet-094000) DBG | Using UUID 5a19c5f7-c8d4-49dc-b8b4-b557e42675a6
	I0307 10:10:41.372736   14673 main.go:141] libmachine: (kindnet-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:10:41.372811   14673 client.go:171] duration metric: took 637.049396ms to LocalClient.Create
	I0307 10:10:43.373351   14673 start.go:128] duration metric: took 2.672061694s to createHost
	I0307 10:10:43.373374   14673 start.go:83] releasing machines lock for "kindnet-094000", held for 2.672219341s
	W0307 10:10:43.373474   14673 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kindnet-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kindnet-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:10:43.415999   14673 out.go:177] 
	W0307 10:10:43.438860   14673 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:10:43.438933   14673 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:10:43.438949   14673 out.go:239] * Related issues:
	* Related issues:
	W0307 10:10:43.438993   14673 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:10:43.439017   14673 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:10:43.481843   14673 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/kindnet/Start (11.20s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (11.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p calico-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p calico-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=hyperkit : exit status 60 (11.288812094s)

                                                
                                                
-- stdout --
	* [calico-094000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "calico-094000" primary control-plane node in "calico-094000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "calico-094000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:10:49.689023   14831 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:10:49.689193   14831 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:10:49.689199   14831 out.go:304] Setting ErrFile to fd 2...
	I0307 10:10:49.689203   14831 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:10:49.689369   14831 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:10:49.690837   14831 out.go:298] Setting JSON to false
	I0307 10:10:49.714259   14831 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7820,"bootTime":1709827229,"procs":468,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:10:49.714347   14831 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:10:49.736890   14831 out.go:177] * [calico-094000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:10:49.777572   14831 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:10:49.777598   14831 notify.go:220] Checking for updates...
	I0307 10:10:49.799939   14831 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:10:49.841554   14831 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:10:49.862657   14831 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:10:49.883718   14831 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:10:49.904749   14831 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:10:49.926602   14831 config.go:182] Loaded profile config "cert-expiration-787000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:10:49.926784   14831 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:10:49.926954   14831 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:10:49.956689   14831 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:10:49.998843   14831 start.go:297] selected driver: hyperkit
	I0307 10:10:49.998868   14831 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:10:49.998887   14831 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:10:50.003322   14831 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:10:50.003422   14831 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:10:50.011207   14831 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:10:50.015221   14831 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:50.015244   14831 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:10:50.015280   14831 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:10:50.015503   14831 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:10:50.015556   14831 cni.go:84] Creating CNI manager for "calico"
	I0307 10:10:50.015565   14831 start_flags.go:319] Found "Calico" CNI - setting NetworkPlugin=cni
	I0307 10:10:50.015627   14831 start.go:340] cluster config:
	{Name:calico-094000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:calico-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunti
me:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSoc
k: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:10:50.015733   14831 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:10:50.057667   14831 out.go:177] * Starting "calico-094000" primary control-plane node in "calico-094000" cluster
	I0307 10:10:50.078622   14831 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:10:50.078664   14831 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:10:50.078680   14831 cache.go:56] Caching tarball of preloaded images
	I0307 10:10:50.078788   14831 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:10:50.078797   14831 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:10:50.078875   14831 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/calico-094000/config.json ...
	I0307 10:10:50.078892   14831 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/calico-094000/config.json: {Name:mk3820591fa867990649d9f798be046f08a27151 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:10:50.079207   14831 start.go:360] acquireMachinesLock for calico-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:10:50.079256   14831 start.go:364] duration metric: took 40.311µs to acquireMachinesLock for "calico-094000"
	I0307 10:10:50.079277   14831 start.go:93] Provisioning new machine with config: &{Name:calico-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:calico-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:10:50.079327   14831 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:10:50.100845   14831 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:10:50.101108   14831 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:50.101180   14831 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:10:50.110509   14831 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60336
	I0307 10:10:50.110885   14831 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:10:50.111313   14831 main.go:141] libmachine: Using API Version  1
	I0307 10:10:50.111321   14831 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:10:50.111529   14831 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:10:50.111628   14831 main.go:141] libmachine: (calico-094000) Calling .GetMachineName
	I0307 10:10:50.111719   14831 main.go:141] libmachine: (calico-094000) Calling .DriverName
	I0307 10:10:50.111814   14831 start.go:159] libmachine.API.Create for "calico-094000" (driver="hyperkit")
	I0307 10:10:50.111838   14831 client.go:168] LocalClient.Create starting
	I0307 10:10:50.111879   14831 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:10:50.111926   14831 main.go:141] libmachine: Decoding PEM data...
	I0307 10:10:50.111948   14831 main.go:141] libmachine: Parsing certificate...
	I0307 10:10:50.112002   14831 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:10:50.112040   14831 main.go:141] libmachine: Decoding PEM data...
	I0307 10:10:50.112052   14831 main.go:141] libmachine: Parsing certificate...
	I0307 10:10:50.112066   14831 main.go:141] libmachine: Running pre-create checks...
	I0307 10:10:50.112075   14831 main.go:141] libmachine: (calico-094000) Calling .PreCreateCheck
	I0307 10:10:50.112147   14831 main.go:141] libmachine: (calico-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:50.112378   14831 main.go:141] libmachine: (calico-094000) Calling .GetConfigRaw
	I0307 10:10:50.121875   14831 main.go:141] libmachine: Creating machine...
	I0307 10:10:50.121888   14831 main.go:141] libmachine: (calico-094000) Calling .Create
	I0307 10:10:50.122008   14831 main.go:141] libmachine: (calico-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:50.122132   14831 main.go:141] libmachine: (calico-094000) DBG | I0307 10:10:50.121995   14839 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:10:50.122174   14831 main.go:141] libmachine: (calico-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:10:50.297456   14831 main.go:141] libmachine: (calico-094000) DBG | I0307 10:10:50.297375   14839 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/calico-094000/id_rsa...
	I0307 10:10:50.337037   14831 main.go:141] libmachine: (calico-094000) DBG | I0307 10:10:50.336962   14839 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/calico-094000/calico-094000.rawdisk...
	I0307 10:10:50.337053   14831 main.go:141] libmachine: (calico-094000) DBG | Writing magic tar header
	I0307 10:10:50.337061   14831 main.go:141] libmachine: (calico-094000) DBG | Writing SSH key tar header
	I0307 10:10:50.337502   14831 main.go:141] libmachine: (calico-094000) DBG | I0307 10:10:50.337461   14839 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/calico-094000 ...
	I0307 10:10:50.699090   14831 main.go:141] libmachine: (calico-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:50.699110   14831 main.go:141] libmachine: (calico-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/calico-094000/hyperkit.pid
	I0307 10:10:50.699156   14831 main.go:141] libmachine: (calico-094000) DBG | Using UUID f7c07dc5-09ef-46d8-b866-62c405fd015b
	I0307 10:10:50.741619   14831 main.go:141] libmachine: (calico-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:10:50.741727   14831 client.go:171] duration metric: took 629.869758ms to LocalClient.Create
	I0307 10:10:52.744043   14831 start.go:128] duration metric: took 2.664643637s to createHost
	I0307 10:10:52.744090   14831 start.go:83] releasing machines lock for "calico-094000", held for 2.664784153s
	W0307 10:10:52.744125   14831 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:10:52.744806   14831 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:52.744869   14831 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:10:52.754748   14831 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60343
	I0307 10:10:52.755143   14831 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:10:52.755532   14831 main.go:141] libmachine: Using API Version  1
	I0307 10:10:52.755547   14831 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:10:52.755795   14831 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:10:52.756148   14831 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:52.756176   14831 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:10:52.764286   14831 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60347
	I0307 10:10:52.764670   14831 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:10:52.765009   14831 main.go:141] libmachine: Using API Version  1
	I0307 10:10:52.765030   14831 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:10:52.765253   14831 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:10:52.765351   14831 main.go:141] libmachine: (calico-094000) Calling .GetState
	I0307 10:10:52.765430   14831 main.go:141] libmachine: (calico-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:52.765450   14831 main.go:141] libmachine: (calico-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/calico-094000/hyperkit.json: no such file or directory
	I0307 10:10:52.765456   14831 main.go:141] libmachine: (calico-094000) DBG | hyperkit pid from json: 0
	I0307 10:10:52.765518   14831 main.go:141] libmachine: (calico-094000) Calling .DriverName
	I0307 10:10:52.820625   14831 out.go:177] * Deleting "calico-094000" in hyperkit ...
	I0307 10:10:52.862494   14831 main.go:141] libmachine: (calico-094000) Calling .Remove
	I0307 10:10:52.862816   14831 main.go:141] libmachine: (calico-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:52.862838   14831 main.go:141] libmachine: (calico-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:52.862862   14831 main.go:141] libmachine: (calico-094000) DBG | hyperkit pid from json: 0
	I0307 10:10:52.862888   14831 main.go:141] libmachine: (calico-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/calico-094000/hyperkit.json: no such file or directory
	W0307 10:10:52.881909   14831 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:10:52.881927   14831 start.go:728] Will try again in 5 seconds ...
	I0307 10:10:57.884134   14831 start.go:360] acquireMachinesLock for calico-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:10:57.884360   14831 start.go:364] duration metric: took 142.586µs to acquireMachinesLock for "calico-094000"
	I0307 10:10:57.884417   14831 start.go:93] Provisioning new machine with config: &{Name:calico-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:calico-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:10:57.884534   14831 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:10:57.906215   14831 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:10:57.906360   14831 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:10:57.906401   14831 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:10:57.915627   14831 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60349
	I0307 10:10:57.915981   14831 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:10:57.916370   14831 main.go:141] libmachine: Using API Version  1
	I0307 10:10:57.916383   14831 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:10:57.916634   14831 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:10:57.916743   14831 main.go:141] libmachine: (calico-094000) Calling .GetMachineName
	I0307 10:10:57.916833   14831 main.go:141] libmachine: (calico-094000) Calling .DriverName
	I0307 10:10:57.916939   14831 start.go:159] libmachine.API.Create for "calico-094000" (driver="hyperkit")
	I0307 10:10:57.916956   14831 client.go:168] LocalClient.Create starting
	I0307 10:10:57.916993   14831 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:10:57.917040   14831 main.go:141] libmachine: Decoding PEM data...
	I0307 10:10:57.917051   14831 main.go:141] libmachine: Parsing certificate...
	I0307 10:10:57.917096   14831 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:10:57.917131   14831 main.go:141] libmachine: Decoding PEM data...
	I0307 10:10:57.917145   14831 main.go:141] libmachine: Parsing certificate...
	I0307 10:10:57.917159   14831 main.go:141] libmachine: Running pre-create checks...
	I0307 10:10:57.917172   14831 main.go:141] libmachine: (calico-094000) Calling .PreCreateCheck
	I0307 10:10:57.917243   14831 main.go:141] libmachine: (calico-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:57.917265   14831 main.go:141] libmachine: (calico-094000) Calling .GetConfigRaw
	I0307 10:10:57.917685   14831 main.go:141] libmachine: Creating machine...
	I0307 10:10:57.917693   14831 main.go:141] libmachine: (calico-094000) Calling .Create
	I0307 10:10:57.917770   14831 main.go:141] libmachine: (calico-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:57.917886   14831 main.go:141] libmachine: (calico-094000) DBG | I0307 10:10:57.917759   14858 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:10:57.917932   14831 main.go:141] libmachine: (calico-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:10:58.095759   14831 main.go:141] libmachine: (calico-094000) DBG | I0307 10:10:58.095700   14858 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/calico-094000/id_rsa...
	I0307 10:10:58.219203   14831 main.go:141] libmachine: (calico-094000) DBG | I0307 10:10:58.219116   14858 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/calico-094000/calico-094000.rawdisk...
	I0307 10:10:58.219218   14831 main.go:141] libmachine: (calico-094000) DBG | Writing magic tar header
	I0307 10:10:58.219235   14831 main.go:141] libmachine: (calico-094000) DBG | Writing SSH key tar header
	I0307 10:10:58.220606   14831 main.go:141] libmachine: (calico-094000) DBG | I0307 10:10:58.220522   14858 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/calico-094000 ...
	I0307 10:10:58.582466   14831 main.go:141] libmachine: (calico-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:10:58.582486   14831 main.go:141] libmachine: (calico-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/calico-094000/hyperkit.pid
	I0307 10:10:58.582527   14831 main.go:141] libmachine: (calico-094000) DBG | Using UUID b5cb4aaf-a56f-4648-b453-db34b39958f5
	I0307 10:10:58.620663   14831 main.go:141] libmachine: (calico-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:10:58.620748   14831 client.go:171] duration metric: took 703.773994ms to LocalClient.Create
	I0307 10:11:00.621264   14831 start.go:128] duration metric: took 2.736669407s to createHost
	I0307 10:11:00.621293   14831 start.go:83] releasing machines lock for "calico-094000", held for 2.736850881s
	W0307 10:11:00.621404   14831 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p calico-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p calico-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:11:00.664750   14831 out.go:177] 
	W0307 10:11:00.728676   14831 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:11:00.728766   14831 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:11:00.728782   14831 out.go:239] * Related issues:
	* Related issues:
	W0307 10:11:00.728814   14831 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:11:00.728834   14831 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:11:00.770748   14831 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/calico/Start (11.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (12.4s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p custom-flannel-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p custom-flannel-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=hyperkit : exit status 60 (12.394303126s)

                                                
                                                
-- stdout --
	* [custom-flannel-094000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "custom-flannel-094000" primary control-plane node in "custom-flannel-094000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "custom-flannel-094000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:11:01.456594   14883 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:11:01.456778   14883 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:11:01.456784   14883 out.go:304] Setting ErrFile to fd 2...
	I0307 10:11:01.456787   14883 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:11:01.456991   14883 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:11:01.458606   14883 out.go:298] Setting JSON to false
	I0307 10:11:01.482438   14883 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7832,"bootTime":1709827229,"procs":439,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:11:01.482557   14883 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:11:01.503501   14883 out.go:177] * [custom-flannel-094000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:11:01.567287   14883 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:11:01.545725   14883 notify.go:220] Checking for updates...
	I0307 10:11:01.630298   14883 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:11:01.693486   14883 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:11:01.735228   14883 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:11:01.757391   14883 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:01.799436   14883 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:11:01.820913   14883 config.go:182] Loaded profile config "calico-094000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:11:01.821112   14883 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:11:01.821283   14883 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:11:01.862343   14883 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:11:01.904588   14883 start.go:297] selected driver: hyperkit
	I0307 10:11:01.904613   14883 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:11:01.904633   14883 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:11:01.909069   14883 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:11:01.909185   14883 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:11:01.917034   14883 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:11:01.920841   14883 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:01.920875   14883 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:11:01.920914   14883 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:11:01.921105   14883 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:11:01.921168   14883 cni.go:84] Creating CNI manager for "testdata/kube-flannel.yaml"
	I0307 10:11:01.921208   14883 start_flags.go:319] Found "testdata/kube-flannel.yaml" CNI - setting NetworkPlugin=cni
	I0307 10:11:01.921283   14883 start.go:340] cluster config:
	{Name:custom-flannel-094000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loca
l ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: S
ocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:11:01.921362   14883 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:11:01.967264   14883 out.go:177] * Starting "custom-flannel-094000" primary control-plane node in "custom-flannel-094000" cluster
	I0307 10:11:01.988309   14883 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:11:01.988350   14883 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:11:01.988365   14883 cache.go:56] Caching tarball of preloaded images
	I0307 10:11:01.988485   14883 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:11:01.988494   14883 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:11:01.988583   14883 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/custom-flannel-094000/config.json ...
	I0307 10:11:01.988600   14883 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/custom-flannel-094000/config.json: {Name:mkf5937b014e827b21765cc2d956c952d45ac9e6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:11:01.988932   14883 start.go:360] acquireMachinesLock for custom-flannel-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:11:01.988989   14883 start.go:364] duration metric: took 41.412µs to acquireMachinesLock for "custom-flannel-094000"
	I0307 10:11:01.989011   14883 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mou
ntMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:11:01.989063   14883 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:11:02.010370   14883 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:11:02.010534   14883 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:02.010575   14883 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:02.018740   14883 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60367
	I0307 10:11:02.019113   14883 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:02.019562   14883 main.go:141] libmachine: Using API Version  1
	I0307 10:11:02.019575   14883 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:02.019842   14883 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:02.019957   14883 main.go:141] libmachine: (custom-flannel-094000) Calling .GetMachineName
	I0307 10:11:02.020058   14883 main.go:141] libmachine: (custom-flannel-094000) Calling .DriverName
	I0307 10:11:02.020162   14883 start.go:159] libmachine.API.Create for "custom-flannel-094000" (driver="hyperkit")
	I0307 10:11:02.020189   14883 client.go:168] LocalClient.Create starting
	I0307 10:11:02.020224   14883 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:11:02.020274   14883 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:02.020298   14883 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:02.020350   14883 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:11:02.020387   14883 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:02.020399   14883 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:02.020412   14883 main.go:141] libmachine: Running pre-create checks...
	I0307 10:11:02.020427   14883 main.go:141] libmachine: (custom-flannel-094000) Calling .PreCreateCheck
	I0307 10:11:02.020506   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:02.020722   14883 main.go:141] libmachine: (custom-flannel-094000) Calling .GetConfigRaw
	I0307 10:11:02.031593   14883 main.go:141] libmachine: Creating machine...
	I0307 10:11:02.031605   14883 main.go:141] libmachine: (custom-flannel-094000) Calling .Create
	I0307 10:11:02.031740   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:02.031905   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | I0307 10:11:02.031721   14899 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:02.031980   14883 main.go:141] libmachine: (custom-flannel-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:11:02.405328   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | I0307 10:11:02.405242   14899 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/custom-flannel-094000/id_rsa...
	I0307 10:11:02.471736   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | I0307 10:11:02.471670   14899 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/custom-flannel-094000/custom-flannel-094000.rawdisk...
	I0307 10:11:02.471751   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | Writing magic tar header
	I0307 10:11:02.471762   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | Writing SSH key tar header
	I0307 10:11:02.472317   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | I0307 10:11:02.472278   14899 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/custom-flannel-094000 ...
	I0307 10:11:02.874076   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:02.874096   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/custom-flannel-094000/hyperkit.pid
	I0307 10:11:02.874129   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | Using UUID ddc118d6-8b43-4357-8967-89fc4dc98e1d
	I0307 10:11:03.030892   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:11:03.030984   14883 client.go:171] duration metric: took 1.010771074s to LocalClient.Create
	I0307 10:11:05.032854   14883 start.go:128] duration metric: took 3.043726528s to createHost
	I0307 10:11:05.032879   14883 start.go:83] releasing machines lock for "custom-flannel-094000", held for 3.0438341s
	W0307 10:11:05.032910   14883 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:11:05.033446   14883 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:05.033491   14883 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:05.042714   14883 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60399
	I0307 10:11:05.043080   14883 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:05.043466   14883 main.go:141] libmachine: Using API Version  1
	I0307 10:11:05.043496   14883 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:05.043742   14883 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:05.044118   14883 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:05.044143   14883 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:05.052187   14883 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60401
	I0307 10:11:05.052576   14883 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:05.052972   14883 main.go:141] libmachine: Using API Version  1
	I0307 10:11:05.052990   14883 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:05.053229   14883 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:05.053355   14883 main.go:141] libmachine: (custom-flannel-094000) Calling .GetState
	I0307 10:11:05.053441   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:05.053457   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | hyperkit pid from json: 0
	I0307 10:11:05.053468   14883 main.go:141] libmachine: (custom-flannel-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/custom-flannel-094000/hyperkit.json: no such file or directory
	I0307 10:11:05.053510   14883 main.go:141] libmachine: (custom-flannel-094000) Calling .DriverName
	I0307 10:11:05.095153   14883 out.go:177] * Deleting "custom-flannel-094000" in hyperkit ...
	I0307 10:11:05.116283   14883 main.go:141] libmachine: (custom-flannel-094000) Calling .Remove
	I0307 10:11:05.116586   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:05.116602   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:05.116670   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | hyperkit pid from json: 0
	I0307 10:11:05.116699   14883 main.go:141] libmachine: (custom-flannel-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/custom-flannel-094000/hyperkit.json: no such file or directory
	W0307 10:11:05.197969   14883 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:11:05.197987   14883 start.go:728] Will try again in 5 seconds ...
	I0307 10:11:10.199233   14883 start.go:360] acquireMachinesLock for custom-flannel-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:11:10.759471   14883 start.go:364] duration metric: took 560.167153ms to acquireMachinesLock for "custom-flannel-094000"
	I0307 10:11:10.759540   14883 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mou
ntMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:11:10.759649   14883 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:11:10.780096   14883 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:11:10.780161   14883 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:10.780184   14883 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:10.788059   14883 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60447
	I0307 10:11:10.788391   14883 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:10.788744   14883 main.go:141] libmachine: Using API Version  1
	I0307 10:11:10.788754   14883 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:10.788975   14883 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:10.789090   14883 main.go:141] libmachine: (custom-flannel-094000) Calling .GetMachineName
	I0307 10:11:10.789180   14883 main.go:141] libmachine: (custom-flannel-094000) Calling .DriverName
	I0307 10:11:10.789318   14883 start.go:159] libmachine.API.Create for "custom-flannel-094000" (driver="hyperkit")
	I0307 10:11:10.789336   14883 client.go:168] LocalClient.Create starting
	I0307 10:11:10.789363   14883 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:11:10.789400   14883 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:10.789412   14883 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:10.789457   14883 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:11:10.789482   14883 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:10.789495   14883 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:10.789523   14883 main.go:141] libmachine: Running pre-create checks...
	I0307 10:11:10.789529   14883 main.go:141] libmachine: (custom-flannel-094000) Calling .PreCreateCheck
	I0307 10:11:10.789602   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:10.789626   14883 main.go:141] libmachine: (custom-flannel-094000) Calling .GetConfigRaw
	I0307 10:11:10.823247   14883 main.go:141] libmachine: Creating machine...
	I0307 10:11:10.823272   14883 main.go:141] libmachine: (custom-flannel-094000) Calling .Create
	I0307 10:11:10.823529   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:10.823704   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | I0307 10:11:10.823484   15040 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:10.823789   14883 main.go:141] libmachine: (custom-flannel-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:11:11.052862   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | I0307 10:11:11.052789   15040 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/custom-flannel-094000/id_rsa...
	I0307 10:11:11.147842   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | I0307 10:11:11.147764   15040 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/custom-flannel-094000/custom-flannel-094000.rawdisk...
	I0307 10:11:11.147868   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | Writing magic tar header
	I0307 10:11:11.147885   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | Writing SSH key tar header
	I0307 10:11:11.148709   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | I0307 10:11:11.148614   15040 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/custom-flannel-094000 ...
	I0307 10:11:11.574613   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:11.574635   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/custom-flannel-094000/hyperkit.pid
	I0307 10:11:11.574676   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | Using UUID 20012090-dbb3-4c42-b62e-48778544dc39
	I0307 10:11:11.611203   14883 main.go:141] libmachine: (custom-flannel-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:11:11.611285   14883 client.go:171] duration metric: took 821.92956ms to LocalClient.Create
	I0307 10:11:13.613530   14883 start.go:128] duration metric: took 2.8537987s to createHost
	I0307 10:11:13.613590   14883 start.go:83] releasing machines lock for "custom-flannel-094000", held for 2.854024587s
	W0307 10:11:13.613690   14883 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p custom-flannel-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p custom-flannel-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:11:13.659067   14883 out.go:177] 
	W0307 10:11:13.682267   14883 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:11:13.682337   14883 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:11:13.682354   14883 out.go:239] * Related issues:
	* Related issues:
	W0307 10:11:13.682414   14883 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:11:13.682524   14883 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:11:13.725106   14883 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/custom-flannel/Start (12.40s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Start (11.42s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p false-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p false-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=hyperkit : exit status 60 (11.414414558s)

                                                
                                                
-- stdout --
	* [false-094000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "false-094000" primary control-plane node in "false-094000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "false-094000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:11:07.618498   15028 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:11:07.618772   15028 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:11:07.618778   15028 out.go:304] Setting ErrFile to fd 2...
	I0307 10:11:07.618782   15028 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:11:07.618944   15028 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:11:07.620381   15028 out.go:298] Setting JSON to false
	I0307 10:11:07.643022   15028 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7838,"bootTime":1709827229,"procs":478,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:11:07.643125   15028 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:11:07.665264   15028 out.go:177] * [false-094000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:11:07.706262   15028 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:11:07.706386   15028 notify.go:220] Checking for updates...
	I0307 10:11:07.749265   15028 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:11:07.791283   15028 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:11:07.835049   15028 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:11:07.878455   15028 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:07.901188   15028 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:11:07.922695   15028 config.go:182] Loaded profile config "custom-flannel-094000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:11:07.922792   15028 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:11:07.922883   15028 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:11:07.952533   15028 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:11:07.994316   15028 start.go:297] selected driver: hyperkit
	I0307 10:11:07.994344   15028 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:11:07.994363   15028 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:11:07.998690   15028 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:11:07.998797   15028 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:11:08.006723   15028 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:11:08.010613   15028 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:08.010635   15028 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:11:08.010669   15028 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:11:08.010865   15028 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:11:08.010927   15028 cni.go:84] Creating CNI manager for "false"
	I0307 10:11:08.010997   15028 start.go:340] cluster config:
	{Name:false-094000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:false-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSH
AgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:11:08.011088   15028 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:11:08.053053   15028 out.go:177] * Starting "false-094000" primary control-plane node in "false-094000" cluster
	I0307 10:11:08.074305   15028 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:11:08.074362   15028 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:11:08.074383   15028 cache.go:56] Caching tarball of preloaded images
	I0307 10:11:08.074545   15028 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:11:08.074558   15028 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:11:08.074672   15028 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/false-094000/config.json ...
	I0307 10:11:08.074701   15028 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/false-094000/config.json: {Name:mkfdfc8943206eb563f6d9f15435088f04af915a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:11:08.075257   15028 start.go:360] acquireMachinesLock for false-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:11:08.075358   15028 start.go:364] duration metric: took 80.478µs to acquireMachinesLock for "false-094000"
	I0307 10:11:08.075394   15028 start.go:93] Provisioning new machine with config: &{Name:false-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Ku
bernetesVersion:v1.28.4 ClusterName:false-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0
MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:11:08.075463   15028 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:11:08.096289   15028 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:11:08.096534   15028 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:08.096627   15028 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:08.105002   15028 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60441
	I0307 10:11:08.105364   15028 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:08.105787   15028 main.go:141] libmachine: Using API Version  1
	I0307 10:11:08.105797   15028 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:08.106021   15028 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:08.106123   15028 main.go:141] libmachine: (false-094000) Calling .GetMachineName
	I0307 10:11:08.106205   15028 main.go:141] libmachine: (false-094000) Calling .DriverName
	I0307 10:11:08.106309   15028 start.go:159] libmachine.API.Create for "false-094000" (driver="hyperkit")
	I0307 10:11:08.106334   15028 client.go:168] LocalClient.Create starting
	I0307 10:11:08.106364   15028 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:11:08.106411   15028 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:08.106434   15028 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:08.106489   15028 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:11:08.106531   15028 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:08.106542   15028 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:08.106558   15028 main.go:141] libmachine: Running pre-create checks...
	I0307 10:11:08.106565   15028 main.go:141] libmachine: (false-094000) Calling .PreCreateCheck
	I0307 10:11:08.106644   15028 main.go:141] libmachine: (false-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:08.106818   15028 main.go:141] libmachine: (false-094000) Calling .GetConfigRaw
	I0307 10:11:08.117214   15028 main.go:141] libmachine: Creating machine...
	I0307 10:11:08.117226   15028 main.go:141] libmachine: (false-094000) Calling .Create
	I0307 10:11:08.117361   15028 main.go:141] libmachine: (false-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:08.117526   15028 main.go:141] libmachine: (false-094000) DBG | I0307 10:11:08.117335   15036 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:08.117604   15028 main.go:141] libmachine: (false-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:11:08.293961   15028 main.go:141] libmachine: (false-094000) DBG | I0307 10:11:08.293893   15036 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/false-094000/id_rsa...
	I0307 10:11:08.355031   15028 main.go:141] libmachine: (false-094000) DBG | I0307 10:11:08.354949   15036 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/false-094000/false-094000.rawdisk...
	I0307 10:11:08.355046   15028 main.go:141] libmachine: (false-094000) DBG | Writing magic tar header
	I0307 10:11:08.355054   15028 main.go:141] libmachine: (false-094000) DBG | Writing SSH key tar header
	I0307 10:11:08.355694   15028 main.go:141] libmachine: (false-094000) DBG | I0307 10:11:08.355617   15036 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/false-094000 ...
	I0307 10:11:08.718472   15028 main.go:141] libmachine: (false-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:08.718491   15028 main.go:141] libmachine: (false-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/false-094000/hyperkit.pid
	I0307 10:11:08.718507   15028 main.go:141] libmachine: (false-094000) DBG | Using UUID e9615860-6365-48e2-84d2-2a9e3fb25e4e
	I0307 10:11:08.757338   15028 main.go:141] libmachine: (false-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:11:08.757423   15028 client.go:171] duration metric: took 651.066884ms to LocalClient.Create
	I0307 10:11:10.759340   15028 start.go:128] duration metric: took 2.683816948s to createHost
	I0307 10:11:10.759367   15028 start.go:83] releasing machines lock for "false-094000", held for 2.683956102s
	W0307 10:11:10.759398   15028 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:11:10.760046   15028 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:10.760091   15028 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:10.769268   15028 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60443
	I0307 10:11:10.769596   15028 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:10.769987   15028 main.go:141] libmachine: Using API Version  1
	I0307 10:11:10.770003   15028 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:10.770229   15028 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:10.770591   15028 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:10.770620   15028 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:10.778422   15028 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60445
	I0307 10:11:10.778755   15028 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:10.779112   15028 main.go:141] libmachine: Using API Version  1
	I0307 10:11:10.779126   15028 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:10.779337   15028 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:10.779441   15028 main.go:141] libmachine: (false-094000) Calling .GetState
	I0307 10:11:10.779522   15028 main.go:141] libmachine: (false-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:10.779554   15028 main.go:141] libmachine: (false-094000) DBG | hyperkit pid from json: 0
	I0307 10:11:10.779569   15028 main.go:141] libmachine: (false-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/false-094000/hyperkit.json: no such file or directory
	I0307 10:11:10.779653   15028 main.go:141] libmachine: (false-094000) Calling .DriverName
	I0307 10:11:10.823171   15028 out.go:177] * Deleting "false-094000" in hyperkit ...
	I0307 10:11:10.844942   15028 main.go:141] libmachine: (false-094000) Calling .Remove
	I0307 10:11:10.845259   15028 main.go:141] libmachine: (false-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:10.845287   15028 main.go:141] libmachine: (false-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:10.845311   15028 main.go:141] libmachine: (false-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/false-094000/hyperkit.json: no such file or directory
	I0307 10:11:10.845323   15028 main.go:141] libmachine: (false-094000) DBG | hyperkit pid from json: 0
	W0307 10:11:10.863752   15028 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:11:10.863767   15028 start.go:728] Will try again in 5 seconds ...
	I0307 10:11:15.864584   15028 start.go:360] acquireMachinesLock for false-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:11:15.864687   15028 start.go:364] duration metric: took 70.391µs to acquireMachinesLock for "false-094000"
	I0307 10:11:15.864706   15028 start.go:93] Provisioning new machine with config: &{Name:false-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Ku
bernetesVersion:v1.28.4 ClusterName:false-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0
MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:11:15.864771   15028 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:11:15.945368   15028 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:11:15.945489   15028 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:15.945544   15028 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:15.954220   15028 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60469
	I0307 10:11:15.954581   15028 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:15.954941   15028 main.go:141] libmachine: Using API Version  1
	I0307 10:11:15.954958   15028 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:15.955197   15028 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:15.955304   15028 main.go:141] libmachine: (false-094000) Calling .GetMachineName
	I0307 10:11:15.955393   15028 main.go:141] libmachine: (false-094000) Calling .DriverName
	I0307 10:11:15.955490   15028 start.go:159] libmachine.API.Create for "false-094000" (driver="hyperkit")
	I0307 10:11:15.955509   15028 client.go:168] LocalClient.Create starting
	I0307 10:11:15.955542   15028 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:11:15.955589   15028 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:15.955600   15028 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:15.955641   15028 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:11:15.955677   15028 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:15.955693   15028 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:15.955706   15028 main.go:141] libmachine: Running pre-create checks...
	I0307 10:11:15.955712   15028 main.go:141] libmachine: (false-094000) Calling .PreCreateCheck
	I0307 10:11:15.955790   15028 main.go:141] libmachine: (false-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:15.955802   15028 main.go:141] libmachine: (false-094000) Calling .GetConfigRaw
	I0307 10:11:15.966627   15028 main.go:141] libmachine: Creating machine...
	I0307 10:11:15.966641   15028 main.go:141] libmachine: (false-094000) Calling .Create
	I0307 10:11:15.966764   15028 main.go:141] libmachine: (false-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:15.966927   15028 main.go:141] libmachine: (false-094000) DBG | I0307 10:11:15.966741   15100 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:15.967000   15028 main.go:141] libmachine: (false-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:11:16.147909   15028 main.go:141] libmachine: (false-094000) DBG | I0307 10:11:16.147847   15100 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/false-094000/id_rsa...
	I0307 10:11:16.180851   15028 main.go:141] libmachine: (false-094000) DBG | I0307 10:11:16.180786   15100 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/false-094000/false-094000.rawdisk...
	I0307 10:11:16.180870   15028 main.go:141] libmachine: (false-094000) DBG | Writing magic tar header
	I0307 10:11:16.180881   15028 main.go:141] libmachine: (false-094000) DBG | Writing SSH key tar header
	I0307 10:11:16.181269   15028 main.go:141] libmachine: (false-094000) DBG | I0307 10:11:16.181222   15100 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/false-094000 ...
	I0307 10:11:16.606046   15028 main.go:141] libmachine: (false-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:16.606063   15028 main.go:141] libmachine: (false-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/false-094000/hyperkit.pid
	I0307 10:11:16.606114   15028 main.go:141] libmachine: (false-094000) DBG | Using UUID b8b932d1-4e41-418e-9537-b1a68cb329af
	I0307 10:11:16.763028   15028 main.go:141] libmachine: (false-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:11:16.763108   15028 client.go:171] duration metric: took 807.579339ms to LocalClient.Create
	I0307 10:11:18.763229   15028 start.go:128] duration metric: took 2.898396505s to createHost
	I0307 10:11:18.763241   15028 start.go:83] releasing machines lock for "false-094000", held for 2.898501128s
	W0307 10:11:18.763297   15028 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p false-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p false-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:11:18.825774   15028 out.go:177] 
	W0307 10:11:18.867536   15028 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:11:18.867577   15028 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:11:18.867593   15028 out.go:239] * Related issues:
	* Related issues:
	W0307 10:11:18.867619   15028 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:11:18.867634   15028 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:11:18.909723   15028 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/false/Start (11.42s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (11.87s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p enable-default-cni-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p enable-default-cni-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=hyperkit : exit status 60 (11.864944497s)

                                                
                                                
-- stdout --
	* [enable-default-cni-094000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "enable-default-cni-094000" primary control-plane node in "enable-default-cni-094000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "enable-default-cni-094000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:11:20.593314   15229 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:11:20.593495   15229 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:11:20.593500   15229 out.go:304] Setting ErrFile to fd 2...
	I0307 10:11:20.593503   15229 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:11:20.593683   15229 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:11:20.595239   15229 out.go:298] Setting JSON to false
	I0307 10:11:20.618614   15229 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7851,"bootTime":1709827229,"procs":477,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:11:20.618726   15229 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:11:20.641966   15229 out.go:177] * [enable-default-cni-094000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:11:20.705891   15229 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:11:20.685324   15229 notify.go:220] Checking for updates...
	I0307 10:11:20.769854   15229 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:11:20.812067   15229 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:11:20.855287   15229 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:11:20.898994   15229 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:20.962032   15229 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:11:21.005106   15229 config.go:182] Loaded profile config "false-094000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:11:21.005304   15229 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:11:21.005469   15229 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:11:21.046050   15229 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:11:21.067056   15229 start.go:297] selected driver: hyperkit
	I0307 10:11:21.067072   15229 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:11:21.067083   15229 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:11:21.070270   15229 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:11:21.070377   15229 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:11:21.078663   15229 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:11:21.082648   15229 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:21.082688   15229 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:11:21.082728   15229 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	E0307 10:11:21.082909   15229 start_flags.go:464] Found deprecated --enable-default-cni flag, setting --cni=bridge
	I0307 10:11:21.082931   15229 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:11:21.082992   15229 cni.go:84] Creating CNI manager for "bridge"
	I0307 10:11:21.082999   15229 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 10:11:21.083078   15229 start.go:340] cluster config:
	{Name:enable-default-cni-094000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPa
th: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:11:21.083162   15229 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:11:21.103938   15229 out.go:177] * Starting "enable-default-cni-094000" primary control-plane node in "enable-default-cni-094000" cluster
	I0307 10:11:21.125224   15229 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:11:21.125328   15229 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:11:21.125368   15229 cache.go:56] Caching tarball of preloaded images
	I0307 10:11:21.125578   15229 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:11:21.125596   15229 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:11:21.125792   15229 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/enable-default-cni-094000/config.json ...
	I0307 10:11:21.125831   15229 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/enable-default-cni-094000/config.json: {Name:mkd236b8a92dfae717a2f0ec428249895194f7af Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:11:21.126487   15229 start.go:360] acquireMachinesLock for enable-default-cni-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:11:21.126607   15229 start.go:364] duration metric: took 84.002µs to acquireMachinesLock for "enable-default-cni-094000"
	I0307 10:11:21.126650   15229 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:11:21.126742   15229 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:11:21.148186   15229 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:11:21.148450   15229 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:21.148512   15229 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:21.158076   15229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60545
	I0307 10:11:21.158506   15229 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:21.158936   15229 main.go:141] libmachine: Using API Version  1
	I0307 10:11:21.158945   15229 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:21.159180   15229 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:21.159287   15229 main.go:141] libmachine: (enable-default-cni-094000) Calling .GetMachineName
	I0307 10:11:21.159375   15229 main.go:141] libmachine: (enable-default-cni-094000) Calling .DriverName
	I0307 10:11:21.159479   15229 start.go:159] libmachine.API.Create for "enable-default-cni-094000" (driver="hyperkit")
	I0307 10:11:21.159509   15229 client.go:168] LocalClient.Create starting
	I0307 10:11:21.159545   15229 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:11:21.159593   15229 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:21.159611   15229 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:21.159663   15229 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:11:21.159698   15229 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:21.159710   15229 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:21.159722   15229 main.go:141] libmachine: Running pre-create checks...
	I0307 10:11:21.159732   15229 main.go:141] libmachine: (enable-default-cni-094000) Calling .PreCreateCheck
	I0307 10:11:21.159819   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:21.159990   15229 main.go:141] libmachine: (enable-default-cni-094000) Calling .GetConfigRaw
	I0307 10:11:21.169861   15229 main.go:141] libmachine: Creating machine...
	I0307 10:11:21.169887   15229 main.go:141] libmachine: (enable-default-cni-094000) Calling .Create
	I0307 10:11:21.170120   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:21.170388   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | I0307 10:11:21.170088   15246 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:21.170496   15229 main.go:141] libmachine: (enable-default-cni-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:11:21.630590   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | I0307 10:11:21.630521   15246 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/enable-default-cni-094000/id_rsa...
	I0307 10:11:21.707062   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | I0307 10:11:21.706976   15246 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/enable-default-cni-094000/enable-default-cni-094000.rawdisk...
	I0307 10:11:21.707076   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | Writing magic tar header
	I0307 10:11:21.707087   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | Writing SSH key tar header
	I0307 10:11:21.707608   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | I0307 10:11:21.707566   15246 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/enable-default-cni-094000 ...
	I0307 10:11:22.090320   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:22.090343   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/enable-default-cni-094000/hyperkit.pid
	I0307 10:11:22.090417   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | Using UUID fe56cf24-fc61-439f-b224-190db3ba0708
	I0307 10:11:22.249137   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:11:22.249209   15229 client.go:171] duration metric: took 1.089675258s to LocalClient.Create
	I0307 10:11:24.249658   15229 start.go:128] duration metric: took 3.122847129s to createHost
	I0307 10:11:24.249687   15229 start.go:83] releasing machines lock for "enable-default-cni-094000", held for 3.123017992s
	W0307 10:11:24.249725   15229 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:11:24.250304   15229 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:24.250366   15229 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:24.259272   15229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60585
	I0307 10:11:24.259651   15229 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:24.260001   15229 main.go:141] libmachine: Using API Version  1
	I0307 10:11:24.260011   15229 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:24.260257   15229 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:24.260637   15229 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:24.260660   15229 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:24.268903   15229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60587
	I0307 10:11:24.269269   15229 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:24.269641   15229 main.go:141] libmachine: Using API Version  1
	I0307 10:11:24.269660   15229 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:24.269885   15229 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:24.269989   15229 main.go:141] libmachine: (enable-default-cni-094000) Calling .GetState
	I0307 10:11:24.270075   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:24.270095   15229 main.go:141] libmachine: (enable-default-cni-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/enable-default-cni-094000/hyperkit.json: no such file or directory
	I0307 10:11:24.270106   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | hyperkit pid from json: 0
	I0307 10:11:24.270132   15229 main.go:141] libmachine: (enable-default-cni-094000) Calling .DriverName
	I0307 10:11:24.311709   15229 out.go:177] * Deleting "enable-default-cni-094000" in hyperkit ...
	I0307 10:11:24.332971   15229 main.go:141] libmachine: (enable-default-cni-094000) Calling .Remove
	I0307 10:11:24.333384   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:24.333409   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:24.333425   15229 main.go:141] libmachine: (enable-default-cni-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/enable-default-cni-094000/hyperkit.json: no such file or directory
	I0307 10:11:24.333580   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | hyperkit pid from json: 0
	W0307 10:11:24.412433   15229 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:11:24.412450   15229 start.go:728] Will try again in 5 seconds ...
	I0307 10:11:29.413556   15229 start.go:360] acquireMachinesLock for enable-default-cni-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:11:29.413725   15229 start.go:364] duration metric: took 137.212µs to acquireMachinesLock for "enable-default-cni-094000"
	I0307 10:11:29.413771   15229 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:11:29.413902   15229 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:11:29.455739   15229 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:11:29.455888   15229 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:29.455934   15229 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:29.465557   15229 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60615
	I0307 10:11:29.465957   15229 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:29.466284   15229 main.go:141] libmachine: Using API Version  1
	I0307 10:11:29.466293   15229 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:29.466523   15229 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:29.466631   15229 main.go:141] libmachine: (enable-default-cni-094000) Calling .GetMachineName
	I0307 10:11:29.466719   15229 main.go:141] libmachine: (enable-default-cni-094000) Calling .DriverName
	I0307 10:11:29.466838   15229 start.go:159] libmachine.API.Create for "enable-default-cni-094000" (driver="hyperkit")
	I0307 10:11:29.466867   15229 client.go:168] LocalClient.Create starting
	I0307 10:11:29.466899   15229 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:11:29.466950   15229 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:29.466962   15229 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:29.467011   15229 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:11:29.467046   15229 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:29.467057   15229 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:29.467069   15229 main.go:141] libmachine: Running pre-create checks...
	I0307 10:11:29.467075   15229 main.go:141] libmachine: (enable-default-cni-094000) Calling .PreCreateCheck
	I0307 10:11:29.467153   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:29.467179   15229 main.go:141] libmachine: (enable-default-cni-094000) Calling .GetConfigRaw
	I0307 10:11:29.467738   15229 main.go:141] libmachine: Creating machine...
	I0307 10:11:29.467746   15229 main.go:141] libmachine: (enable-default-cni-094000) Calling .Create
	I0307 10:11:29.467818   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:29.467929   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | I0307 10:11:29.467807   15354 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:29.467972   15229 main.go:141] libmachine: (enable-default-cni-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:11:29.645836   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | I0307 10:11:29.645770   15354 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/enable-default-cni-094000/id_rsa...
	I0307 10:11:29.776740   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | I0307 10:11:29.776654   15354 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/enable-default-cni-094000/enable-default-cni-094000.rawdisk...
	I0307 10:11:29.776754   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | Writing magic tar header
	I0307 10:11:29.776773   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | Writing SSH key tar header
	I0307 10:11:29.777497   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | I0307 10:11:29.777439   15354 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/enable-default-cni-094000 ...
	I0307 10:11:30.187052   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:30.187072   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/enable-default-cni-094000/hyperkit.pid
	I0307 10:11:30.187099   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | Using UUID 3c258984-11ef-4815-b5b3-67d8d1223054
	I0307 10:11:30.224990   15229 main.go:141] libmachine: (enable-default-cni-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:11:30.225078   15229 client.go:171] duration metric: took 758.191778ms to LocalClient.Create
	I0307 10:11:32.225229   15229 start.go:128] duration metric: took 2.811265788s to createHost
	I0307 10:11:32.225247   15229 start.go:83] releasing machines lock for "enable-default-cni-094000", held for 2.811464752s
	W0307 10:11:32.225367   15229 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p enable-default-cni-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p enable-default-cni-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:11:32.266728   15229 out.go:177] 
	W0307 10:11:32.288876   15229 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:11:32.288965   15229 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:11:32.289032   15229 out.go:239] * Related issues:
	* Related issues:
	W0307 10:11:32.289089   15229 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:11:32.289120   15229 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:11:32.331569   15229 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/enable-default-cni/Start (11.87s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (11.65s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p flannel-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p flannel-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=hyperkit : exit status 60 (11.65229438s)

                                                
                                                
-- stdout --
	* [flannel-094000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "flannel-094000" primary control-plane node in "flannel-094000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "flannel-094000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:11:25.527523   15342 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:11:25.528124   15342 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:11:25.528195   15342 out.go:304] Setting ErrFile to fd 2...
	I0307 10:11:25.528207   15342 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:11:25.528891   15342 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:11:25.530492   15342 out.go:298] Setting JSON to false
	I0307 10:11:25.553331   15342 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7856,"bootTime":1709827229,"procs":501,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:11:25.553432   15342 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:11:25.577591   15342 out.go:177] * [flannel-094000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:11:25.640558   15342 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:11:25.618600   15342 notify.go:220] Checking for updates...
	I0307 10:11:25.661457   15342 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:11:25.682355   15342 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:11:25.703314   15342 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:11:25.724465   15342 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:25.745606   15342 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:11:25.767443   15342 config.go:182] Loaded profile config "enable-default-cni-094000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:11:25.767686   15342 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:11:25.767871   15342 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:11:25.797504   15342 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:11:25.839427   15342 start.go:297] selected driver: hyperkit
	I0307 10:11:25.839452   15342 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:11:25.839488   15342 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:11:25.843916   15342 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:11:25.844015   15342 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:11:25.851877   15342 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:11:25.855654   15342 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:25.855676   15342 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:11:25.855713   15342 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:11:25.855936   15342 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:11:25.855992   15342 cni.go:84] Creating CNI manager for "flannel"
	I0307 10:11:25.856006   15342 start_flags.go:319] Found "Flannel" CNI - setting NetworkPlugin=cni
	I0307 10:11:25.856074   15342 start.go:340] cluster config:
	{Name:flannel-094000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:flannel-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:11:25.856165   15342 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:11:25.877382   15342 out.go:177] * Starting "flannel-094000" primary control-plane node in "flannel-094000" cluster
	I0307 10:11:25.898356   15342 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:11:25.898430   15342 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:11:25.898459   15342 cache.go:56] Caching tarball of preloaded images
	I0307 10:11:25.898652   15342 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:11:25.898671   15342 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:11:25.898817   15342 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/flannel-094000/config.json ...
	I0307 10:11:25.898855   15342 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/flannel-094000/config.json: {Name:mk43f7a9633559ff0191559f86120212b9352af9 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:11:25.899576   15342 start.go:360] acquireMachinesLock for flannel-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:11:25.899695   15342 start.go:364] duration metric: took 95.851µs to acquireMachinesLock for "flannel-094000"
	I0307 10:11:25.899741   15342 start.go:93] Provisioning new machine with config: &{Name:flannel-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:flannel-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:11:25.899831   15342 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:11:25.921450   15342 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:11:25.921665   15342 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:25.921721   15342 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:25.930332   15342 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60609
	I0307 10:11:25.930717   15342 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:25.931175   15342 main.go:141] libmachine: Using API Version  1
	I0307 10:11:25.931184   15342 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:25.931439   15342 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:25.931570   15342 main.go:141] libmachine: (flannel-094000) Calling .GetMachineName
	I0307 10:11:25.931655   15342 main.go:141] libmachine: (flannel-094000) Calling .DriverName
	I0307 10:11:25.931757   15342 start.go:159] libmachine.API.Create for "flannel-094000" (driver="hyperkit")
	I0307 10:11:25.931780   15342 client.go:168] LocalClient.Create starting
	I0307 10:11:25.931813   15342 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:11:25.931865   15342 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:25.931882   15342 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:25.931935   15342 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:11:25.931970   15342 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:25.931981   15342 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:25.931992   15342 main.go:141] libmachine: Running pre-create checks...
	I0307 10:11:25.932002   15342 main.go:141] libmachine: (flannel-094000) Calling .PreCreateCheck
	I0307 10:11:25.932068   15342 main.go:141] libmachine: (flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:25.932214   15342 main.go:141] libmachine: (flannel-094000) Calling .GetConfigRaw
	I0307 10:11:25.942553   15342 main.go:141] libmachine: Creating machine...
	I0307 10:11:25.942561   15342 main.go:141] libmachine: (flannel-094000) Calling .Create
	I0307 10:11:25.942638   15342 main.go:141] libmachine: (flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:25.942762   15342 main.go:141] libmachine: (flannel-094000) DBG | I0307 10:11:25.942629   15350 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:25.942815   15342 main.go:141] libmachine: (flannel-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:11:26.126325   15342 main.go:141] libmachine: (flannel-094000) DBG | I0307 10:11:26.126225   15350 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/flannel-094000/id_rsa...
	I0307 10:11:26.320014   15342 main.go:141] libmachine: (flannel-094000) DBG | I0307 10:11:26.319918   15350 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/flannel-094000/flannel-094000.rawdisk...
	I0307 10:11:26.320030   15342 main.go:141] libmachine: (flannel-094000) DBG | Writing magic tar header
	I0307 10:11:26.320040   15342 main.go:141] libmachine: (flannel-094000) DBG | Writing SSH key tar header
	I0307 10:11:26.320774   15342 main.go:141] libmachine: (flannel-094000) DBG | I0307 10:11:26.320711   15350 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/flannel-094000 ...
	I0307 10:11:26.680848   15342 main.go:141] libmachine: (flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:26.680871   15342 main.go:141] libmachine: (flannel-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/flannel-094000/hyperkit.pid
	I0307 10:11:26.680974   15342 main.go:141] libmachine: (flannel-094000) DBG | Using UUID c42441ef-50ba-4ff7-ab74-66f6b4a507e2
	I0307 10:11:26.715901   15342 main.go:141] libmachine: (flannel-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:11:26.715983   15342 client.go:171] duration metric: took 784.183095ms to LocalClient.Create
	I0307 10:11:28.717359   15342 start.go:128] duration metric: took 2.817463478s to createHost
	I0307 10:11:28.717384   15342 start.go:83] releasing machines lock for "flannel-094000", held for 2.81763268s
	W0307 10:11:28.717415   15342 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:11:28.717985   15342 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:28.718024   15342 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:28.727723   15342 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60611
	I0307 10:11:28.728288   15342 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:28.728618   15342 main.go:141] libmachine: Using API Version  1
	I0307 10:11:28.728628   15342 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:28.728869   15342 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:28.729221   15342 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:28.729246   15342 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:28.736987   15342 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60613
	I0307 10:11:28.737321   15342 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:28.737655   15342 main.go:141] libmachine: Using API Version  1
	I0307 10:11:28.737665   15342 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:28.737872   15342 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:28.737980   15342 main.go:141] libmachine: (flannel-094000) Calling .GetState
	I0307 10:11:28.738056   15342 main.go:141] libmachine: (flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:28.738102   15342 main.go:141] libmachine: (flannel-094000) DBG | hyperkit pid from json: 0
	I0307 10:11:28.738115   15342 main.go:141] libmachine: (flannel-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/flannel-094000/hyperkit.json: no such file or directory
	I0307 10:11:28.738118   15342 main.go:141] libmachine: (flannel-094000) Calling .DriverName
	I0307 10:11:28.771822   15342 out.go:177] * Deleting "flannel-094000" in hyperkit ...
	I0307 10:11:28.793558   15342 main.go:141] libmachine: (flannel-094000) Calling .Remove
	I0307 10:11:28.793760   15342 main.go:141] libmachine: (flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:28.793772   15342 main.go:141] libmachine: (flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:28.793781   15342 main.go:141] libmachine: (flannel-094000) DBG | hyperkit pid from json: 0
	I0307 10:11:28.793838   15342 main.go:141] libmachine: (flannel-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/flannel-094000/hyperkit.json: no such file or directory
	W0307 10:11:28.811525   15342 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:11:28.811537   15342 start.go:728] Will try again in 5 seconds ...
	I0307 10:11:33.812752   15342 start.go:360] acquireMachinesLock for flannel-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:11:33.812838   15342 start.go:364] duration metric: took 62.896µs to acquireMachinesLock for "flannel-094000"
	I0307 10:11:33.812862   15342 start.go:93] Provisioning new machine with config: &{Name:flannel-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:flannel-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:11:33.812941   15342 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:11:33.834425   15342 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:11:33.834520   15342 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:33.834571   15342 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:33.842917   15342 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60627
	I0307 10:11:33.843289   15342 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:33.843864   15342 main.go:141] libmachine: Using API Version  1
	I0307 10:11:33.843878   15342 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:33.844092   15342 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:33.844194   15342 main.go:141] libmachine: (flannel-094000) Calling .GetMachineName
	I0307 10:11:33.844260   15342 main.go:141] libmachine: (flannel-094000) Calling .DriverName
	I0307 10:11:33.844357   15342 start.go:159] libmachine.API.Create for "flannel-094000" (driver="hyperkit")
	I0307 10:11:33.844395   15342 client.go:168] LocalClient.Create starting
	I0307 10:11:33.844424   15342 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:11:33.844464   15342 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:33.844476   15342 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:33.844515   15342 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:11:33.844539   15342 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:33.844558   15342 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:33.844575   15342 main.go:141] libmachine: Running pre-create checks...
	I0307 10:11:33.844580   15342 main.go:141] libmachine: (flannel-094000) Calling .PreCreateCheck
	I0307 10:11:33.844658   15342 main.go:141] libmachine: (flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:33.844697   15342 main.go:141] libmachine: (flannel-094000) Calling .GetConfigRaw
	I0307 10:11:33.855666   15342 main.go:141] libmachine: Creating machine...
	I0307 10:11:33.855679   15342 main.go:141] libmachine: (flannel-094000) Calling .Create
	I0307 10:11:33.855818   15342 main.go:141] libmachine: (flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:33.855967   15342 main.go:141] libmachine: (flannel-094000) DBG | I0307 10:11:33.855812   15397 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:33.856025   15342 main.go:141] libmachine: (flannel-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:11:34.237094   15342 main.go:141] libmachine: (flannel-094000) DBG | I0307 10:11:34.237043   15397 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/flannel-094000/id_rsa...
	I0307 10:11:34.417056   15342 main.go:141] libmachine: (flannel-094000) DBG | I0307 10:11:34.416960   15397 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/flannel-094000/flannel-094000.rawdisk...
	I0307 10:11:34.417083   15342 main.go:141] libmachine: (flannel-094000) DBG | Writing magic tar header
	I0307 10:11:34.417120   15342 main.go:141] libmachine: (flannel-094000) DBG | Writing SSH key tar header
	I0307 10:11:34.474277   15342 main.go:141] libmachine: (flannel-094000) DBG | I0307 10:11:34.474224   15397 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/flannel-094000 ...
	I0307 10:11:34.944039   15342 main.go:141] libmachine: (flannel-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:34.944055   15342 main.go:141] libmachine: (flannel-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/flannel-094000/hyperkit.pid
	I0307 10:11:34.944076   15342 main.go:141] libmachine: (flannel-094000) DBG | Using UUID 48951ba4-acdf-4efe-8e38-0e0241cc05b0
	I0307 10:11:34.982528   15342 main.go:141] libmachine: (flannel-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:11:34.982678   15342 client.go:171] duration metric: took 1.138258382s to LocalClient.Create
	I0307 10:11:36.982834   15342 start.go:128] duration metric: took 3.169818418s to createHost
	I0307 10:11:36.982850   15342 start.go:83] releasing machines lock for "flannel-094000", held for 3.16995541s
	W0307 10:11:36.982929   15342 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p flannel-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p flannel-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:11:37.013802   15342 out.go:177] 
	W0307 10:11:37.035053   15342 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:11:37.035089   15342 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:11:37.035097   15342 out.go:239] * Related issues:
	* Related issues:
	W0307 10:11:37.035108   15342 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:11:37.035116   15342 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:11:37.055999   15342 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/flannel/Start (11.65s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (11.82s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p bridge-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p bridge-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=hyperkit : exit status 60 (11.814011256s)

                                                
                                                
-- stdout --
	* [bridge-094000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "bridge-094000" primary control-plane node in "bridge-094000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "bridge-094000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:11:38.686112   15532 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:11:38.686303   15532 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:11:38.686308   15532 out.go:304] Setting ErrFile to fd 2...
	I0307 10:11:38.686311   15532 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:11:38.686826   15532 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:11:38.689240   15532 out.go:298] Setting JSON to false
	I0307 10:11:38.713585   15532 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7869,"bootTime":1709827229,"procs":481,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:11:38.713703   15532 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:11:38.736043   15532 out.go:177] * [bridge-094000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:11:38.799993   15532 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:11:38.778355   15532 notify.go:220] Checking for updates...
	I0307 10:11:38.883934   15532 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:11:38.904905   15532 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:11:38.926019   15532 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:11:38.967966   15532 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:39.010301   15532 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:11:39.052756   15532 config.go:182] Loaded profile config "flannel-094000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:11:39.052892   15532 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:11:39.053006   15532 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:11:39.115294   15532 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:11:39.177954   15532 start.go:297] selected driver: hyperkit
	I0307 10:11:39.177974   15532 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:11:39.177984   15532 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:11:39.181095   15532 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:11:39.181204   15532 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:11:39.189632   15532 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:11:39.194122   15532 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:39.194158   15532 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:11:39.194198   15532 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:11:39.194424   15532 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:11:39.194491   15532 cni.go:84] Creating CNI manager for "bridge"
	I0307 10:11:39.194498   15532 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 10:11:39.194573   15532 start.go:340] cluster config:
	{Name:bridge-094000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:bridge-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunti
me:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSoc
k: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:11:39.194661   15532 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:11:39.236957   15532 out.go:177] * Starting "bridge-094000" primary control-plane node in "bridge-094000" cluster
	I0307 10:11:39.258098   15532 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:11:39.258151   15532 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:11:39.258168   15532 cache.go:56] Caching tarball of preloaded images
	I0307 10:11:39.258272   15532 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:11:39.258280   15532 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:11:39.258356   15532 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/bridge-094000/config.json ...
	I0307 10:11:39.258373   15532 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/bridge-094000/config.json: {Name:mk378f64702c122358fd132f77f3df09636c5672 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:11:39.258655   15532 start.go:360] acquireMachinesLock for bridge-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:11:39.258703   15532 start.go:364] duration metric: took 38.55µs to acquireMachinesLock for "bridge-094000"
	I0307 10:11:39.258724   15532 start.go:93] Provisioning new machine with config: &{Name:bridge-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:bridge-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:11:39.258774   15532 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:11:39.280188   15532 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:11:39.280420   15532 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:39.280484   15532 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:39.289688   15532 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60709
	I0307 10:11:39.290065   15532 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:39.290480   15532 main.go:141] libmachine: Using API Version  1
	I0307 10:11:39.290498   15532 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:39.290731   15532 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:39.290843   15532 main.go:141] libmachine: (bridge-094000) Calling .GetMachineName
	I0307 10:11:39.290926   15532 main.go:141] libmachine: (bridge-094000) Calling .DriverName
	I0307 10:11:39.291029   15532 start.go:159] libmachine.API.Create for "bridge-094000" (driver="hyperkit")
	I0307 10:11:39.291055   15532 client.go:168] LocalClient.Create starting
	I0307 10:11:39.291089   15532 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:11:39.291136   15532 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:39.291155   15532 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:39.291218   15532 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:11:39.291260   15532 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:39.291271   15532 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:39.291300   15532 main.go:141] libmachine: Running pre-create checks...
	I0307 10:11:39.291309   15532 main.go:141] libmachine: (bridge-094000) Calling .PreCreateCheck
	I0307 10:11:39.291385   15532 main.go:141] libmachine: (bridge-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:39.291517   15532 main.go:141] libmachine: (bridge-094000) Calling .GetConfigRaw
	I0307 10:11:39.322483   15532 main.go:141] libmachine: Creating machine...
	I0307 10:11:39.322504   15532 main.go:141] libmachine: (bridge-094000) Calling .Create
	I0307 10:11:39.322775   15532 main.go:141] libmachine: (bridge-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:39.323088   15532 main.go:141] libmachine: (bridge-094000) DBG | I0307 10:11:39.322741   15549 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:39.323209   15532 main.go:141] libmachine: (bridge-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:11:39.773825   15532 main.go:141] libmachine: (bridge-094000) DBG | I0307 10:11:39.773721   15549 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/bridge-094000/id_rsa...
	I0307 10:11:39.866326   15532 main.go:141] libmachine: (bridge-094000) DBG | I0307 10:11:39.866258   15549 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/bridge-094000/bridge-094000.rawdisk...
	I0307 10:11:39.866343   15532 main.go:141] libmachine: (bridge-094000) DBG | Writing magic tar header
	I0307 10:11:39.866362   15532 main.go:141] libmachine: (bridge-094000) DBG | Writing SSH key tar header
	I0307 10:11:39.866940   15532 main.go:141] libmachine: (bridge-094000) DBG | I0307 10:11:39.866901   15549 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/bridge-094000 ...
	I0307 10:11:40.280449   15532 main.go:141] libmachine: (bridge-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:40.280476   15532 main.go:141] libmachine: (bridge-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/bridge-094000/hyperkit.pid
	I0307 10:11:40.280489   15532 main.go:141] libmachine: (bridge-094000) DBG | Using UUID 87a99cc1-c3e7-42bb-83c4-2b42d1799fae
	I0307 10:11:40.322225   15532 main.go:141] libmachine: (bridge-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:11:40.322267   15532 client.go:171] duration metric: took 1.031185373s to LocalClient.Create
	I0307 10:11:42.322865   15532 start.go:128] duration metric: took 3.064033258s to createHost
	I0307 10:11:42.322895   15532 start.go:83] releasing machines lock for "bridge-094000", held for 3.064137302s
	W0307 10:11:42.322911   15532 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:11:42.323229   15532 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:42.323258   15532 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:42.331566   15532 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60745
	I0307 10:11:42.332086   15532 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:42.332463   15532 main.go:141] libmachine: Using API Version  1
	I0307 10:11:42.332475   15532 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:42.332708   15532 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:42.333071   15532 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:42.333093   15532 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:42.341325   15532 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60747
	I0307 10:11:42.341704   15532 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:42.342070   15532 main.go:141] libmachine: Using API Version  1
	I0307 10:11:42.342079   15532 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:42.342269   15532 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:42.342358   15532 main.go:141] libmachine: (bridge-094000) Calling .GetState
	I0307 10:11:42.342439   15532 main.go:141] libmachine: (bridge-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:42.342481   15532 main.go:141] libmachine: (bridge-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/bridge-094000/hyperkit.json: no such file or directory
	I0307 10:11:42.342493   15532 main.go:141] libmachine: (bridge-094000) DBG | hyperkit pid from json: 0
	I0307 10:11:42.342545   15532 main.go:141] libmachine: (bridge-094000) Calling .DriverName
	I0307 10:11:42.384991   15532 out.go:177] * Deleting "bridge-094000" in hyperkit ...
	I0307 10:11:42.405766   15532 main.go:141] libmachine: (bridge-094000) Calling .Remove
	I0307 10:11:42.405939   15532 main.go:141] libmachine: (bridge-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:42.405973   15532 main.go:141] libmachine: (bridge-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/bridge-094000/hyperkit.json: no such file or directory
	I0307 10:11:42.405982   15532 main.go:141] libmachine: (bridge-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:42.405991   15532 main.go:141] libmachine: (bridge-094000) DBG | hyperkit pid from json: 0
	W0307 10:11:42.494490   15532 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:11:42.494510   15532 start.go:728] Will try again in 5 seconds ...
	I0307 10:11:47.496491   15532 start.go:360] acquireMachinesLock for bridge-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:11:47.496673   15532 start.go:364] duration metric: took 149.719µs to acquireMachinesLock for "bridge-094000"
	I0307 10:11:47.496717   15532 start.go:93] Provisioning new machine with config: &{Name:bridge-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:bridge-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:11:47.496837   15532 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:11:47.539289   15532 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:11:47.539442   15532 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:47.539487   15532 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:47.549367   15532 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60783
	I0307 10:11:47.549747   15532 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:47.550082   15532 main.go:141] libmachine: Using API Version  1
	I0307 10:11:47.550092   15532 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:47.550306   15532 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:47.550410   15532 main.go:141] libmachine: (bridge-094000) Calling .GetMachineName
	I0307 10:11:47.550500   15532 main.go:141] libmachine: (bridge-094000) Calling .DriverName
	I0307 10:11:47.550596   15532 start.go:159] libmachine.API.Create for "bridge-094000" (driver="hyperkit")
	I0307 10:11:47.550614   15532 client.go:168] LocalClient.Create starting
	I0307 10:11:47.550643   15532 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:11:47.550691   15532 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:47.550707   15532 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:47.550747   15532 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:11:47.550785   15532 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:47.550803   15532 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:47.550819   15532 main.go:141] libmachine: Running pre-create checks...
	I0307 10:11:47.550825   15532 main.go:141] libmachine: (bridge-094000) Calling .PreCreateCheck
	I0307 10:11:47.550906   15532 main.go:141] libmachine: (bridge-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:47.550955   15532 main.go:141] libmachine: (bridge-094000) Calling .GetConfigRaw
	I0307 10:11:47.551549   15532 main.go:141] libmachine: Creating machine...
	I0307 10:11:47.551558   15532 main.go:141] libmachine: (bridge-094000) Calling .Create
	I0307 10:11:47.551628   15532 main.go:141] libmachine: (bridge-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:47.551743   15532 main.go:141] libmachine: (bridge-094000) DBG | I0307 10:11:47.551617   15671 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:47.551797   15532 main.go:141] libmachine: (bridge-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:11:47.732338   15532 main.go:141] libmachine: (bridge-094000) DBG | I0307 10:11:47.732278   15671 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/bridge-094000/id_rsa...
	I0307 10:11:47.907987   15532 main.go:141] libmachine: (bridge-094000) DBG | I0307 10:11:47.907874   15671 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/bridge-094000/bridge-094000.rawdisk...
	I0307 10:11:47.908012   15532 main.go:141] libmachine: (bridge-094000) DBG | Writing magic tar header
	I0307 10:11:47.908026   15532 main.go:141] libmachine: (bridge-094000) DBG | Writing SSH key tar header
	I0307 10:11:47.908577   15532 main.go:141] libmachine: (bridge-094000) DBG | I0307 10:11:47.908538   15671 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/bridge-094000 ...
	I0307 10:11:48.271286   15532 main.go:141] libmachine: (bridge-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:48.271304   15532 main.go:141] libmachine: (bridge-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/bridge-094000/hyperkit.pid
	I0307 10:11:48.271350   15532 main.go:141] libmachine: (bridge-094000) DBG | Using UUID 7c209b05-f433-4e32-ab9a-f55cc0bbd864
	I0307 10:11:48.309341   15532 main.go:141] libmachine: (bridge-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:11:48.309428   15532 client.go:171] duration metric: took 758.79544ms to LocalClient.Create
	I0307 10:11:50.309801   15532 start.go:128] duration metric: took 2.812900789s to createHost
	I0307 10:11:50.309831   15532 start.go:83] releasing machines lock for "bridge-094000", held for 2.813100788s
	W0307 10:11:50.309922   15532 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p bridge-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p bridge-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:11:50.331419   15532 out.go:177] 
	W0307 10:11:50.353312   15532 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:11:50.353376   15532 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:11:50.353399   15532 out.go:239] * Related issues:
	* Related issues:
	W0307 10:11:50.353430   15532 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:11:50.353484   15532 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:11:50.375215   15532 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/bridge/Start (11.82s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Start (11.44s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p kubenet-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubenet-094000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=hyperkit : exit status 60 (11.434076831s)

                                                
                                                
-- stdout --
	* [kubenet-094000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "kubenet-094000" primary control-plane node in "kubenet-094000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "kubenet-094000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:11:44.192897   15659 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:11:44.193149   15659 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:11:44.193154   15659 out.go:304] Setting ErrFile to fd 2...
	I0307 10:11:44.193158   15659 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:11:44.193347   15659 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:11:44.194842   15659 out.go:298] Setting JSON to false
	I0307 10:11:44.217183   15659 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7875,"bootTime":1709827229,"procs":503,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:11:44.217277   15659 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:11:44.240910   15659 out.go:177] * [kubenet-094000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:11:44.282835   15659 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:11:44.282935   15659 notify.go:220] Checking for updates...
	I0307 10:11:44.326625   15659 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:11:44.349738   15659 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:11:44.371094   15659 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:11:44.392680   15659 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:44.413938   15659 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:11:44.435472   15659 config.go:182] Loaded profile config "bridge-094000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:11:44.435606   15659 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:11:44.435703   15659 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:11:44.463636   15659 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:11:44.505914   15659 start.go:297] selected driver: hyperkit
	I0307 10:11:44.505933   15659 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:11:44.505947   15659 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:11:44.509834   15659 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:11:44.509957   15659 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:11:44.517707   15659 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:11:44.521614   15659 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:44.521636   15659 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:11:44.521670   15659 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:11:44.521870   15659 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:11:44.521934   15659 cni.go:80] network plugin configured as "kubenet", returning disabled
	I0307 10:11:44.522011   15659 start.go:340] cluster config:
	{Name:kubenet-094000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:kubenet-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSoc
k: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:11:44.522101   15659 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:11:44.542782   15659 out.go:177] * Starting "kubenet-094000" primary control-plane node in "kubenet-094000" cluster
	I0307 10:11:44.584948   15659 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:11:44.585033   15659 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:11:44.585058   15659 cache.go:56] Caching tarball of preloaded images
	I0307 10:11:44.585202   15659 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:11:44.585216   15659 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:11:44.585348   15659 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/kubenet-094000/config.json ...
	I0307 10:11:44.585377   15659 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/kubenet-094000/config.json: {Name:mkf5bd25ec606bb01b5304df2f8576830e3e2acc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:11:44.585927   15659 start.go:360] acquireMachinesLock for kubenet-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:11:44.586057   15659 start.go:364] duration metric: took 90.169µs to acquireMachinesLock for "kubenet-094000"
	I0307 10:11:44.586097   15659 start.go:93] Provisioning new machine with config: &{Name:kubenet-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kubenet-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:11:44.586160   15659 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:11:44.607640   15659 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:11:44.607953   15659 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:44.608028   15659 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:44.617763   15659 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60777
	I0307 10:11:44.618157   15659 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:44.618582   15659 main.go:141] libmachine: Using API Version  1
	I0307 10:11:44.618594   15659 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:44.618818   15659 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:44.618925   15659 main.go:141] libmachine: (kubenet-094000) Calling .GetMachineName
	I0307 10:11:44.619023   15659 main.go:141] libmachine: (kubenet-094000) Calling .DriverName
	I0307 10:11:44.619131   15659 start.go:159] libmachine.API.Create for "kubenet-094000" (driver="hyperkit")
	I0307 10:11:44.619157   15659 client.go:168] LocalClient.Create starting
	I0307 10:11:44.619188   15659 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:11:44.619237   15659 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:44.619255   15659 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:44.619315   15659 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:11:44.619352   15659 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:44.619364   15659 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:44.619388   15659 main.go:141] libmachine: Running pre-create checks...
	I0307 10:11:44.619397   15659 main.go:141] libmachine: (kubenet-094000) Calling .PreCreateCheck
	I0307 10:11:44.619465   15659 main.go:141] libmachine: (kubenet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:44.619634   15659 main.go:141] libmachine: (kubenet-094000) Calling .GetConfigRaw
	I0307 10:11:44.628901   15659 main.go:141] libmachine: Creating machine...
	I0307 10:11:44.628914   15659 main.go:141] libmachine: (kubenet-094000) Calling .Create
	I0307 10:11:44.629046   15659 main.go:141] libmachine: (kubenet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:44.629212   15659 main.go:141] libmachine: (kubenet-094000) DBG | I0307 10:11:44.629024   15667 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:44.629268   15659 main.go:141] libmachine: (kubenet-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:11:44.804957   15659 main.go:141] libmachine: (kubenet-094000) DBG | I0307 10:11:44.804863   15667 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubenet-094000/id_rsa...
	I0307 10:11:44.920001   15659 main.go:141] libmachine: (kubenet-094000) DBG | I0307 10:11:44.919918   15667 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubenet-094000/kubenet-094000.rawdisk...
	I0307 10:11:44.920016   15659 main.go:141] libmachine: (kubenet-094000) DBG | Writing magic tar header
	I0307 10:11:44.920044   15659 main.go:141] libmachine: (kubenet-094000) DBG | Writing SSH key tar header
	I0307 10:11:44.920737   15659 main.go:141] libmachine: (kubenet-094000) DBG | I0307 10:11:44.920646   15667 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubenet-094000 ...
	I0307 10:11:45.283681   15659 main.go:141] libmachine: (kubenet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:45.283703   15659 main.go:141] libmachine: (kubenet-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubenet-094000/hyperkit.pid
	I0307 10:11:45.283759   15659 main.go:141] libmachine: (kubenet-094000) DBG | Using UUID 944e3ff7-b8a8-4a22-99fe-f35891134879
	I0307 10:11:45.321826   15659 main.go:141] libmachine: (kubenet-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:11:45.321916   15659 client.go:171] duration metric: took 702.739363ms to LocalClient.Create
	I0307 10:11:47.323202   15659 start.go:128] duration metric: took 2.736983809s to createHost
	I0307 10:11:47.323228   15659 start.go:83] releasing machines lock for "kubenet-094000", held for 2.737119957s
	W0307 10:11:47.323282   15659 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:11:47.323692   15659 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:47.323722   15659 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:47.332419   15659 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60779
	I0307 10:11:47.332839   15659 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:47.333233   15659 main.go:141] libmachine: Using API Version  1
	I0307 10:11:47.333250   15659 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:47.333470   15659 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:47.333820   15659 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:47.333852   15659 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:47.341837   15659 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60781
	I0307 10:11:47.342190   15659 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:47.342547   15659 main.go:141] libmachine: Using API Version  1
	I0307 10:11:47.342561   15659 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:47.342756   15659 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:47.342859   15659 main.go:141] libmachine: (kubenet-094000) Calling .GetState
	I0307 10:11:47.342944   15659 main.go:141] libmachine: (kubenet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:47.342988   15659 main.go:141] libmachine: (kubenet-094000) DBG | hyperkit pid from json: 0
	I0307 10:11:47.343009   15659 main.go:141] libmachine: (kubenet-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubenet-094000/hyperkit.json: no such file or directory
	I0307 10:11:47.343011   15659 main.go:141] libmachine: (kubenet-094000) Calling .DriverName
	I0307 10:11:47.396392   15659 out.go:177] * Deleting "kubenet-094000" in hyperkit ...
	I0307 10:11:47.419281   15659 main.go:141] libmachine: (kubenet-094000) Calling .Remove
	I0307 10:11:47.419514   15659 main.go:141] libmachine: (kubenet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:47.419553   15659 main.go:141] libmachine: (kubenet-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubenet-094000/hyperkit.json: no such file or directory
	I0307 10:11:47.419564   15659 main.go:141] libmachine: (kubenet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:47.419578   15659 main.go:141] libmachine: (kubenet-094000) DBG | hyperkit pid from json: 0
	W0307 10:11:47.437145   15659 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:11:47.437165   15659 start.go:728] Will try again in 5 seconds ...
	I0307 10:11:52.438519   15659 start.go:360] acquireMachinesLock for kubenet-094000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:11:52.438592   15659 start.go:364] duration metric: took 55.724µs to acquireMachinesLock for "kubenet-094000"
	I0307 10:11:52.438612   15659 start.go:93] Provisioning new machine with config: &{Name:kubenet-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kubenet-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:11:52.438686   15659 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:11:52.480010   15659 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 10:11:52.480117   15659 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:52.480168   15659 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:52.488932   15659 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60803
	I0307 10:11:52.489355   15659 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:52.489753   15659 main.go:141] libmachine: Using API Version  1
	I0307 10:11:52.489766   15659 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:52.489982   15659 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:52.490099   15659 main.go:141] libmachine: (kubenet-094000) Calling .GetMachineName
	I0307 10:11:52.490230   15659 main.go:141] libmachine: (kubenet-094000) Calling .DriverName
	I0307 10:11:52.490357   15659 start.go:159] libmachine.API.Create for "kubenet-094000" (driver="hyperkit")
	I0307 10:11:52.490397   15659 client.go:168] LocalClient.Create starting
	I0307 10:11:52.490429   15659 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:11:52.490468   15659 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:52.490487   15659 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:52.490538   15659 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:11:52.490569   15659 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:52.490580   15659 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:52.490597   15659 main.go:141] libmachine: Running pre-create checks...
	I0307 10:11:52.490605   15659 main.go:141] libmachine: (kubenet-094000) Calling .PreCreateCheck
	I0307 10:11:52.490694   15659 main.go:141] libmachine: (kubenet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:52.490722   15659 main.go:141] libmachine: (kubenet-094000) Calling .GetConfigRaw
	I0307 10:11:52.491199   15659 main.go:141] libmachine: Creating machine...
	I0307 10:11:52.491208   15659 main.go:141] libmachine: (kubenet-094000) Calling .Create
	I0307 10:11:52.491302   15659 main.go:141] libmachine: (kubenet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:52.491432   15659 main.go:141] libmachine: (kubenet-094000) DBG | I0307 10:11:52.491292   15722 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:52.491478   15659 main.go:141] libmachine: (kubenet-094000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:11:52.761357   15659 main.go:141] libmachine: (kubenet-094000) DBG | I0307 10:11:52.761279   15722 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubenet-094000/id_rsa...
	I0307 10:11:52.851646   15659 main.go:141] libmachine: (kubenet-094000) DBG | I0307 10:11:52.851539   15722 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubenet-094000/kubenet-094000.rawdisk...
	I0307 10:11:52.851664   15659 main.go:141] libmachine: (kubenet-094000) DBG | Writing magic tar header
	I0307 10:11:52.851673   15659 main.go:141] libmachine: (kubenet-094000) DBG | Writing SSH key tar header
	I0307 10:11:52.852656   15659 main.go:141] libmachine: (kubenet-094000) DBG | I0307 10:11:52.852580   15722 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubenet-094000 ...
	I0307 10:11:53.248353   15659 main.go:141] libmachine: (kubenet-094000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:53.248371   15659 main.go:141] libmachine: (kubenet-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/kubenet-094000/hyperkit.pid
	I0307 10:11:53.248433   15659 main.go:141] libmachine: (kubenet-094000) DBG | Using UUID 1ea273c4-175a-4db4-9d43-5658346b7b62
	I0307 10:11:53.404691   15659 main.go:141] libmachine: (kubenet-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:11:53.404770   15659 client.go:171] duration metric: took 914.352123ms to LocalClient.Create
	I0307 10:11:55.405418   15659 start.go:128] duration metric: took 2.966658621s to createHost
	I0307 10:11:55.405448   15659 start.go:83] releasing machines lock for "kubenet-094000", held for 2.966801223s
	W0307 10:11:55.405583   15659 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubenet-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubenet-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:11:55.460515   15659 out.go:177] 
	W0307 10:11:55.481611   15659 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:11:55.481640   15659 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:11:55.481652   15659 out.go:239] * Related issues:
	* Related issues:
	W0307 10:11:55.481669   15659 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:11:55.481680   15659 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:11:55.502569   15659 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/kubenet/Start (11.44s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (11.88s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p old-k8s-version-169000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-169000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0: exit status 60 (11.808605936s)

                                                
                                                
-- stdout --
	* [old-k8s-version-169000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "old-k8s-version-169000" primary control-plane node in "old-k8s-version-169000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "old-k8s-version-169000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:11:56.746629   15831 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:11:56.746884   15831 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:11:56.746891   15831 out.go:304] Setting ErrFile to fd 2...
	I0307 10:11:56.746897   15831 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:11:56.747952   15831 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:11:56.750058   15831 out.go:298] Setting JSON to false
	I0307 10:11:56.773401   15831 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7887,"bootTime":1709827229,"procs":477,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:11:56.773529   15831 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:11:56.795288   15831 out.go:177] * [old-k8s-version-169000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:11:56.860448   15831 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:11:56.837439   15831 notify.go:220] Checking for updates...
	I0307 10:11:56.946367   15831 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:11:56.988492   15831 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:11:57.010246   15831 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:11:57.031185   15831 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:57.052486   15831 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:11:57.078618   15831 config.go:182] Loaded profile config "kubenet-094000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:11:57.078716   15831 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:11:57.078804   15831 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:11:57.107834   15831 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:11:57.150109   15831 start.go:297] selected driver: hyperkit
	I0307 10:11:57.150125   15831 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:11:57.150136   15831 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:11:57.153271   15831 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:11:57.153379   15831 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:11:57.161610   15831 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:11:57.165546   15831 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:57.165583   15831 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:11:57.165624   15831 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:11:57.165826   15831 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:11:57.165889   15831 cni.go:84] Creating CNI manager for ""
	I0307 10:11:57.165907   15831 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0307 10:11:57.165976   15831 start.go:340] cluster config:
	{Name:old-k8s-version-169000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-169000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loc
al ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSH
AuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:11:57.166064   15831 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:11:57.207988   15831 out.go:177] * Starting "old-k8s-version-169000" primary control-plane node in "old-k8s-version-169000" cluster
	I0307 10:11:57.229005   15831 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0307 10:11:57.229048   15831 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0307 10:11:57.229063   15831 cache.go:56] Caching tarball of preloaded images
	I0307 10:11:57.229167   15831 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:11:57.229177   15831 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0307 10:11:57.229273   15831 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/old-k8s-version-169000/config.json ...
	I0307 10:11:57.229290   15831 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/old-k8s-version-169000/config.json: {Name:mk904b1401f28f3d138acb4d92e60476afddd7f7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:11:57.229595   15831 start.go:360] acquireMachinesLock for old-k8s-version-169000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:11:57.229649   15831 start.go:364] duration metric: took 40.105µs to acquireMachinesLock for "old-k8s-version-169000"
	I0307 10:11:57.229670   15831 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-169000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-169000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:11:57.229718   15831 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:11:57.271959   15831 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:11:57.272143   15831 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:11:57.272181   15831 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:11:57.280444   15831 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60871
	I0307 10:11:57.280861   15831 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:11:57.281274   15831 main.go:141] libmachine: Using API Version  1
	I0307 10:11:57.281284   15831 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:11:57.281520   15831 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:11:57.281640   15831 main.go:141] libmachine: (old-k8s-version-169000) Calling .GetMachineName
	I0307 10:11:57.281725   15831 main.go:141] libmachine: (old-k8s-version-169000) Calling .DriverName
	I0307 10:11:57.281829   15831 start.go:159] libmachine.API.Create for "old-k8s-version-169000" (driver="hyperkit")
	I0307 10:11:57.281857   15831 client.go:168] LocalClient.Create starting
	I0307 10:11:57.281890   15831 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:11:57.281940   15831 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:57.281957   15831 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:57.282018   15831 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:11:57.282055   15831 main.go:141] libmachine: Decoding PEM data...
	I0307 10:11:57.282066   15831 main.go:141] libmachine: Parsing certificate...
	I0307 10:11:57.282078   15831 main.go:141] libmachine: Running pre-create checks...
	I0307 10:11:57.282087   15831 main.go:141] libmachine: (old-k8s-version-169000) Calling .PreCreateCheck
	I0307 10:11:57.282165   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:57.282318   15831 main.go:141] libmachine: (old-k8s-version-169000) Calling .GetConfigRaw
	I0307 10:11:57.282799   15831 main.go:141] libmachine: Creating machine...
	I0307 10:11:57.282807   15831 main.go:141] libmachine: (old-k8s-version-169000) Calling .Create
	I0307 10:11:57.282878   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:57.282998   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | I0307 10:11:57.282869   15850 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:11:57.283060   15831 main.go:141] libmachine: (old-k8s-version-169000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:11:57.663834   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | I0307 10:11:57.663763   15850 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000/id_rsa...
	I0307 10:11:57.817481   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | I0307 10:11:57.817428   15850 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000/old-k8s-version-169000.rawdisk...
	I0307 10:11:57.817498   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | Writing magic tar header
	I0307 10:11:57.817517   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | Writing SSH key tar header
	I0307 10:11:57.817829   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | I0307 10:11:57.817790   15850 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000 ...
	I0307 10:11:58.182201   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:11:58.182217   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000/hyperkit.pid
	I0307 10:11:58.182263   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | Using UUID 04d6e822-224c-4e86-a567-cd3eb8131332
	I0307 10:11:58.223616   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:11:58.223712   15831 client.go:171] duration metric: took 941.830256ms to LocalClient.Create
	I0307 10:12:00.225187   15831 start.go:128] duration metric: took 2.995411204s to createHost
	I0307 10:12:00.225218   15831 start.go:83] releasing machines lock for "old-k8s-version-169000", held for 2.995505733s
	W0307 10:12:00.225235   15831 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:12:00.225524   15831 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:00.225550   15831 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:00.234162   15831 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60911
	I0307 10:12:00.234535   15831 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:00.234924   15831 main.go:141] libmachine: Using API Version  1
	I0307 10:12:00.234942   15831 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:00.235165   15831 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:00.235670   15831 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:00.235701   15831 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:00.244171   15831 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60913
	I0307 10:12:00.244551   15831 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:00.244890   15831 main.go:141] libmachine: Using API Version  1
	I0307 10:12:00.244899   15831 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:00.245158   15831 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:00.245345   15831 main.go:141] libmachine: (old-k8s-version-169000) Calling .GetState
	I0307 10:12:00.245576   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:00.245587   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | hyperkit pid from json: 0
	I0307 10:12:00.245595   15831 main.go:141] libmachine: (old-k8s-version-169000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000/hyperkit.json: no such file or directory
	I0307 10:12:00.245656   15831 main.go:141] libmachine: (old-k8s-version-169000) Calling .DriverName
	I0307 10:12:00.288343   15831 out.go:177] * Deleting "old-k8s-version-169000" in hyperkit ...
	I0307 10:12:00.309253   15831 main.go:141] libmachine: (old-k8s-version-169000) Calling .Remove
	I0307 10:12:00.309561   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:00.309597   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:00.309666   15831 main.go:141] libmachine: (old-k8s-version-169000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000/hyperkit.json: no such file or directory
	I0307 10:12:00.309680   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | hyperkit pid from json: 0
	W0307 10:12:00.408452   15831 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:00.408515   15831 start.go:728] Will try again in 5 seconds ...
	I0307 10:12:05.408695   15831 start.go:360] acquireMachinesLock for old-k8s-version-169000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:05.408772   15831 start.go:364] duration metric: took 57.075µs to acquireMachinesLock for "old-k8s-version-169000"
	I0307 10:12:05.408793   15831 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-169000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-169000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:12:05.408852   15831 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:12:05.432577   15831 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:12:05.432697   15831 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:05.432722   15831 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:05.440846   15831 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60955
	I0307 10:12:05.441198   15831 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:05.441531   15831 main.go:141] libmachine: Using API Version  1
	I0307 10:12:05.441545   15831 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:05.441781   15831 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:05.441881   15831 main.go:141] libmachine: (old-k8s-version-169000) Calling .GetMachineName
	I0307 10:12:05.441963   15831 main.go:141] libmachine: (old-k8s-version-169000) Calling .DriverName
	I0307 10:12:05.442057   15831 start.go:159] libmachine.API.Create for "old-k8s-version-169000" (driver="hyperkit")
	I0307 10:12:05.442076   15831 client.go:168] LocalClient.Create starting
	I0307 10:12:05.442112   15831 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:12:05.442154   15831 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:05.442167   15831 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:05.442219   15831 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:12:05.442245   15831 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:05.442262   15831 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:05.442279   15831 main.go:141] libmachine: Running pre-create checks...
	I0307 10:12:05.442287   15831 main.go:141] libmachine: (old-k8s-version-169000) Calling .PreCreateCheck
	I0307 10:12:05.442374   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:05.442420   15831 main.go:141] libmachine: (old-k8s-version-169000) Calling .GetConfigRaw
	I0307 10:12:05.494177   15831 main.go:141] libmachine: Creating machine...
	I0307 10:12:05.494191   15831 main.go:141] libmachine: (old-k8s-version-169000) Calling .Create
	I0307 10:12:05.494309   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:05.494533   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | I0307 10:12:05.494295   15997 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:05.494594   15831 main.go:141] libmachine: (old-k8s-version-169000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:12:05.723188   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | I0307 10:12:05.723133   15997 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000/id_rsa...
	I0307 10:12:05.912401   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | I0307 10:12:05.912343   15997 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000/old-k8s-version-169000.rawdisk...
	I0307 10:12:05.912418   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | Writing magic tar header
	I0307 10:12:05.912433   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | Writing SSH key tar header
	I0307 10:12:05.912905   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | I0307 10:12:05.912854   15997 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000 ...
	I0307 10:12:06.282659   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:06.282676   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000/hyperkit.pid
	I0307 10:12:06.282734   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | Using UUID 8f7091b8-4237-43f9-864d-fd7b7d1dc325
	I0307 10:12:06.319848   15831 main.go:141] libmachine: (old-k8s-version-169000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:06.319929   15831 client.go:171] duration metric: took 877.832834ms to LocalClient.Create
	I0307 10:12:08.320911   15831 start.go:128] duration metric: took 2.912000056s to createHost
	I0307 10:12:08.320924   15831 start.go:83] releasing machines lock for "old-k8s-version-169000", held for 2.912099495s
	W0307 10:12:08.320986   15831 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-169000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-169000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:08.368091   15831 out.go:177] 
	W0307 10:12:08.389137   15831 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:12:08.389213   15831 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:12:08.389282   15831 out.go:239] * Related issues:
	* Related issues:
	W0307 10:12:08.389309   15831 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:12:08.389328   15831 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:12:08.430856   15831 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-169000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000: exit status 7 (73.625898ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-169000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (11.88s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (11.73s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p no-preload-947000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p no-preload-947000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (11.653597806s)

                                                
                                                
-- stdout --
	* [no-preload-947000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "no-preload-947000" primary control-plane node in "no-preload-947000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "no-preload-947000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:12:01.968635   15954 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:12:01.969395   15954 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:01.969403   15954 out.go:304] Setting ErrFile to fd 2...
	I0307 10:12:01.969409   15954 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:01.970001   15954 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:12:01.971579   15954 out.go:298] Setting JSON to false
	I0307 10:12:01.994364   15954 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7892,"bootTime":1709827229,"procs":500,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:12:01.994466   15954 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:12:02.017348   15954 out.go:177] * [no-preload-947000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:12:02.059704   15954 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:12:02.059767   15954 notify.go:220] Checking for updates...
	I0307 10:12:02.102299   15954 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:12:02.144407   15954 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:12:02.165399   15954 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:12:02.186819   15954 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:02.208590   15954 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:12:02.230251   15954 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:12:02.230461   15954 config.go:182] Loaded profile config "old-k8s-version-169000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0307 10:12:02.230634   15954 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:12:02.260551   15954 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:12:02.302302   15954 start.go:297] selected driver: hyperkit
	I0307 10:12:02.302330   15954 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:12:02.302352   15954 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:12:02.306717   15954 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:02.306827   15954 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:12:02.314552   15954 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:12:02.318429   15954 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:02.318457   15954 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:12:02.318544   15954 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:12:02.318753   15954 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:12:02.318805   15954 cni.go:84] Creating CNI manager for ""
	I0307 10:12:02.318823   15954 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:12:02.318830   15954 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 10:12:02.318897   15954 start.go:340] cluster config:
	{Name:no-preload-947000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-947000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:
SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:12:02.318991   15954 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:02.361552   15954 out.go:177] * Starting "no-preload-947000" primary control-plane node in "no-preload-947000" cluster
	I0307 10:12:02.382409   15954 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 10:12:02.382629   15954 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/no-preload-947000/config.json ...
	I0307 10:12:02.382698   15954 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/no-preload-947000/config.json: {Name:mkeb0a83817059e157499b3a9be8d886b6525eff Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:12:02.382791   15954 cache.go:107] acquiring lock: {Name:mk23a88b2566792987733168dde9a45e7d23012e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:02.382791   15954 cache.go:107] acquiring lock: {Name:mkc9757fa9eeeec85e77ce3410a63e40eb4597d3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:02.382843   15954 cache.go:107] acquiring lock: {Name:mkb1387b8583968d6e804b7f8c523cdf39480b28 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:02.382978   15954 cache.go:107] acquiring lock: {Name:mk868de11d37377993d3dab9873a532f58539eec Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:02.383056   15954 cache.go:115] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0307 10:12:02.383096   15954 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 313.208µs
	I0307 10:12:02.383121   15954 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0307 10:12:02.383102   15954 cache.go:107] acquiring lock: {Name:mk397a13c843cb93391cfd8631e48a6e6dc63122 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:02.383145   15954 cache.go:107] acquiring lock: {Name:mk931badc67037ef28cd5ab03d04b614992a91b6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:02.383197   15954 cache.go:107] acquiring lock: {Name:mkb9165f8553e439174704686448d512d825e83f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:02.383225   15954 cache.go:107] acquiring lock: {Name:mk8eb2860ac623bcd7c811c959733be4eb0ad016 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:02.383323   15954 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
	I0307 10:12:02.383485   15954 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
	I0307 10:12:02.383703   15954 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
	I0307 10:12:02.383783   15954 start.go:360] acquireMachinesLock for no-preload-947000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:02.383847   15954 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.10-0
	I0307 10:12:02.383853   15954 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
	I0307 10:12:02.383941   15954 start.go:364] duration metric: took 128.218µs to acquireMachinesLock for "no-preload-947000"
	I0307 10:12:02.384007   15954 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.11.1
	I0307 10:12:02.384043   15954 image.go:134] retrieving image: registry.k8s.io/pause:3.9
	I0307 10:12:02.384027   15954 start.go:93] Provisioning new machine with config: &{Name:no-preload-947000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-947000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptio
ns:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:12:02.384174   15954 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:12:02.426472   15954 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:12:02.426749   15954 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:02.426797   15954 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:02.429480   15954 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.10-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.10-0
	I0307 10:12:02.429782   15954 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
	I0307 10:12:02.429849   15954 image.go:177] daemon lookup for registry.k8s.io/pause:3.9: Error response from daemon: No such image: registry.k8s.io/pause:3.9
	I0307 10:12:02.430398   15954 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.11.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.11.1
	I0307 10:12:02.431128   15954 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
	I0307 10:12:02.431145   15954 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
	I0307 10:12:02.431154   15954 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
	I0307 10:12:02.436412   15954 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60941
	I0307 10:12:02.436823   15954 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:02.437258   15954 main.go:141] libmachine: Using API Version  1
	I0307 10:12:02.437267   15954 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:02.437491   15954 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:02.437603   15954 main.go:141] libmachine: (no-preload-947000) Calling .GetMachineName
	I0307 10:12:02.437701   15954 main.go:141] libmachine: (no-preload-947000) Calling .DriverName
	I0307 10:12:02.437803   15954 start.go:159] libmachine.API.Create for "no-preload-947000" (driver="hyperkit")
	I0307 10:12:02.437831   15954 client.go:168] LocalClient.Create starting
	I0307 10:12:02.437866   15954 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:12:02.437917   15954 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:02.437933   15954 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:02.437993   15954 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:12:02.438029   15954 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:02.438041   15954 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:02.438053   15954 main.go:141] libmachine: Running pre-create checks...
	I0307 10:12:02.438062   15954 main.go:141] libmachine: (no-preload-947000) Calling .PreCreateCheck
	I0307 10:12:02.438146   15954 main.go:141] libmachine: (no-preload-947000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:02.438298   15954 main.go:141] libmachine: (no-preload-947000) Calling .GetConfigRaw
	I0307 10:12:02.438756   15954 main.go:141] libmachine: Creating machine...
	I0307 10:12:02.438765   15954 main.go:141] libmachine: (no-preload-947000) Calling .Create
	I0307 10:12:02.438852   15954 main.go:141] libmachine: (no-preload-947000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:02.438980   15954 main.go:141] libmachine: (no-preload-947000) DBG | I0307 10:12:02.438839   15964 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:02.439029   15954 main.go:141] libmachine: (no-preload-947000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:12:02.624568   15954 main.go:141] libmachine: (no-preload-947000) DBG | I0307 10:12:02.624439   15964 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000/id_rsa...
	I0307 10:12:02.830371   15954 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0
	I0307 10:12:02.832577   15954 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2
	I0307 10:12:02.862776   15954 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9
	I0307 10:12:02.910808   15954 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1
	I0307 10:12:02.929766   15954 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2
	I0307 10:12:02.988293   15954 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2
	I0307 10:12:02.988449   15954 cache.go:157] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 exists
	I0307 10:12:02.988465   15954 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9" took 605.360556ms
	I0307 10:12:02.988474   15954 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 succeeded
	I0307 10:12:02.994389   15954 main.go:141] libmachine: (no-preload-947000) DBG | I0307 10:12:02.994336   15964 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000/no-preload-947000.rawdisk...
	I0307 10:12:02.994407   15954 main.go:141] libmachine: (no-preload-947000) DBG | Writing magic tar header
	I0307 10:12:02.994419   15954 main.go:141] libmachine: (no-preload-947000) DBG | Writing SSH key tar header
	I0307 10:12:02.994757   15954 main.go:141] libmachine: (no-preload-947000) DBG | I0307 10:12:02.994724   15964 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000 ...
	I0307 10:12:03.039937   15954 cache.go:162] opening:  /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2
	I0307 10:12:03.353814   15954 main.go:141] libmachine: (no-preload-947000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:03.353829   15954 main.go:141] libmachine: (no-preload-947000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000/hyperkit.pid
	I0307 10:12:03.353877   15954 main.go:141] libmachine: (no-preload-947000) DBG | Using UUID 5f249547-9373-42b1-a13f-7203525a5427
	I0307 10:12:03.392137   15954 main.go:141] libmachine: (no-preload-947000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:03.392239   15954 client.go:171] duration metric: took 954.382558ms to LocalClient.Create
	I0307 10:12:05.392358   15954 start.go:128] duration metric: took 3.008118299s to createHost
	I0307 10:12:05.392375   15954 start.go:83] releasing machines lock for "no-preload-947000", held for 3.00836343s
	W0307 10:12:05.392395   15954 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:12:05.392758   15954 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:05.392786   15954 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:05.401168   15954 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60951
	I0307 10:12:05.401524   15954 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:05.401917   15954 main.go:141] libmachine: Using API Version  1
	I0307 10:12:05.401929   15954 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:05.402135   15954 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:05.402524   15954 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:05.402555   15954 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:05.422745   15954 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60953
	I0307 10:12:05.423109   15954 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:05.423441   15954 main.go:141] libmachine: Using API Version  1
	I0307 10:12:05.423453   15954 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:05.423706   15954 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:05.423826   15954 main.go:141] libmachine: (no-preload-947000) Calling .GetState
	I0307 10:12:05.423929   15954 main.go:141] libmachine: (no-preload-947000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:05.423954   15954 main.go:141] libmachine: (no-preload-947000) DBG | hyperkit pid from json: 0
	I0307 10:12:05.423971   15954 main.go:141] libmachine: (no-preload-947000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000/hyperkit.json: no such file or directory
	I0307 10:12:05.424054   15954 main.go:141] libmachine: (no-preload-947000) Calling .DriverName
	I0307 10:12:05.494068   15954 out.go:177] * Deleting "no-preload-947000" in hyperkit ...
	I0307 10:12:05.515277   15954 main.go:141] libmachine: (no-preload-947000) Calling .Remove
	I0307 10:12:05.515458   15954 main.go:141] libmachine: (no-preload-947000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:05.515487   15954 main.go:141] libmachine: (no-preload-947000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000/hyperkit.json: no such file or directory
	I0307 10:12:05.515499   15954 main.go:141] libmachine: (no-preload-947000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:05.515514   15954 main.go:141] libmachine: (no-preload-947000) DBG | hyperkit pid from json: 0
	W0307 10:12:05.532790   15954 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:05.532806   15954 start.go:728] Will try again in 5 seconds ...
	I0307 10:12:05.761406   15954 cache.go:157] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 exists
	I0307 10:12:05.761423   15954 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2" took 3.378377482s
	I0307 10:12:05.761431   15954 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 succeeded
	I0307 10:12:06.079659   15954 cache.go:157] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 exists
	I0307 10:12:06.079677   15954 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1" took 3.696502281s
	I0307 10:12:06.079688   15954 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
	I0307 10:12:06.174963   15954 cache.go:157] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 exists
	I0307 10:12:06.174983   15954 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2" took 3.792119996s
	I0307 10:12:06.174993   15954 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 succeeded
	I0307 10:12:08.099234   15954 cache.go:157] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 exists
	I0307 10:12:08.099254   15954 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2" took 5.716401662s
	I0307 10:12:08.099264   15954 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 succeeded
	I0307 10:12:09.374793   15954 cache.go:157] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 exists
	I0307 10:12:09.374811   15954 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2" took 6.991669277s
	I0307 10:12:09.374829   15954 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 succeeded
	I0307 10:12:10.532954   15954 start.go:360] acquireMachinesLock for no-preload-947000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:10.533044   15954 start.go:364] duration metric: took 68.998µs to acquireMachinesLock for "no-preload-947000"
	I0307 10:12:10.533061   15954 start.go:93] Provisioning new machine with config: &{Name:no-preload-947000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-947000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptio
ns:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:12:10.533120   15954 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:12:10.556374   15954 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:12:10.556465   15954 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:10.556491   15954 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:10.564832   15954 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60981
	I0307 10:12:10.565175   15954 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:10.565537   15954 main.go:141] libmachine: Using API Version  1
	I0307 10:12:10.565553   15954 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:10.565791   15954 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:10.565888   15954 main.go:141] libmachine: (no-preload-947000) Calling .GetMachineName
	I0307 10:12:10.565977   15954 main.go:141] libmachine: (no-preload-947000) Calling .DriverName
	I0307 10:12:10.566083   15954 start.go:159] libmachine.API.Create for "no-preload-947000" (driver="hyperkit")
	I0307 10:12:10.566099   15954 client.go:168] LocalClient.Create starting
	I0307 10:12:10.566127   15954 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:12:10.566175   15954 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:10.566189   15954 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:10.566229   15954 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:12:10.566272   15954 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:10.566299   15954 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:10.566313   15954 main.go:141] libmachine: Running pre-create checks...
	I0307 10:12:10.566319   15954 main.go:141] libmachine: (no-preload-947000) Calling .PreCreateCheck
	I0307 10:12:10.566398   15954 main.go:141] libmachine: (no-preload-947000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:10.566424   15954 main.go:141] libmachine: (no-preload-947000) Calling .GetConfigRaw
	I0307 10:12:10.566858   15954 main.go:141] libmachine: Creating machine...
	I0307 10:12:10.566866   15954 main.go:141] libmachine: (no-preload-947000) Calling .Create
	I0307 10:12:10.566947   15954 main.go:141] libmachine: (no-preload-947000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:10.567084   15954 main.go:141] libmachine: (no-preload-947000) DBG | I0307 10:12:10.566958   16029 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:10.567146   15954 main.go:141] libmachine: (no-preload-947000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:12:10.742353   15954 main.go:141] libmachine: (no-preload-947000) DBG | I0307 10:12:10.742308   16029 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000/id_rsa...
	I0307 10:12:10.896387   15954 main.go:141] libmachine: (no-preload-947000) DBG | I0307 10:12:10.896301   16029 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000/no-preload-947000.rawdisk...
	I0307 10:12:10.896416   15954 main.go:141] libmachine: (no-preload-947000) DBG | Writing magic tar header
	I0307 10:12:10.896426   15954 main.go:141] libmachine: (no-preload-947000) DBG | Writing SSH key tar header
	I0307 10:12:10.896940   15954 main.go:141] libmachine: (no-preload-947000) DBG | I0307 10:12:10.896906   16029 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000 ...
	I0307 10:12:11.017881   15954 cache.go:157] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 exists
	I0307 10:12:11.017902   15954 cache.go:96] cache image "registry.k8s.io/etcd:3.5.10-0" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0" took 8.634860826s
	I0307 10:12:11.017920   15954 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.10-0 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 succeeded
	I0307 10:12:11.017938   15954 cache.go:87] Successfully saved all images to host disk.
	I0307 10:12:11.255842   15954 main.go:141] libmachine: (no-preload-947000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:11.255857   15954 main.go:141] libmachine: (no-preload-947000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000/hyperkit.pid
	I0307 10:12:11.255921   15954 main.go:141] libmachine: (no-preload-947000) DBG | Using UUID ffbbd459-dc2a-4a8a-9b98-8836e0a9c6d8
	I0307 10:12:11.294743   15954 main.go:141] libmachine: (no-preload-947000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:11.294832   15954 client.go:171] duration metric: took 728.714499ms to LocalClient.Create
	I0307 10:12:13.295370   15954 start.go:128] duration metric: took 2.762195307s to createHost
	I0307 10:12:13.295393   15954 start.go:83] releasing machines lock for "no-preload-947000", held for 2.762297672s
	W0307 10:12:13.295515   15954 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p no-preload-947000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p no-preload-947000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:13.353317   15954 out.go:177] 
	W0307 10:12:13.374595   15954 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:12:13.374664   15954 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:12:13.374734   15954 out.go:239] * Related issues:
	* Related issues:
	W0307 10:12:13.374760   15954 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:12:13.374782   15954 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:12:13.458249   15954 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p no-preload-947000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000: exit status 7 (73.482596ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-947000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/FirstStart (11.73s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-169000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context old-k8s-version-169000 create -f testdata/busybox.yaml: exit status 1 (36.607493ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-169000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context old-k8s-version-169000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000: exit status 7 (72.419151ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-169000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000: exit status 7 (72.595286ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-169000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/DeployApp (0.18s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p old-k8s-version-169000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-169000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context old-k8s-version-169000 describe deploy/metrics-server -n kube-system: exit status 1 (37.287888ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-169000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context old-k8s-version-169000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000: exit status 7 (72.576066ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-169000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.32s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (6.05s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p old-k8s-version-169000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-169000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0: exit status 60 (5.978048612s)

                                                
                                                
-- stdout --
	* [old-k8s-version-169000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
	* Using the hyperkit driver based on existing profile
	* Starting "old-k8s-version-169000" primary control-plane node in "old-k8s-version-169000" cluster
	* Restarting existing hyperkit VM for "old-k8s-version-169000" ...
	* Restarting existing hyperkit VM for "old-k8s-version-169000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:12:12.849507   16050 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:12:12.850243   16050 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:12.850252   16050 out.go:304] Setting ErrFile to fd 2...
	I0307 10:12:12.850258   16050 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:12.850843   16050 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:12:12.852519   16050 out.go:298] Setting JSON to false
	I0307 10:12:12.875035   16050 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7903,"bootTime":1709827229,"procs":444,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:12:12.875130   16050 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:12:12.897127   16050 out.go:177] * [old-k8s-version-169000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:12:12.939841   16050 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:12:12.939914   16050 notify.go:220] Checking for updates...
	I0307 10:12:12.983670   16050 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:12:13.004967   16050 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:12:13.026681   16050 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:12:13.047995   16050 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:13.074787   16050 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:12:13.096023   16050 config.go:182] Loaded profile config "old-k8s-version-169000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0307 10:12:13.096685   16050 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:13.096768   16050 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:13.106045   16050 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:60998
	I0307 10:12:13.106428   16050 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:13.106845   16050 main.go:141] libmachine: Using API Version  1
	I0307 10:12:13.106858   16050 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:13.107092   16050 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:13.107193   16050 main.go:141] libmachine: (old-k8s-version-169000) Calling .DriverName
	I0307 10:12:13.128538   16050 out.go:177] * Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
	I0307 10:12:13.149552   16050 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:12:13.150118   16050 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:13.150173   16050 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:13.159886   16050 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61000
	I0307 10:12:13.160290   16050 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:13.160678   16050 main.go:141] libmachine: Using API Version  1
	I0307 10:12:13.160704   16050 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:13.160924   16050 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:13.161040   16050 main.go:141] libmachine: (old-k8s-version-169000) Calling .DriverName
	I0307 10:12:13.189383   16050 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 10:12:13.231664   16050 start.go:297] selected driver: hyperkit
	I0307 10:12:13.231693   16050 start.go:901] validating driver "hyperkit" against &{Name:old-k8s-version-169000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-169000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 Cert
Expiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:12:13.231900   16050 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:12:13.236617   16050 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:13.236717   16050 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:12:13.244468   16050 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:12:13.248369   16050 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:13.248392   16050 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:12:13.248533   16050 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:12:13.248596   16050 cni.go:84] Creating CNI manager for ""
	I0307 10:12:13.248612   16050 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0307 10:12:13.248654   16050 start.go:340] cluster config:
	{Name:old-k8s-version-169000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-169000 Namespace:defa
ult APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion
:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:12:13.248755   16050 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:13.290377   16050 out.go:177] * Starting "old-k8s-version-169000" primary control-plane node in "old-k8s-version-169000" cluster
	I0307 10:12:13.311710   16050 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0307 10:12:13.311786   16050 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0307 10:12:13.311830   16050 cache.go:56] Caching tarball of preloaded images
	I0307 10:12:13.312040   16050 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:12:13.312061   16050 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0307 10:12:13.312226   16050 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/old-k8s-version-169000/config.json ...
	I0307 10:12:13.354170   16050 start.go:360] acquireMachinesLock for old-k8s-version-169000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:13.354301   16050 start.go:364] duration metric: took 101.996µs to acquireMachinesLock for "old-k8s-version-169000"
	I0307 10:12:13.354339   16050 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:12:13.354356   16050 fix.go:54] fixHost starting: 
	I0307 10:12:13.354773   16050 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:13.354816   16050 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:13.363593   16050 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61002
	I0307 10:12:13.363969   16050 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:13.364398   16050 main.go:141] libmachine: Using API Version  1
	I0307 10:12:13.364413   16050 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:13.364623   16050 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:13.364743   16050 main.go:141] libmachine: (old-k8s-version-169000) Calling .DriverName
	I0307 10:12:13.364855   16050 main.go:141] libmachine: (old-k8s-version-169000) Calling .GetState
	I0307 10:12:13.364947   16050 main.go:141] libmachine: (old-k8s-version-169000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:13.364964   16050 main.go:141] libmachine: (old-k8s-version-169000) DBG | hyperkit pid from json: 0
	I0307 10:12:13.364979   16050 main.go:141] libmachine: (old-k8s-version-169000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000/hyperkit.json: no such file or directory
	I0307 10:12:13.365018   16050 fix.go:112] recreateIfNeeded on old-k8s-version-169000: state=Stopped err=<nil>
	I0307 10:12:13.365043   16050 main.go:141] libmachine: (old-k8s-version-169000) Calling .DriverName
	W0307 10:12:13.365129   16050 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:12:13.416625   16050 out.go:177] * Restarting existing hyperkit VM for "old-k8s-version-169000" ...
	I0307 10:12:13.500520   16050 main.go:141] libmachine: (old-k8s-version-169000) Calling .Start
	I0307 10:12:13.500735   16050 main.go:141] libmachine: (old-k8s-version-169000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:13.500799   16050 main.go:141] libmachine: (old-k8s-version-169000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000/hyperkit.pid
	I0307 10:12:13.500886   16050 main.go:141] libmachine: (old-k8s-version-169000) DBG | Using UUID 8f7091b8-4237-43f9-864d-fd7b7d1dc325
	I0307 10:12:13.502334   16050 main.go:141] libmachine: (old-k8s-version-169000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:13.502431   16050 fix.go:56] duration metric: took 148.07688ms for fixHost
	I0307 10:12:13.502441   16050 start.go:83] releasing machines lock for "old-k8s-version-169000", held for 148.126915ms
	W0307 10:12:13.502456   16050 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 10:12:13.502503   16050 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:13.502511   16050 start.go:728] Will try again in 5 seconds ...
	I0307 10:12:18.502749   16050 start.go:360] acquireMachinesLock for old-k8s-version-169000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:18.502910   16050 start.go:364] duration metric: took 125.575µs to acquireMachinesLock for "old-k8s-version-169000"
	I0307 10:12:18.502944   16050 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:12:18.502951   16050 fix.go:54] fixHost starting: 
	I0307 10:12:18.503402   16050 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:18.503443   16050 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:18.512488   16050 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61048
	I0307 10:12:18.512902   16050 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:18.513247   16050 main.go:141] libmachine: Using API Version  1
	I0307 10:12:18.513255   16050 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:18.513472   16050 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:18.513591   16050 main.go:141] libmachine: (old-k8s-version-169000) Calling .DriverName
	I0307 10:12:18.513707   16050 main.go:141] libmachine: (old-k8s-version-169000) Calling .GetState
	I0307 10:12:18.513820   16050 main.go:141] libmachine: (old-k8s-version-169000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:18.513831   16050 main.go:141] libmachine: (old-k8s-version-169000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000/hyperkit.json: no such file or directory
	I0307 10:12:18.513858   16050 main.go:141] libmachine: (old-k8s-version-169000) DBG | hyperkit pid from json: 0
	I0307 10:12:18.513874   16050 fix.go:112] recreateIfNeeded on old-k8s-version-169000: state=Stopped err=<nil>
	I0307 10:12:18.513884   16050 main.go:141] libmachine: (old-k8s-version-169000) Calling .DriverName
	W0307 10:12:18.513972   16050 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:12:18.535715   16050 out.go:177] * Restarting existing hyperkit VM for "old-k8s-version-169000" ...
	I0307 10:12:18.579213   16050 main.go:141] libmachine: (old-k8s-version-169000) Calling .Start
	I0307 10:12:18.579486   16050 main.go:141] libmachine: (old-k8s-version-169000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:18.579546   16050 main.go:141] libmachine: (old-k8s-version-169000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000/hyperkit.pid
	I0307 10:12:18.579618   16050 main.go:141] libmachine: (old-k8s-version-169000) DBG | Using UUID 8f7091b8-4237-43f9-864d-fd7b7d1dc325
	I0307 10:12:18.620570   16050 main.go:141] libmachine: (old-k8s-version-169000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:18.620668   16050 fix.go:56] duration metric: took 117.715095ms for fixHost
	I0307 10:12:18.620678   16050 start.go:83] releasing machines lock for "old-k8s-version-169000", held for 117.754184ms
	W0307 10:12:18.620739   16050 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-169000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-169000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:18.642138   16050 out.go:177] 
	W0307 10:12:18.663200   16050 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:12:18.663353   16050 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:12:18.663377   16050 out.go:239] * Related issues:
	* Related issues:
	W0307 10:12:18.663424   16050 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:12:18.663455   16050 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:12:18.705165   16050 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p old-k8s-version-169000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000: exit status 7 (73.458693ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-169000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (6.05s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-947000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context no-preload-947000 create -f testdata/busybox.yaml: exit status 1 (36.99679ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-947000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context no-preload-947000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000: exit status 7 (72.73223ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-947000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000: exit status 7 (73.398326ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-947000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/DeployApp (0.18s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p no-preload-947000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-947000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context no-preload-947000 describe deploy/metrics-server -n kube-system: exit status 1 (37.027227ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-947000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context no-preload-947000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000: exit status 7 (73.280439ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-947000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.32s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (6.52s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p no-preload-947000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p no-preload-947000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (6.444149675s)

                                                
                                                
-- stdout --
	* [no-preload-947000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "no-preload-947000" primary control-plane node in "no-preload-947000" cluster
	* Restarting existing hyperkit VM for "no-preload-947000" ...
	* Restarting existing hyperkit VM for "no-preload-947000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:12:17.332829   16107 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:12:17.333092   16107 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:17.333097   16107 out.go:304] Setting ErrFile to fd 2...
	I0307 10:12:17.333100   16107 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:17.334056   16107 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:12:17.335750   16107 out.go:298] Setting JSON to false
	I0307 10:12:17.358203   16107 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7908,"bootTime":1709827229,"procs":448,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:12:17.358299   16107 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:12:17.379987   16107 out.go:177] * [no-preload-947000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:12:17.421829   16107 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:12:17.421907   16107 notify.go:220] Checking for updates...
	I0307 10:12:17.463908   16107 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:12:17.484705   16107 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:12:17.505702   16107 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:12:17.526774   16107 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:17.547783   16107 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:12:17.569439   16107 config.go:182] Loaded profile config "no-preload-947000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0307 10:12:17.569926   16107 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:17.569982   16107 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:17.578720   16107 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61042
	I0307 10:12:17.579095   16107 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:17.579566   16107 main.go:141] libmachine: Using API Version  1
	I0307 10:12:17.579583   16107 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:17.579857   16107 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:17.579977   16107 main.go:141] libmachine: (no-preload-947000) Calling .DriverName
	I0307 10:12:17.580181   16107 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:12:17.580425   16107 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:17.580473   16107 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:17.588280   16107 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61044
	I0307 10:12:17.588607   16107 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:17.588922   16107 main.go:141] libmachine: Using API Version  1
	I0307 10:12:17.588933   16107 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:17.589140   16107 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:17.589243   16107 main.go:141] libmachine: (no-preload-947000) Calling .DriverName
	I0307 10:12:17.617815   16107 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 10:12:17.659875   16107 start.go:297] selected driver: hyperkit
	I0307 10:12:17.659904   16107 start.go:901] validating driver "hyperkit" against &{Name:no-preload-947000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-947000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0
CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:12:17.660112   16107 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:12:17.664348   16107 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:17.664439   16107 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:12:17.672446   16107 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:12:17.676676   16107 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:17.676700   16107 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:12:17.676837   16107 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:12:17.676906   16107 cni.go:84] Creating CNI manager for ""
	I0307 10:12:17.676921   16107 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:12:17.676970   16107 start.go:340] cluster config:
	{Name:no-preload-947000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-947000 Namespace:default
APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVer
sion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:12:17.677071   16107 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:17.718676   16107 out.go:177] * Starting "no-preload-947000" primary control-plane node in "no-preload-947000" cluster
	I0307 10:12:17.739905   16107 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 10:12:17.740070   16107 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/no-preload-947000/config.json ...
	I0307 10:12:17.740179   16107 cache.go:107] acquiring lock: {Name:mk397a13c843cb93391cfd8631e48a6e6dc63122 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:17.740180   16107 cache.go:107] acquiring lock: {Name:mk23a88b2566792987733168dde9a45e7d23012e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:17.740235   16107 cache.go:107] acquiring lock: {Name:mkb9165f8553e439174704686448d512d825e83f Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:17.740271   16107 cache.go:107] acquiring lock: {Name:mkb1387b8583968d6e804b7f8c523cdf39480b28 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:17.740379   16107 cache.go:115] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 exists
	I0307 10:12:17.740405   16107 cache.go:115] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 exists
	I0307 10:12:17.740413   16107 cache.go:115] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 exists
	I0307 10:12:17.740409   16107 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2" took 242.329µs
	I0307 10:12:17.740421   16107 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9" took 211.487µs
	I0307 10:12:17.740373   16107 cache.go:107] acquiring lock: {Name:mk868de11d37377993d3dab9873a532f58539eec Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:17.740436   16107 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 succeeded
	I0307 10:12:17.740371   16107 cache.go:107] acquiring lock: {Name:mkc9757fa9eeeec85e77ce3410a63e40eb4597d3 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:17.740432   16107 cache.go:107] acquiring lock: {Name:mk8eb2860ac623bcd7c811c959733be4eb0ad016 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:17.740419   16107 cache.go:107] acquiring lock: {Name:mk931badc67037ef28cd5ab03d04b614992a91b6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:17.740428   16107 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2" took 163.114µs
	I0307 10:12:17.740486   16107 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 succeeded
	I0307 10:12:17.740432   16107 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 succeeded
	I0307 10:12:17.740535   16107 cache.go:115] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0307 10:12:17.740579   16107 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 399.515µs
	I0307 10:12:17.740604   16107 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0307 10:12:17.740610   16107 cache.go:115] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 exists
	I0307 10:12:17.740625   16107 cache.go:115] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 exists
	I0307 10:12:17.740637   16107 cache.go:96] cache image "registry.k8s.io/etcd:3.5.10-0" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0" took 344.509µs
	I0307 10:12:17.740645   16107 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.10-0 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 succeeded
	I0307 10:12:17.740638   16107 cache.go:115] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 exists
	I0307 10:12:17.740658   16107 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2" took 316.078µs
	I0307 10:12:17.740658   16107 cache.go:115] /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 exists
	I0307 10:12:17.740673   16107 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 succeeded
	I0307 10:12:17.740631   16107 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1" took 292.473µs
	I0307 10:12:17.740689   16107 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
	I0307 10:12:17.740684   16107 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2" took 385.75µs
	I0307 10:12:17.740714   16107 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 succeeded
	I0307 10:12:17.740724   16107 cache.go:87] Successfully saved all images to host disk.
	I0307 10:12:17.740973   16107 start.go:360] acquireMachinesLock for no-preload-947000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:17.741047   16107 start.go:364] duration metric: took 57.46µs to acquireMachinesLock for "no-preload-947000"
	I0307 10:12:17.741079   16107 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:12:17.741094   16107 fix.go:54] fixHost starting: 
	I0307 10:12:17.741383   16107 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:17.741410   16107 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:17.750230   16107 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61046
	I0307 10:12:17.750619   16107 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:17.750956   16107 main.go:141] libmachine: Using API Version  1
	I0307 10:12:17.750965   16107 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:17.751214   16107 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:17.751335   16107 main.go:141] libmachine: (no-preload-947000) Calling .DriverName
	I0307 10:12:17.751424   16107 main.go:141] libmachine: (no-preload-947000) Calling .GetState
	I0307 10:12:17.751502   16107 main.go:141] libmachine: (no-preload-947000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:17.751560   16107 main.go:141] libmachine: (no-preload-947000) DBG | hyperkit pid from json: 0
	I0307 10:12:17.751582   16107 main.go:141] libmachine: (no-preload-947000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000/hyperkit.json: no such file or directory
	I0307 10:12:17.751574   16107 fix.go:112] recreateIfNeeded on no-preload-947000: state=Stopped err=<nil>
	I0307 10:12:17.751598   16107 main.go:141] libmachine: (no-preload-947000) Calling .DriverName
	W0307 10:12:17.751679   16107 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:12:17.793790   16107 out.go:177] * Restarting existing hyperkit VM for "no-preload-947000" ...
	I0307 10:12:17.814684   16107 main.go:141] libmachine: (no-preload-947000) Calling .Start
	I0307 10:12:17.814957   16107 main.go:141] libmachine: (no-preload-947000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:17.815013   16107 main.go:141] libmachine: (no-preload-947000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000/hyperkit.pid
	I0307 10:12:17.815077   16107 main.go:141] libmachine: (no-preload-947000) DBG | Using UUID ffbbd459-dc2a-4a8a-9b98-8836e0a9c6d8
	I0307 10:12:17.816661   16107 main.go:141] libmachine: (no-preload-947000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:17.816761   16107 fix.go:56] duration metric: took 75.669287ms for fixHost
	I0307 10:12:17.816772   16107 start.go:83] releasing machines lock for "no-preload-947000", held for 75.7157ms
	W0307 10:12:17.816788   16107 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 10:12:17.816851   16107 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:17.816857   16107 start.go:728] Will try again in 5 seconds ...
	I0307 10:12:22.817403   16107 start.go:360] acquireMachinesLock for no-preload-947000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:23.353313   16107 start.go:364] duration metric: took 535.865067ms to acquireMachinesLock for "no-preload-947000"
	I0307 10:12:23.353349   16107 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:12:23.353356   16107 fix.go:54] fixHost starting: 
	I0307 10:12:23.353709   16107 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:23.353738   16107 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:23.362555   16107 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61080
	I0307 10:12:23.362968   16107 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:23.363345   16107 main.go:141] libmachine: Using API Version  1
	I0307 10:12:23.363361   16107 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:23.363607   16107 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:23.363725   16107 main.go:141] libmachine: (no-preload-947000) Calling .DriverName
	I0307 10:12:23.363819   16107 main.go:141] libmachine: (no-preload-947000) Calling .GetState
	I0307 10:12:23.363896   16107 main.go:141] libmachine: (no-preload-947000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:23.363921   16107 main.go:141] libmachine: (no-preload-947000) DBG | hyperkit pid from json: 0
	I0307 10:12:23.363944   16107 main.go:141] libmachine: (no-preload-947000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000/hyperkit.json: no such file or directory
	I0307 10:12:23.363983   16107 fix.go:112] recreateIfNeeded on no-preload-947000: state=Stopped err=<nil>
	I0307 10:12:23.364001   16107 main.go:141] libmachine: (no-preload-947000) Calling .DriverName
	W0307 10:12:23.364090   16107 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:12:23.406195   16107 out.go:177] * Restarting existing hyperkit VM for "no-preload-947000" ...
	I0307 10:12:23.471207   16107 main.go:141] libmachine: (no-preload-947000) Calling .Start
	I0307 10:12:23.471528   16107 main.go:141] libmachine: (no-preload-947000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:23.471626   16107 main.go:141] libmachine: (no-preload-947000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000/hyperkit.pid
	I0307 10:12:23.471720   16107 main.go:141] libmachine: (no-preload-947000) DBG | Using UUID ffbbd459-dc2a-4a8a-9b98-8836e0a9c6d8
	I0307 10:12:23.543507   16107 main.go:141] libmachine: (no-preload-947000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:23.543604   16107 fix.go:56] duration metric: took 190.24515ms for fixHost
	I0307 10:12:23.543614   16107 start.go:83] releasing machines lock for "no-preload-947000", held for 190.281479ms
	W0307 10:12:23.543672   16107 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p no-preload-947000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p no-preload-947000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:23.585287   16107 out.go:177] 
	W0307 10:12:23.610459   16107 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:12:23.610525   16107 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:12:23.610541   16107 out.go:239] * Related issues:
	* Related issues:
	W0307 10:12:23.610564   16107 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:12:23.610617   16107 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:12:23.653294   16107 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p no-preload-947000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000: exit status 7 (73.778031ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-947000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/SecondStart (6.52s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-169000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000: exit status 7 (72.901882ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-169000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-169000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-169000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context old-k8s-version-169000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (36.531495ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-169000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context old-k8s-version-169000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000: exit status 7 (73.644002ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-169000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.11s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p old-k8s-version-169000 image list --format=json
start_stop_delete_test.go:304: v1.20.0 images missing (-want +got):
  []string{
- 	"k8s.gcr.io/coredns:1.7.0",
- 	"k8s.gcr.io/etcd:3.4.13-0",
- 	"k8s.gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"k8s.gcr.io/kube-apiserver:v1.20.0",
- 	"k8s.gcr.io/kube-controller-manager:v1.20.0",
- 	"k8s.gcr.io/kube-proxy:v1.20.0",
- 	"k8s.gcr.io/kube-scheduler:v1.20.0",
- 	"k8s.gcr.io/pause:3.2",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000: exit status 7 (73.891454ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-169000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p old-k8s-version-169000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p old-k8s-version-169000 --alsologtostderr -v=1: exit status 83 (137.651327ms)

                                                
                                                
-- stdout --
	* The control-plane node old-k8s-version-169000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p old-k8s-version-169000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:12:19.268540   16136 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:12:19.268808   16136 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:19.268814   16136 out.go:304] Setting ErrFile to fd 2...
	I0307 10:12:19.268818   16136 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:19.268994   16136 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:12:19.269317   16136 out.go:298] Setting JSON to false
	I0307 10:12:19.269332   16136 mustload.go:65] Loading cluster: old-k8s-version-169000
	I0307 10:12:19.269599   16136 config.go:182] Loaded profile config "old-k8s-version-169000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0307 10:12:19.269936   16136 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:19.269980   16136 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:19.277539   16136 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61064
	I0307 10:12:19.277973   16136 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:19.278423   16136 main.go:141] libmachine: Using API Version  1
	I0307 10:12:19.278431   16136 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:19.278670   16136 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:19.278783   16136 main.go:141] libmachine: (old-k8s-version-169000) Calling .GetState
	I0307 10:12:19.278868   16136 main.go:141] libmachine: (old-k8s-version-169000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:19.278882   16136 main.go:141] libmachine: (old-k8s-version-169000) DBG | hyperkit pid from json: 0
	I0307 10:12:19.278908   16136 main.go:141] libmachine: (old-k8s-version-169000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/old-k8s-version-169000/hyperkit.json: no such file or directory
	I0307 10:12:19.299739   16136 out.go:177] * The control-plane node old-k8s-version-169000 host is not running: state=Stopped
	I0307 10:12:19.322405   16136 out.go:177]   To start a cluster, run: "minikube start -p old-k8s-version-169000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p old-k8s-version-169000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000: exit status 7 (73.348879ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-169000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000: exit status 7 (73.874584ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-169000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/Pause (0.29s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (11.71s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p embed-certs-026000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p embed-certs-026000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (11.635695498s)

                                                
                                                
-- stdout --
	* [embed-certs-026000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "embed-certs-026000" primary control-plane node in "embed-certs-026000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "embed-certs-026000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:12:20.257287   16164 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:12:20.257546   16164 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:20.257554   16164 out.go:304] Setting ErrFile to fd 2...
	I0307 10:12:20.257558   16164 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:20.257747   16164 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:12:20.259192   16164 out.go:298] Setting JSON to false
	I0307 10:12:20.281732   16164 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7911,"bootTime":1709827229,"procs":455,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:12:20.281825   16164 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:12:20.303271   16164 out.go:177] * [embed-certs-026000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:12:20.345117   16164 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:12:20.345224   16164 notify.go:220] Checking for updates...
	I0307 10:12:20.366047   16164 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:12:20.387020   16164 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:12:20.408195   16164 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:12:20.428890   16164 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:20.450154   16164 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:12:20.472254   16164 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:12:20.472446   16164 config.go:182] Loaded profile config "no-preload-947000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0307 10:12:20.472576   16164 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:12:20.501034   16164 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:12:20.543223   16164 start.go:297] selected driver: hyperkit
	I0307 10:12:20.543249   16164 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:12:20.543268   16164 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:12:20.547701   16164 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:20.547803   16164 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:12:20.555645   16164 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:12:20.559490   16164 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:20.559513   16164 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:12:20.559546   16164 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:12:20.559747   16164 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:12:20.559809   16164 cni.go:84] Creating CNI manager for ""
	I0307 10:12:20.559827   16164 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:12:20.559834   16164 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 10:12:20.559899   16164 start.go:340] cluster config:
	{Name:embed-certs-026000 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-026000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Conta
inerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthS
ock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:12:20.559991   16164 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:20.602040   16164 out.go:177] * Starting "embed-certs-026000" primary control-plane node in "embed-certs-026000" cluster
	I0307 10:12:20.639286   16164 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:12:20.639353   16164 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:12:20.639385   16164 cache.go:56] Caching tarball of preloaded images
	I0307 10:12:20.639609   16164 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:12:20.639630   16164 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:12:20.639782   16164 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/embed-certs-026000/config.json ...
	I0307 10:12:20.639819   16164 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/embed-certs-026000/config.json: {Name:mkb95234bc2aaf576099431ad10c65ea5b9d8e6b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:12:20.640417   16164 start.go:360] acquireMachinesLock for embed-certs-026000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:20.640539   16164 start.go:364] duration metric: took 98.934µs to acquireMachinesLock for "embed-certs-026000"
	I0307 10:12:20.640568   16164 start.go:93] Provisioning new machine with config: &{Name:embed-certs-026000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-026000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou
ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:12:20.640627   16164 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:12:20.662119   16164 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:12:20.662387   16164 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:20.662467   16164 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:20.671745   16164 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61077
	I0307 10:12:20.672177   16164 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:20.672603   16164 main.go:141] libmachine: Using API Version  1
	I0307 10:12:20.672627   16164 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:20.672879   16164 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:20.672993   16164 main.go:141] libmachine: (embed-certs-026000) Calling .GetMachineName
	I0307 10:12:20.673088   16164 main.go:141] libmachine: (embed-certs-026000) Calling .DriverName
	I0307 10:12:20.673195   16164 start.go:159] libmachine.API.Create for "embed-certs-026000" (driver="hyperkit")
	I0307 10:12:20.673218   16164 client.go:168] LocalClient.Create starting
	I0307 10:12:20.673251   16164 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:12:20.673304   16164 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:20.673322   16164 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:20.673375   16164 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:12:20.673410   16164 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:20.673422   16164 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:20.673435   16164 main.go:141] libmachine: Running pre-create checks...
	I0307 10:12:20.673446   16164 main.go:141] libmachine: (embed-certs-026000) Calling .PreCreateCheck
	I0307 10:12:20.673525   16164 main.go:141] libmachine: (embed-certs-026000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:20.673718   16164 main.go:141] libmachine: (embed-certs-026000) Calling .GetConfigRaw
	I0307 10:12:20.683621   16164 main.go:141] libmachine: Creating machine...
	I0307 10:12:20.683639   16164 main.go:141] libmachine: (embed-certs-026000) Calling .Create
	I0307 10:12:20.683803   16164 main.go:141] libmachine: (embed-certs-026000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:20.684056   16164 main.go:141] libmachine: (embed-certs-026000) DBG | I0307 10:12:20.683789   16172 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:20.684213   16164 main.go:141] libmachine: (embed-certs-026000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:12:20.863740   16164 main.go:141] libmachine: (embed-certs-026000) DBG | I0307 10:12:20.863640   16172 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000/id_rsa...
	I0307 10:12:20.950922   16164 main.go:141] libmachine: (embed-certs-026000) DBG | I0307 10:12:20.950839   16172 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000/embed-certs-026000.rawdisk...
	I0307 10:12:20.950933   16164 main.go:141] libmachine: (embed-certs-026000) DBG | Writing magic tar header
	I0307 10:12:20.950943   16164 main.go:141] libmachine: (embed-certs-026000) DBG | Writing SSH key tar header
	I0307 10:12:20.951905   16164 main.go:141] libmachine: (embed-certs-026000) DBG | I0307 10:12:20.951804   16172 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000 ...
	I0307 10:12:21.313906   16164 main.go:141] libmachine: (embed-certs-026000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:21.313941   16164 main.go:141] libmachine: (embed-certs-026000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000/hyperkit.pid
	I0307 10:12:21.313959   16164 main.go:141] libmachine: (embed-certs-026000) DBG | Using UUID e8b43695-e350-4aa5-89fc-a2369c0cd90f
	I0307 10:12:21.351907   16164 main.go:141] libmachine: (embed-certs-026000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:21.351993   16164 client.go:171] duration metric: took 678.752398ms to LocalClient.Create
	I0307 10:12:23.353239   16164 start.go:128] duration metric: took 2.71255711s to createHost
	I0307 10:12:23.353259   16164 start.go:83] releasing machines lock for "embed-certs-026000", held for 2.712669504s
	W0307 10:12:23.353284   16164 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:12:23.353705   16164 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:23.353737   16164 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:23.362559   16164 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61079
	I0307 10:12:23.362977   16164 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:23.363353   16164 main.go:141] libmachine: Using API Version  1
	I0307 10:12:23.363367   16164 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:23.363603   16164 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:23.363963   16164 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:23.363991   16164 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:23.372122   16164 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61083
	I0307 10:12:23.372461   16164 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:23.372802   16164 main.go:141] libmachine: Using API Version  1
	I0307 10:12:23.372816   16164 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:23.373032   16164 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:23.373151   16164 main.go:141] libmachine: (embed-certs-026000) Calling .GetState
	I0307 10:12:23.373241   16164 main.go:141] libmachine: (embed-certs-026000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:23.373277   16164 main.go:141] libmachine: (embed-certs-026000) DBG | hyperkit pid from json: 0
	I0307 10:12:23.373298   16164 main.go:141] libmachine: (embed-certs-026000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000/hyperkit.json: no such file or directory
	I0307 10:12:23.373314   16164 main.go:141] libmachine: (embed-certs-026000) Calling .DriverName
	I0307 10:12:23.450335   16164 out.go:177] * Deleting "embed-certs-026000" in hyperkit ...
	I0307 10:12:23.492339   16164 main.go:141] libmachine: (embed-certs-026000) Calling .Remove
	I0307 10:12:23.492620   16164 main.go:141] libmachine: (embed-certs-026000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:23.492640   16164 main.go:141] libmachine: (embed-certs-026000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:23.492656   16164 main.go:141] libmachine: (embed-certs-026000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000/hyperkit.json: no such file or directory
	I0307 10:12:23.492677   16164 main.go:141] libmachine: (embed-certs-026000) DBG | hyperkit pid from json: 0
	W0307 10:12:23.511994   16164 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:23.512013   16164 start.go:728] Will try again in 5 seconds ...
	I0307 10:12:28.512488   16164 start.go:360] acquireMachinesLock for embed-certs-026000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:28.785782   16164 start.go:364] duration metric: took 273.25952ms to acquireMachinesLock for "embed-certs-026000"
	I0307 10:12:28.785820   16164 start.go:93] Provisioning new machine with config: &{Name:embed-certs-026000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-026000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou
ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:12:28.785943   16164 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:12:28.821096   16164 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:12:28.821226   16164 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:28.821287   16164 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:28.829834   16164 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61118
	I0307 10:12:28.830218   16164 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:28.830580   16164 main.go:141] libmachine: Using API Version  1
	I0307 10:12:28.830594   16164 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:28.830783   16164 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:28.830884   16164 main.go:141] libmachine: (embed-certs-026000) Calling .GetMachineName
	I0307 10:12:28.830970   16164 main.go:141] libmachine: (embed-certs-026000) Calling .DriverName
	I0307 10:12:28.831069   16164 start.go:159] libmachine.API.Create for "embed-certs-026000" (driver="hyperkit")
	I0307 10:12:28.831085   16164 client.go:168] LocalClient.Create starting
	I0307 10:12:28.831111   16164 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:12:28.831150   16164 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:28.831159   16164 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:28.831203   16164 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:12:28.831227   16164 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:28.831241   16164 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:28.831255   16164 main.go:141] libmachine: Running pre-create checks...
	I0307 10:12:28.831267   16164 main.go:141] libmachine: (embed-certs-026000) Calling .PreCreateCheck
	I0307 10:12:28.831356   16164 main.go:141] libmachine: (embed-certs-026000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:28.831398   16164 main.go:141] libmachine: (embed-certs-026000) Calling .GetConfigRaw
	I0307 10:12:28.862608   16164 main.go:141] libmachine: Creating machine...
	I0307 10:12:28.862626   16164 main.go:141] libmachine: (embed-certs-026000) Calling .Create
	I0307 10:12:28.862821   16164 main.go:141] libmachine: (embed-certs-026000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:28.863007   16164 main.go:141] libmachine: (embed-certs-026000) DBG | I0307 10:12:28.862792   16251 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:28.863107   16164 main.go:141] libmachine: (embed-certs-026000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:12:29.091230   16164 main.go:141] libmachine: (embed-certs-026000) DBG | I0307 10:12:29.091148   16251 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000/id_rsa...
	I0307 10:12:29.258286   16164 main.go:141] libmachine: (embed-certs-026000) DBG | I0307 10:12:29.258233   16251 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000/embed-certs-026000.rawdisk...
	I0307 10:12:29.258299   16164 main.go:141] libmachine: (embed-certs-026000) DBG | Writing magic tar header
	I0307 10:12:29.258328   16164 main.go:141] libmachine: (embed-certs-026000) DBG | Writing SSH key tar header
	I0307 10:12:29.259178   16164 main.go:141] libmachine: (embed-certs-026000) DBG | I0307 10:12:29.259093   16251 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000 ...
	I0307 10:12:29.623755   16164 main.go:141] libmachine: (embed-certs-026000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:29.623772   16164 main.go:141] libmachine: (embed-certs-026000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000/hyperkit.pid
	I0307 10:12:29.623784   16164 main.go:141] libmachine: (embed-certs-026000) DBG | Using UUID 9929bf3e-5342-4a42-a952-e31a6a90c427
	I0307 10:12:29.660518   16164 main.go:141] libmachine: (embed-certs-026000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:29.660610   16164 client.go:171] duration metric: took 829.505089ms to LocalClient.Create
	I0307 10:12:31.661708   16164 start.go:128] duration metric: took 2.875706133s to createHost
	I0307 10:12:31.661729   16164 start.go:83] releasing machines lock for "embed-certs-026000", held for 2.875888082s
	W0307 10:12:31.661807   16164 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p embed-certs-026000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p embed-certs-026000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:31.704340   16164 out.go:177] 
	W0307 10:12:31.726402   16164 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:12:31.726460   16164 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:12:31.726478   16164 out.go:239] * Related issues:
	* Related issues:
	W0307 10:12:31.726568   16164 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:12:31.726612   16164 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:12:31.769380   16164 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p embed-certs-026000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000: exit status 7 (74.982686ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-026000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/FirstStart (11.71s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-947000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000: exit status 7 (72.321426ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-947000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-947000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-947000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context no-preload-947000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (37.309742ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-947000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context no-preload-947000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000: exit status 7 (73.399641ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-947000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.11s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p no-preload-947000 image list --format=json
start_stop_delete_test.go:304: v1.29.0-rc.2 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.1",
- 	"registry.k8s.io/etcd:3.5.10-0",
- 	"registry.k8s.io/kube-apiserver:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-controller-manager:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-proxy:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-scheduler:v1.29.0-rc.2",
- 	"registry.k8s.io/pause:3.9",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000: exit status 7 (72.786949ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-947000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (0.28s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p no-preload-947000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p no-preload-947000 --alsologtostderr -v=1: exit status 83 (137.955947ms)

                                                
                                                
-- stdout --
	* The control-plane node no-preload-947000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p no-preload-947000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:12:24.215060   16195 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:12:24.215291   16195 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:24.215296   16195 out.go:304] Setting ErrFile to fd 2...
	I0307 10:12:24.215300   16195 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:24.215472   16195 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:12:24.215788   16195 out.go:298] Setting JSON to false
	I0307 10:12:24.215804   16195 mustload.go:65] Loading cluster: no-preload-947000
	I0307 10:12:24.216109   16195 config.go:182] Loaded profile config "no-preload-947000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0307 10:12:24.216441   16195 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:24.216491   16195 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:24.224175   16195 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61099
	I0307 10:12:24.224605   16195 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:24.225026   16195 main.go:141] libmachine: Using API Version  1
	I0307 10:12:24.225057   16195 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:24.225299   16195 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:24.225416   16195 main.go:141] libmachine: (no-preload-947000) Calling .GetState
	I0307 10:12:24.225505   16195 main.go:141] libmachine: (no-preload-947000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:24.225537   16195 main.go:141] libmachine: (no-preload-947000) DBG | hyperkit pid from json: 0
	I0307 10:12:24.225555   16195 main.go:141] libmachine: (no-preload-947000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/no-preload-947000/hyperkit.json: no such file or directory
	I0307 10:12:24.247247   16195 out.go:177] * The control-plane node no-preload-947000 host is not running: state=Stopped
	I0307 10:12:24.268889   16195 out.go:177]   To start a cluster, run: "minikube start -p no-preload-947000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p no-preload-947000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000: exit status 7 (73.263845ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-947000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000: exit status 7 (72.3912ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-947000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/Pause (0.28s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (11.42s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p default-k8s-diff-port-061000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p default-k8s-diff-port-061000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (11.345256395s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-061000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "default-k8s-diff-port-061000" primary control-plane node in "default-k8s-diff-port-061000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "default-k8s-diff-port-061000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:12:25.630893   16235 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:12:25.631063   16235 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:25.631069   16235 out.go:304] Setting ErrFile to fd 2...
	I0307 10:12:25.631073   16235 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:25.631231   16235 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:12:25.632648   16235 out.go:298] Setting JSON to false
	I0307 10:12:25.655722   16235 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7916,"bootTime":1709827229,"procs":454,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:12:25.655808   16235 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:12:25.676750   16235 out.go:177] * [default-k8s-diff-port-061000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:12:25.718623   16235 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:12:25.718687   16235 notify.go:220] Checking for updates...
	I0307 10:12:25.740584   16235 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:12:25.761593   16235 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:12:25.782717   16235 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:12:25.803445   16235 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:25.824488   16235 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:12:25.848571   16235 config.go:182] Loaded profile config "embed-certs-026000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:12:25.848734   16235 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:12:25.848884   16235 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:12:25.878477   16235 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:12:25.920471   16235 start.go:297] selected driver: hyperkit
	I0307 10:12:25.920492   16235 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:12:25.920508   16235 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:12:25.923545   16235 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:25.923658   16235 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:12:25.931535   16235 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:12:25.935398   16235 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:25.935421   16235 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:12:25.935470   16235 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 10:12:25.935715   16235 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:12:25.935766   16235 cni.go:84] Creating CNI manager for ""
	I0307 10:12:25.935781   16235 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:12:25.935787   16235 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 10:12:25.935847   16235 start.go:340] cluster config:
	{Name:default-k8s-diff-port-061000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-061000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomai
n:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPat
h: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:12:25.935936   16235 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:25.957411   16235 out.go:177] * Starting "default-k8s-diff-port-061000" primary control-plane node in "default-k8s-diff-port-061000" cluster
	I0307 10:12:25.979503   16235 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:12:25.979576   16235 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:12:25.979606   16235 cache.go:56] Caching tarball of preloaded images
	I0307 10:12:25.979801   16235 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:12:25.979818   16235 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:12:25.979973   16235 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/default-k8s-diff-port-061000/config.json ...
	I0307 10:12:25.980009   16235 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/default-k8s-diff-port-061000/config.json: {Name:mka8ec3d2e32007b3385aa767e77995a9301f6e2 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:12:25.980591   16235 start.go:360] acquireMachinesLock for default-k8s-diff-port-061000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:25.980699   16235 start.go:364] duration metric: took 79.801µs to acquireMachinesLock for "default-k8s-diff-port-061000"
	I0307 10:12:25.980741   16235 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-061000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-061000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:12:25.980824   16235 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:12:26.002669   16235 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:12:26.002896   16235 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:26.002954   16235 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:26.011933   16235 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61112
	I0307 10:12:26.012322   16235 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:26.012759   16235 main.go:141] libmachine: Using API Version  1
	I0307 10:12:26.012768   16235 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:26.012983   16235 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:26.013135   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .GetMachineName
	I0307 10:12:26.013226   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .DriverName
	I0307 10:12:26.013325   16235 start.go:159] libmachine.API.Create for "default-k8s-diff-port-061000" (driver="hyperkit")
	I0307 10:12:26.013354   16235 client.go:168] LocalClient.Create starting
	I0307 10:12:26.013392   16235 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:12:26.013443   16235 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:26.013462   16235 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:26.013519   16235 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:12:26.013555   16235 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:26.013567   16235 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:26.013579   16235 main.go:141] libmachine: Running pre-create checks...
	I0307 10:12:26.013590   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .PreCreateCheck
	I0307 10:12:26.013667   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:26.013813   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .GetConfigRaw
	I0307 10:12:26.023954   16235 main.go:141] libmachine: Creating machine...
	I0307 10:12:26.023972   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .Create
	I0307 10:12:26.024151   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:26.024386   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | I0307 10:12:26.024115   16243 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:26.024452   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:12:26.201617   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | I0307 10:12:26.201511   16243 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000/id_rsa...
	I0307 10:12:26.385903   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | I0307 10:12:26.385816   16243 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000/default-k8s-diff-port-061000.rawdisk...
	I0307 10:12:26.385916   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | Writing magic tar header
	I0307 10:12:26.385926   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | Writing SSH key tar header
	I0307 10:12:26.386493   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | I0307 10:12:26.386456   16243 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000 ...
	I0307 10:12:26.748756   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:26.748779   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000/hyperkit.pid
	I0307 10:12:26.748793   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | Using UUID 53a53ab9-5063-4208-9120-173626028730
	I0307 10:12:26.785436   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:26.785481   16235 client.go:171] duration metric: took 772.10634ms to LocalClient.Create
	I0307 10:12:28.785702   16235 start.go:128] duration metric: took 2.804821884s to createHost
	I0307 10:12:28.785721   16235 start.go:83] releasing machines lock for "default-k8s-diff-port-061000", held for 2.804967205s
	W0307 10:12:28.785742   16235 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:12:28.786151   16235 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:28.786180   16235 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:28.794518   16235 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61114
	I0307 10:12:28.794871   16235 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:28.795257   16235 main.go:141] libmachine: Using API Version  1
	I0307 10:12:28.795272   16235 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:28.795461   16235 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:28.795800   16235 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:28.795822   16235 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:28.803753   16235 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61116
	I0307 10:12:28.804082   16235 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:28.804437   16235 main.go:141] libmachine: Using API Version  1
	I0307 10:12:28.804454   16235 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:28.804659   16235 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:28.804766   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .GetState
	I0307 10:12:28.804847   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:28.804876   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000/hyperkit.json: no such file or directory
	I0307 10:12:28.804888   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | hyperkit pid from json: 0
	I0307 10:12:28.804950   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .DriverName
	I0307 10:12:28.862383   16235 out.go:177] * Deleting "default-k8s-diff-port-061000" in hyperkit ...
	I0307 10:12:28.885101   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .Remove
	I0307 10:12:28.885293   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:28.885307   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:28.885319   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000/hyperkit.json: no such file or directory
	I0307 10:12:28.885335   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | hyperkit pid from json: 0
	W0307 10:12:28.903722   16235 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:28.903738   16235 start.go:728] Will try again in 5 seconds ...
	I0307 10:12:33.904113   16235 start.go:360] acquireMachinesLock for default-k8s-diff-port-061000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:33.904277   16235 start.go:364] duration metric: took 103.058µs to acquireMachinesLock for "default-k8s-diff-port-061000"
	I0307 10:12:33.904306   16235 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-061000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-061000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:12:33.904403   16235 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:12:33.927254   16235 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:12:33.927362   16235 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:33.927415   16235 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:33.936075   16235 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61144
	I0307 10:12:33.936452   16235 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:33.936788   16235 main.go:141] libmachine: Using API Version  1
	I0307 10:12:33.936800   16235 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:33.937024   16235 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:33.937129   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .GetMachineName
	I0307 10:12:33.937213   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .DriverName
	I0307 10:12:33.937315   16235 start.go:159] libmachine.API.Create for "default-k8s-diff-port-061000" (driver="hyperkit")
	I0307 10:12:33.937341   16235 client.go:168] LocalClient.Create starting
	I0307 10:12:33.937369   16235 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:12:33.937420   16235 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:33.937431   16235 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:33.937474   16235 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:12:33.937510   16235 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:33.937523   16235 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:33.937550   16235 main.go:141] libmachine: Running pre-create checks...
	I0307 10:12:33.937556   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .PreCreateCheck
	I0307 10:12:33.937630   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:33.937702   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .GetConfigRaw
	I0307 10:12:33.948137   16235 main.go:141] libmachine: Creating machine...
	I0307 10:12:33.948156   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .Create
	I0307 10:12:33.948340   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:33.948552   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | I0307 10:12:33.948310   16286 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:33.948610   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:12:34.125714   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | I0307 10:12:34.125650   16286 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000/id_rsa...
	I0307 10:12:34.286341   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | I0307 10:12:34.286254   16286 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000/default-k8s-diff-port-061000.rawdisk...
	I0307 10:12:34.286355   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | Writing magic tar header
	I0307 10:12:34.286365   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | Writing SSH key tar header
	I0307 10:12:34.287158   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | I0307 10:12:34.287066   16286 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000 ...
	I0307 10:12:34.648980   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:34.649002   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000/hyperkit.pid
	I0307 10:12:34.649012   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | Using UUID 919b7f96-286b-40c4-ba34-605678a26e41
	I0307 10:12:34.685372   16235 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:34.685474   16235 client.go:171] duration metric: took 748.114938ms to LocalClient.Create
	I0307 10:12:36.685722   16235 start.go:128] duration metric: took 2.781243775s to createHost
	I0307 10:12:36.685751   16235 start.go:83] releasing machines lock for "default-k8s-diff-port-061000", held for 2.781419829s
	W0307 10:12:36.685880   16235 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-061000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-061000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:36.727989   16235 out.go:177] 
	W0307 10:12:36.791164   16235 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:12:36.791216   16235 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:12:36.791232   16235 out.go:239] * Related issues:
	* Related issues:
	W0307 10:12:36.791251   16235 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:12:36.791270   16235 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:12:36.833358   16235 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p default-k8s-diff-port-061000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000: exit status 7 (74.783194ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-061000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (11.42s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-026000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context embed-certs-026000 create -f testdata/busybox.yaml: exit status 1 (36.778609ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-026000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context embed-certs-026000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000: exit status 7 (74.677574ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-026000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000: exit status 7 (72.725962ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-026000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/DeployApp (0.18s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p embed-certs-026000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-026000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context embed-certs-026000 describe deploy/metrics-server -n kube-system: exit status 1 (36.671792ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-026000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context embed-certs-026000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000: exit status 7 (72.956013ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-026000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.32s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (6.39s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p embed-certs-026000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p embed-certs-026000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (6.319673329s)

                                                
                                                
-- stdout --
	* [embed-certs-026000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "embed-certs-026000" primary control-plane node in "embed-certs-026000" cluster
	* Restarting existing hyperkit VM for "embed-certs-026000" ...
	* Restarting existing hyperkit VM for "embed-certs-026000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:12:35.836459   16304 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:12:35.836727   16304 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:35.836733   16304 out.go:304] Setting ErrFile to fd 2...
	I0307 10:12:35.836737   16304 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:35.836908   16304 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:12:35.838296   16304 out.go:298] Setting JSON to false
	I0307 10:12:35.860524   16304 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7926,"bootTime":1709827229,"procs":441,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:12:35.860624   16304 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:12:35.881706   16304 out.go:177] * [embed-certs-026000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:12:35.923197   16304 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:12:35.923273   16304 notify.go:220] Checking for updates...
	I0307 10:12:35.965340   16304 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:12:36.007349   16304 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:12:36.028423   16304 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:12:36.049211   16304 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:36.070426   16304 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:12:36.091844   16304 config.go:182] Loaded profile config "embed-certs-026000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:12:36.092511   16304 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:36.092571   16304 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:36.101445   16304 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61160
	I0307 10:12:36.101831   16304 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:36.102252   16304 main.go:141] libmachine: Using API Version  1
	I0307 10:12:36.102265   16304 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:36.102533   16304 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:36.102649   16304 main.go:141] libmachine: (embed-certs-026000) Calling .DriverName
	I0307 10:12:36.102844   16304 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:12:36.103084   16304 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:36.103109   16304 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:36.110939   16304 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61162
	I0307 10:12:36.111308   16304 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:36.111692   16304 main.go:141] libmachine: Using API Version  1
	I0307 10:12:36.111710   16304 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:36.111899   16304 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:36.112000   16304 main.go:141] libmachine: (embed-certs-026000) Calling .DriverName
	I0307 10:12:36.140165   16304 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 10:12:36.161195   16304 start.go:297] selected driver: hyperkit
	I0307 10:12:36.161222   16304 start.go:901] validating driver "hyperkit" against &{Name:embed-certs-026000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-026000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpir
ation:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:12:36.161446   16304 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:12:36.165740   16304 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:36.165840   16304 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:12:36.173661   16304 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:12:36.177568   16304 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:36.177589   16304 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:12:36.177729   16304 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:12:36.177791   16304 cni.go:84] Creating CNI manager for ""
	I0307 10:12:36.177808   16304 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:12:36.177845   16304 start.go:340] cluster config:
	{Name:embed-certs-026000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-026000 Namespace:default APIS
erverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p20
00.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:12:36.177932   16304 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:36.220228   16304 out.go:177] * Starting "embed-certs-026000" primary control-plane node in "embed-certs-026000" cluster
	I0307 10:12:36.241255   16304 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:12:36.241327   16304 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:12:36.241357   16304 cache.go:56] Caching tarball of preloaded images
	I0307 10:12:36.241539   16304 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:12:36.241561   16304 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:12:36.241707   16304 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/embed-certs-026000/config.json ...
	I0307 10:12:36.242641   16304 start.go:360] acquireMachinesLock for embed-certs-026000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:36.685836   16304 start.go:364] duration metric: took 443.156698ms to acquireMachinesLock for "embed-certs-026000"
	I0307 10:12:36.685934   16304 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:12:36.685957   16304 fix.go:54] fixHost starting: 
	I0307 10:12:36.686452   16304 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:36.686502   16304 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:36.695788   16304 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61164
	I0307 10:12:36.696169   16304 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:36.696513   16304 main.go:141] libmachine: Using API Version  1
	I0307 10:12:36.696524   16304 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:36.696723   16304 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:36.696820   16304 main.go:141] libmachine: (embed-certs-026000) Calling .DriverName
	I0307 10:12:36.696910   16304 main.go:141] libmachine: (embed-certs-026000) Calling .GetState
	I0307 10:12:36.696995   16304 main.go:141] libmachine: (embed-certs-026000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:36.697021   16304 main.go:141] libmachine: (embed-certs-026000) DBG | hyperkit pid from json: 0
	I0307 10:12:36.697045   16304 main.go:141] libmachine: (embed-certs-026000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000/hyperkit.json: no such file or directory
	I0307 10:12:36.697066   16304 fix.go:112] recreateIfNeeded on embed-certs-026000: state=Stopped err=<nil>
	I0307 10:12:36.697091   16304 main.go:141] libmachine: (embed-certs-026000) Calling .DriverName
	W0307 10:12:36.697172   16304 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:12:36.770283   16304 out.go:177] * Restarting existing hyperkit VM for "embed-certs-026000" ...
	I0307 10:12:36.812168   16304 main.go:141] libmachine: (embed-certs-026000) Calling .Start
	I0307 10:12:36.812422   16304 main.go:141] libmachine: (embed-certs-026000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:36.812450   16304 main.go:141] libmachine: (embed-certs-026000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000/hyperkit.pid
	I0307 10:12:36.812511   16304 main.go:141] libmachine: (embed-certs-026000) DBG | Using UUID 9929bf3e-5342-4a42-a952-e31a6a90c427
	I0307 10:12:36.813711   16304 main.go:141] libmachine: (embed-certs-026000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:36.813810   16304 fix.go:56] duration metric: took 127.856536ms for fixHost
	I0307 10:12:36.813820   16304 start.go:83] releasing machines lock for "embed-certs-026000", held for 127.962047ms
	W0307 10:12:36.813842   16304 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 10:12:36.813902   16304 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:36.813909   16304 start.go:728] Will try again in 5 seconds ...
	I0307 10:12:41.815189   16304 start.go:360] acquireMachinesLock for embed-certs-026000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:41.815381   16304 start.go:364] duration metric: took 151.653µs to acquireMachinesLock for "embed-certs-026000"
	I0307 10:12:41.815418   16304 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:12:41.815426   16304 fix.go:54] fixHost starting: 
	I0307 10:12:41.815853   16304 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:41.815894   16304 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:41.825037   16304 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61207
	I0307 10:12:41.825471   16304 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:41.825862   16304 main.go:141] libmachine: Using API Version  1
	I0307 10:12:41.825880   16304 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:41.826091   16304 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:41.826201   16304 main.go:141] libmachine: (embed-certs-026000) Calling .DriverName
	I0307 10:12:41.826289   16304 main.go:141] libmachine: (embed-certs-026000) Calling .GetState
	I0307 10:12:41.826372   16304 main.go:141] libmachine: (embed-certs-026000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:41.826388   16304 main.go:141] libmachine: (embed-certs-026000) DBG | hyperkit pid from json: 0
	I0307 10:12:41.826405   16304 main.go:141] libmachine: (embed-certs-026000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000/hyperkit.json: no such file or directory
	I0307 10:12:41.826431   16304 fix.go:112] recreateIfNeeded on embed-certs-026000: state=Stopped err=<nil>
	I0307 10:12:41.826446   16304 main.go:141] libmachine: (embed-certs-026000) Calling .DriverName
	W0307 10:12:41.826530   16304 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:12:41.868759   16304 out.go:177] * Restarting existing hyperkit VM for "embed-certs-026000" ...
	I0307 10:12:41.889832   16304 main.go:141] libmachine: (embed-certs-026000) Calling .Start
	I0307 10:12:41.890117   16304 main.go:141] libmachine: (embed-certs-026000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:41.890160   16304 main.go:141] libmachine: (embed-certs-026000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000/hyperkit.pid
	I0307 10:12:41.890256   16304 main.go:141] libmachine: (embed-certs-026000) DBG | Using UUID 9929bf3e-5342-4a42-a952-e31a6a90c427
	I0307 10:12:41.928535   16304 main.go:141] libmachine: (embed-certs-026000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:41.928625   16304 fix.go:56] duration metric: took 113.198017ms for fixHost
	I0307 10:12:41.928633   16304 start.go:83] releasing machines lock for "embed-certs-026000", held for 113.236732ms
	W0307 10:12:41.928692   16304 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p embed-certs-026000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p embed-certs-026000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:41.970798   16304 out.go:177] 
	W0307 10:12:41.991601   16304 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:12:41.991699   16304 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:12:41.991719   16304 out.go:239] * Related issues:
	* Related issues:
	W0307 10:12:41.991751   16304 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:12:41.991784   16304 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:12:42.033921   16304 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p embed-certs-026000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000: exit status 7 (73.667995ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-026000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/SecondStart (6.39s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-061000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-061000 create -f testdata/busybox.yaml: exit status 1 (37.357939ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-061000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context default-k8s-diff-port-061000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000: exit status 7 (74.550159ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-061000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000: exit status 7 (73.126557ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-061000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.19s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p default-k8s-diff-port-061000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-061000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-061000 describe deploy/metrics-server -n kube-system: exit status 1 (37.194701ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-061000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context default-k8s-diff-port-061000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000: exit status 7 (73.966489ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-061000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.32s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (7.3s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p default-k8s-diff-port-061000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p default-k8s-diff-port-061000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (7.229350267s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-061000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "default-k8s-diff-port-061000" primary control-plane node in "default-k8s-diff-port-061000" cluster
	* Restarting existing hyperkit VM for "default-k8s-diff-port-061000" ...
	* Restarting existing hyperkit VM for "default-k8s-diff-port-061000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:12:39.884704   16355 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:12:39.884886   16355 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:39.884891   16355 out.go:304] Setting ErrFile to fd 2...
	I0307 10:12:39.884895   16355 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:39.885076   16355 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:12:39.886462   16355 out.go:298] Setting JSON to false
	I0307 10:12:39.908772   16355 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7930,"bootTime":1709827229,"procs":446,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:12:39.908869   16355 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:12:39.930682   16355 out.go:177] * [default-k8s-diff-port-061000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:12:39.972602   16355 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:12:39.972669   16355 notify.go:220] Checking for updates...
	I0307 10:12:40.015308   16355 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:12:40.036361   16355 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:12:40.057687   16355 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:12:40.100406   16355 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:40.121348   16355 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:12:40.143066   16355 config.go:182] Loaded profile config "default-k8s-diff-port-061000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:12:40.143705   16355 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:40.143793   16355 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:40.153109   16355 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61201
	I0307 10:12:40.153498   16355 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:40.153932   16355 main.go:141] libmachine: Using API Version  1
	I0307 10:12:40.153943   16355 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:40.154197   16355 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:40.154322   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .DriverName
	I0307 10:12:40.154515   16355 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:12:40.154765   16355 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:40.154792   16355 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:40.162555   16355 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61203
	I0307 10:12:40.162905   16355 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:40.163233   16355 main.go:141] libmachine: Using API Version  1
	I0307 10:12:40.163252   16355 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:40.163479   16355 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:40.163576   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .DriverName
	I0307 10:12:40.191464   16355 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 10:12:40.233359   16355 start.go:297] selected driver: hyperkit
	I0307 10:12:40.233389   16355 start.go:901] validating driver "hyperkit" against &{Name:default-k8s-diff-port-061000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-061000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false E
xtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:12:40.233571   16355 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:12:40.237812   16355 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:40.237903   16355 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:12:40.245725   16355 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:12:40.249677   16355 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:40.249699   16355 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:12:40.249844   16355 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 10:12:40.249913   16355 cni.go:84] Creating CNI manager for ""
	I0307 10:12:40.249936   16355 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:12:40.249985   16355 start.go:340] cluster config:
	{Name:default-k8s-diff-port-061000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-061000 N
amespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-hos
t Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:12:40.250068   16355 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:40.292315   16355 out.go:177] * Starting "default-k8s-diff-port-061000" primary control-plane node in "default-k8s-diff-port-061000" cluster
	I0307 10:12:40.313261   16355 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 10:12:40.313342   16355 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 10:12:40.313373   16355 cache.go:56] Caching tarball of preloaded images
	I0307 10:12:40.313537   16355 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:12:40.313557   16355 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 10:12:40.313689   16355 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/default-k8s-diff-port-061000/config.json ...
	I0307 10:12:40.314515   16355 start.go:360] acquireMachinesLock for default-k8s-diff-port-061000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:40.314663   16355 start.go:364] duration metric: took 106.538µs to acquireMachinesLock for "default-k8s-diff-port-061000"
	I0307 10:12:40.314702   16355 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:12:40.314741   16355 fix.go:54] fixHost starting: 
	I0307 10:12:40.315020   16355 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:40.315046   16355 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:40.323653   16355 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61205
	I0307 10:12:40.324005   16355 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:40.324421   16355 main.go:141] libmachine: Using API Version  1
	I0307 10:12:40.324439   16355 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:40.324671   16355 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:40.324773   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .DriverName
	I0307 10:12:40.324861   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .GetState
	I0307 10:12:40.324945   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:40.324958   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | hyperkit pid from json: 0
	I0307 10:12:40.324975   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000/hyperkit.json: no such file or directory
	I0307 10:12:40.324998   16355 fix.go:112] recreateIfNeeded on default-k8s-diff-port-061000: state=Stopped err=<nil>
	I0307 10:12:40.325013   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .DriverName
	W0307 10:12:40.325103   16355 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:12:40.367599   16355 out.go:177] * Restarting existing hyperkit VM for "default-k8s-diff-port-061000" ...
	I0307 10:12:40.388319   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .Start
	I0307 10:12:40.388517   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:40.388533   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000/hyperkit.pid
	I0307 10:12:40.388562   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | Using UUID 919b7f96-286b-40c4-ba34-605678a26e41
	I0307 10:12:40.389793   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:40.389894   16355 fix.go:56] duration metric: took 75.171778ms for fixHost
	I0307 10:12:40.389905   16355 start.go:83] releasing machines lock for "default-k8s-diff-port-061000", held for 75.229679ms
	W0307 10:12:40.389920   16355 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 10:12:40.389972   16355 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:40.389979   16355 start.go:728] Will try again in 5 seconds ...
	I0307 10:12:45.390277   16355 start.go:360] acquireMachinesLock for default-k8s-diff-port-061000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:46.756574   16355 start.go:364] duration metric: took 1.366206746s to acquireMachinesLock for "default-k8s-diff-port-061000"
	I0307 10:12:46.756621   16355 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:12:46.756633   16355 fix.go:54] fixHost starting: 
	I0307 10:12:46.757011   16355 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:46.757064   16355 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:46.766014   16355 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61238
	I0307 10:12:46.766348   16355 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:46.766694   16355 main.go:141] libmachine: Using API Version  1
	I0307 10:12:46.766703   16355 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:46.766921   16355 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:46.767044   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .DriverName
	I0307 10:12:46.767147   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .GetState
	I0307 10:12:46.767246   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:46.767290   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | hyperkit pid from json: 0
	I0307 10:12:46.767318   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000/hyperkit.json: no such file or directory
	I0307 10:12:46.767326   16355 fix.go:112] recreateIfNeeded on default-k8s-diff-port-061000: state=Stopped err=<nil>
	I0307 10:12:46.767334   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .DriverName
	W0307 10:12:46.767432   16355 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:12:46.788840   16355 out.go:177] * Restarting existing hyperkit VM for "default-k8s-diff-port-061000" ...
	I0307 10:12:46.852687   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .Start
	I0307 10:12:46.852976   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:46.853054   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000/hyperkit.pid
	I0307 10:12:46.853107   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | Using UUID 919b7f96-286b-40c4-ba34-605678a26e41
	I0307 10:12:46.923439   16355 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:46.923509   16355 fix.go:56] duration metric: took 166.874637ms for fixHost
	I0307 10:12:46.923517   16355 start.go:83] releasing machines lock for "default-k8s-diff-port-061000", held for 166.921245ms
	W0307 10:12:46.923576   16355 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-061000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-061000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:46.944626   16355 out.go:177] 
	W0307 10:12:46.965874   16355 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:12:46.965943   16355 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:12:46.965980   16355 out.go:239] * Related issues:
	* Related issues:
	W0307 10:12:46.966034   16355 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:12:46.966075   16355 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:12:46.990693   16355 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p default-k8s-diff-port-061000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000: exit status 7 (74.052975ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-061000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (7.30s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-026000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000: exit status 7 (72.924352ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-026000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-026000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-026000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context embed-certs-026000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (36.8813ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-026000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context embed-certs-026000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000: exit status 7 (73.265982ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-026000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.11s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p embed-certs-026000 image list --format=json
start_stop_delete_test.go:304: v1.28.4 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.4",
- 	"registry.k8s.io/kube-controller-manager:v1.28.4",
- 	"registry.k8s.io/kube-proxy:v1.28.4",
- 	"registry.k8s.io/kube-scheduler:v1.28.4",
- 	"registry.k8s.io/pause:3.9",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000: exit status 7 (73.228612ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-026000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p embed-certs-026000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p embed-certs-026000 --alsologtostderr -v=1: exit status 83 (139.838627ms)

                                                
                                                
-- stdout --
	* The control-plane node embed-certs-026000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p embed-certs-026000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:12:42.594240   16386 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:12:42.595055   16386 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:42.595072   16386 out.go:304] Setting ErrFile to fd 2...
	I0307 10:12:42.595079   16386 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:42.595576   16386 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:12:42.595901   16386 out.go:298] Setting JSON to false
	I0307 10:12:42.595918   16386 mustload.go:65] Loading cluster: embed-certs-026000
	I0307 10:12:42.596204   16386 config.go:182] Loaded profile config "embed-certs-026000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:12:42.596549   16386 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:42.596593   16386 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:42.604382   16386 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61223
	I0307 10:12:42.604814   16386 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:42.605251   16386 main.go:141] libmachine: Using API Version  1
	I0307 10:12:42.605261   16386 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:42.605460   16386 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:42.605563   16386 main.go:141] libmachine: (embed-certs-026000) Calling .GetState
	I0307 10:12:42.605655   16386 main.go:141] libmachine: (embed-certs-026000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:42.605717   16386 main.go:141] libmachine: (embed-certs-026000) DBG | hyperkit pid from json: 0
	I0307 10:12:42.605734   16386 main.go:141] libmachine: (embed-certs-026000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/embed-certs-026000/hyperkit.json: no such file or directory
	I0307 10:12:42.627445   16386 out.go:177] * The control-plane node embed-certs-026000 host is not running: state=Stopped
	I0307 10:12:42.649231   16386 out.go:177]   To start a cluster, run: "minikube start -p embed-certs-026000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p embed-certs-026000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000: exit status 7 (73.413964ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-026000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000: exit status 7 (74.694622ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-026000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/Pause (0.29s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (11.29s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p newest-cni-150000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
E0307 10:12:44.529834   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p newest-cni-150000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (11.209863969s)

                                                
                                                
-- stdout --
	* [newest-cni-150000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "newest-cni-150000" primary control-plane node in "newest-cni-150000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "newest-cni-150000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:12:43.576451   16415 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:12:43.577110   16415 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:43.577118   16415 out.go:304] Setting ErrFile to fd 2...
	I0307 10:12:43.577124   16415 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:43.577536   16415 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:12:43.579220   16415 out.go:298] Setting JSON to false
	I0307 10:12:43.601710   16415 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7934,"bootTime":1709827229,"procs":454,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:12:43.601804   16415 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:12:43.623544   16415 out.go:177] * [newest-cni-150000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:12:43.665387   16415 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:12:43.665428   16415 notify.go:220] Checking for updates...
	I0307 10:12:43.708031   16415 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:12:43.729167   16415 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:12:43.750142   16415 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:12:43.771176   16415 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:43.792091   16415 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:12:43.814071   16415 config.go:182] Loaded profile config "default-k8s-diff-port-061000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:12:43.814289   16415 config.go:182] Loaded profile config "multinode-949000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:12:43.814415   16415 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:12:43.844112   16415 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 10:12:43.886026   16415 start.go:297] selected driver: hyperkit
	I0307 10:12:43.886053   16415 start.go:901] validating driver "hyperkit" against <nil>
	I0307 10:12:43.886077   16415 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:12:43.890427   16415 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:43.890525   16415 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:12:43.898311   16415 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:12:43.902209   16415 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:43.902237   16415 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:12:43.902280   16415 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	W0307 10:12:43.902314   16415 out.go:239] ! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	I0307 10:12:43.902540   16415 start_flags.go:966] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I0307 10:12:43.902592   16415 cni.go:84] Creating CNI manager for ""
	I0307 10:12:43.902612   16415 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:12:43.902617   16415 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 10:12:43.902689   16415 start.go:340] cluster config:
	{Name:newest-cni-150000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-150000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetr
ics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:12:43.902793   16415 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:43.965183   16415 out.go:177] * Starting "newest-cni-150000" primary control-plane node in "newest-cni-150000" cluster
	I0307 10:12:43.986094   16415 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 10:12:43.986190   16415 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0307 10:12:43.986235   16415 cache.go:56] Caching tarball of preloaded images
	I0307 10:12:43.986425   16415 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:12:43.986439   16415 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0307 10:12:43.986563   16415 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/newest-cni-150000/config.json ...
	I0307 10:12:43.986596   16415 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/newest-cni-150000/config.json: {Name:mkae27bfccec56ee0c7aed1d4d7563475a8ccd01 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 10:12:43.987036   16415 start.go:360] acquireMachinesLock for newest-cni-150000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:43.987115   16415 start.go:364] duration metric: took 62.58µs to acquireMachinesLock for "newest-cni-150000"
	I0307 10:12:43.987149   16415 start.go:93] Provisioning new machine with config: &{Name:newest-cni-150000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-150000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube
-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:12:43.987245   16415 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:12:44.008264   16415 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:12:44.008553   16415 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:44.008622   16415 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:44.018049   16415 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61236
	I0307 10:12:44.018447   16415 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:44.019050   16415 main.go:141] libmachine: Using API Version  1
	I0307 10:12:44.019068   16415 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:44.019272   16415 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:44.019377   16415 main.go:141] libmachine: (newest-cni-150000) Calling .GetMachineName
	I0307 10:12:44.019464   16415 main.go:141] libmachine: (newest-cni-150000) Calling .DriverName
	I0307 10:12:44.019565   16415 start.go:159] libmachine.API.Create for "newest-cni-150000" (driver="hyperkit")
	I0307 10:12:44.019597   16415 client.go:168] LocalClient.Create starting
	I0307 10:12:44.019629   16415 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:12:44.019679   16415 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:44.019693   16415 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:44.019746   16415 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:12:44.019782   16415 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:44.019794   16415 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:44.019813   16415 main.go:141] libmachine: Running pre-create checks...
	I0307 10:12:44.019821   16415 main.go:141] libmachine: (newest-cni-150000) Calling .PreCreateCheck
	I0307 10:12:44.019900   16415 main.go:141] libmachine: (newest-cni-150000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:44.020099   16415 main.go:141] libmachine: (newest-cni-150000) Calling .GetConfigRaw
	I0307 10:12:44.029470   16415 main.go:141] libmachine: Creating machine...
	I0307 10:12:44.029480   16415 main.go:141] libmachine: (newest-cni-150000) Calling .Create
	I0307 10:12:44.029553   16415 main.go:141] libmachine: (newest-cni-150000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:44.029665   16415 main.go:141] libmachine: (newest-cni-150000) DBG | I0307 10:12:44.029544   16423 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:44.029807   16415 main.go:141] libmachine: (newest-cni-150000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:12:44.207215   16415 main.go:141] libmachine: (newest-cni-150000) DBG | I0307 10:12:44.207116   16423 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000/id_rsa...
	I0307 10:12:44.358285   16415 main.go:141] libmachine: (newest-cni-150000) DBG | I0307 10:12:44.358192   16423 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000/newest-cni-150000.rawdisk...
	I0307 10:12:44.358300   16415 main.go:141] libmachine: (newest-cni-150000) DBG | Writing magic tar header
	I0307 10:12:44.358314   16415 main.go:141] libmachine: (newest-cni-150000) DBG | Writing SSH key tar header
	I0307 10:12:44.358893   16415 main.go:141] libmachine: (newest-cni-150000) DBG | I0307 10:12:44.358852   16423 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000 ...
	I0307 10:12:44.720538   16415 main.go:141] libmachine: (newest-cni-150000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:44.720562   16415 main.go:141] libmachine: (newest-cni-150000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000/hyperkit.pid
	I0307 10:12:44.720602   16415 main.go:141] libmachine: (newest-cni-150000) DBG | Using UUID c4367150-1afd-4e84-9120-75f0df50c02d
	I0307 10:12:44.755666   16415 main.go:141] libmachine: (newest-cni-150000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:44.755766   16415 client.go:171] duration metric: took 736.147683ms to LocalClient.Create
	I0307 10:12:46.756424   16415 start.go:128] duration metric: took 2.76911873s to createHost
	I0307 10:12:46.756449   16415 start.go:83] releasing machines lock for "newest-cni-150000", held for 2.769280287s
	W0307 10:12:46.756486   16415 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 10:12:46.757011   16415 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:46.757048   16415 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:46.765867   16415 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61239
	I0307 10:12:46.766280   16415 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:46.766681   16415 main.go:141] libmachine: Using API Version  1
	I0307 10:12:46.766700   16415 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:46.766936   16415 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:46.767302   16415 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:46.767324   16415 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:46.775467   16415 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61242
	I0307 10:12:46.775833   16415 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:46.776162   16415 main.go:141] libmachine: Using API Version  1
	I0307 10:12:46.776173   16415 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:46.776360   16415 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:46.776463   16415 main.go:141] libmachine: (newest-cni-150000) Calling .GetState
	I0307 10:12:46.776541   16415 main.go:141] libmachine: (newest-cni-150000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:46.776560   16415 main.go:141] libmachine: (newest-cni-150000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000/hyperkit.json: no such file or directory
	I0307 10:12:46.776566   16415 main.go:141] libmachine: (newest-cni-150000) DBG | hyperkit pid from json: 0
	I0307 10:12:46.776626   16415 main.go:141] libmachine: (newest-cni-150000) Calling .DriverName
	I0307 10:12:46.830862   16415 out.go:177] * Deleting "newest-cni-150000" in hyperkit ...
	I0307 10:12:46.873759   16415 main.go:141] libmachine: (newest-cni-150000) Calling .Remove
	I0307 10:12:46.873914   16415 main.go:141] libmachine: (newest-cni-150000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:46.873924   16415 main.go:141] libmachine: (newest-cni-150000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:46.873941   16415 main.go:141] libmachine: (newest-cni-150000) DBG | hyperkit pid from json: 0
	I0307 10:12:46.873993   16415 main.go:141] libmachine: (newest-cni-150000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000/hyperkit.json: no such file or directory
	W0307 10:12:46.891884   16415 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:46.891898   16415 start.go:728] Will try again in 5 seconds ...
	I0307 10:12:51.893535   16415 start.go:360] acquireMachinesLock for newest-cni-150000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:51.893707   16415 start.go:364] duration metric: took 138.907µs to acquireMachinesLock for "newest-cni-150000"
	I0307 10:12:51.893773   16415 start.go:93] Provisioning new machine with config: &{Name:newest-cni-150000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-150000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube
-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 10:12:51.893930   16415 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 10:12:51.915765   16415 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 10:12:51.915906   16415 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:51.915951   16415 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:51.924972   16415 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61270
	I0307 10:12:51.925365   16415 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:51.925681   16415 main.go:141] libmachine: Using API Version  1
	I0307 10:12:51.925697   16415 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:51.925890   16415 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:51.925985   16415 main.go:141] libmachine: (newest-cni-150000) Calling .GetMachineName
	I0307 10:12:51.926082   16415 main.go:141] libmachine: (newest-cni-150000) Calling .DriverName
	I0307 10:12:51.926169   16415 start.go:159] libmachine.API.Create for "newest-cni-150000" (driver="hyperkit")
	I0307 10:12:51.926183   16415 client.go:168] LocalClient.Create starting
	I0307 10:12:51.926209   16415 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/ca.pem
	I0307 10:12:51.926255   16415 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:51.926265   16415 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:51.926302   16415 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18239-10855/.minikube/certs/cert.pem
	I0307 10:12:51.926337   16415 main.go:141] libmachine: Decoding PEM data...
	I0307 10:12:51.926352   16415 main.go:141] libmachine: Parsing certificate...
	I0307 10:12:51.926364   16415 main.go:141] libmachine: Running pre-create checks...
	I0307 10:12:51.926370   16415 main.go:141] libmachine: (newest-cni-150000) Calling .PreCreateCheck
	I0307 10:12:51.926443   16415 main.go:141] libmachine: (newest-cni-150000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:51.926480   16415 main.go:141] libmachine: (newest-cni-150000) Calling .GetConfigRaw
	I0307 10:12:51.926933   16415 main.go:141] libmachine: Creating machine...
	I0307 10:12:51.926942   16415 main.go:141] libmachine: (newest-cni-150000) Calling .Create
	I0307 10:12:51.927009   16415 main.go:141] libmachine: (newest-cni-150000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:51.927135   16415 main.go:141] libmachine: (newest-cni-150000) DBG | I0307 10:12:51.927003   16473 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:51.927182   16415 main.go:141] libmachine: (newest-cni-150000) Downloading /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 10:12:52.104063   16415 main.go:141] libmachine: (newest-cni-150000) DBG | I0307 10:12:52.104000   16473 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000/id_rsa...
	I0307 10:12:52.176120   16415 main.go:141] libmachine: (newest-cni-150000) DBG | I0307 10:12:52.176043   16473 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000/newest-cni-150000.rawdisk...
	I0307 10:12:52.176134   16415 main.go:141] libmachine: (newest-cni-150000) DBG | Writing magic tar header
	I0307 10:12:52.176144   16415 main.go:141] libmachine: (newest-cni-150000) DBG | Writing SSH key tar header
	I0307 10:12:52.176913   16415 main.go:141] libmachine: (newest-cni-150000) DBG | I0307 10:12:52.176822   16473 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000 ...
	I0307 10:12:52.537755   16415 main.go:141] libmachine: (newest-cni-150000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:52.537775   16415 main.go:141] libmachine: (newest-cni-150000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000/hyperkit.pid
	I0307 10:12:52.537799   16415 main.go:141] libmachine: (newest-cni-150000) DBG | Using UUID e3bca3c3-b280-4a8a-9ccb-1dea4d6feb53
	I0307 10:12:52.573105   16415 main.go:141] libmachine: (newest-cni-150000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:52.573180   16415 client.go:171] duration metric: took 646.980302ms to LocalClient.Create
	I0307 10:12:54.575443   16415 start.go:128] duration metric: took 2.681450518s to createHost
	I0307 10:12:54.575475   16415 start.go:83] releasing machines lock for "newest-cni-150000", held for 2.681711379s
	W0307 10:12:54.575628   16415 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p newest-cni-150000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p newest-cni-150000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:54.618189   16415 out.go:177] 
	W0307 10:12:54.642137   16415 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:12:54.642212   16415 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:12:54.642225   16415 out.go:239] * Related issues:
	* Related issues:
	W0307 10:12:54.642245   16415 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:12:54.642258   16415 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:12:54.664228   16415 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p newest-cni-150000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-150000 -n newest-cni-150000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-150000 -n newest-cni-150000: exit status 7 (74.674285ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-150000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/FirstStart (11.29s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-061000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000: exit status 7 (73.394273ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-061000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-061000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-061000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-061000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (37.090758ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-061000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context default-k8s-diff-port-061000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000: exit status 7 (73.413199ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-061000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.11s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p default-k8s-diff-port-061000 image list --format=json
start_stop_delete_test.go:304: v1.28.4 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.4",
- 	"registry.k8s.io/kube-controller-manager:v1.28.4",
- 	"registry.k8s.io/kube-proxy:v1.28.4",
- 	"registry.k8s.io/kube-scheduler:v1.28.4",
- 	"registry.k8s.io/pause:3.9",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000: exit status 7 (73.625264ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-061000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p default-k8s-diff-port-061000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p default-k8s-diff-port-061000 --alsologtostderr -v=1: exit status 83 (138.891171ms)

                                                
                                                
-- stdout --
	* The control-plane node default-k8s-diff-port-061000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p default-k8s-diff-port-061000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:12:47.556052   16445 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:12:47.556323   16445 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:47.556328   16445 out.go:304] Setting ErrFile to fd 2...
	I0307 10:12:47.556332   16445 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:47.556492   16445 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:12:47.556794   16445 out.go:298] Setting JSON to false
	I0307 10:12:47.556809   16445 mustload.go:65] Loading cluster: default-k8s-diff-port-061000
	I0307 10:12:47.558172   16445 config.go:182] Loaded profile config "default-k8s-diff-port-061000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 10:12:47.558505   16445 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:47.558554   16445 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:47.566289   16445 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61258
	I0307 10:12:47.566734   16445 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:47.567172   16445 main.go:141] libmachine: Using API Version  1
	I0307 10:12:47.567182   16445 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:47.567433   16445 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:47.567546   16445 main.go:141] libmachine: (default-k8s-diff-port-061000) Calling .GetState
	I0307 10:12:47.567633   16445 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:47.567661   16445 main.go:141] libmachine: (default-k8s-diff-port-061000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/default-k8s-diff-port-061000/hyperkit.json: no such file or directory
	I0307 10:12:47.567671   16445 main.go:141] libmachine: (default-k8s-diff-port-061000) DBG | hyperkit pid from json: 0
	I0307 10:12:47.589277   16445 out.go:177] * The control-plane node default-k8s-diff-port-061000 host is not running: state=Stopped
	I0307 10:12:47.610152   16445 out.go:177]   To start a cluster, run: "minikube start -p default-k8s-diff-port-061000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p default-k8s-diff-port-061000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000: exit status 7 (73.28143ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-061000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000: exit status 7 (74.246305ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-061000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/Pause (0.29s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (5.93s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p newest-cni-150000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p newest-cni-150000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (5.856699846s)

                                                
                                                
-- stdout --
	* [newest-cni-150000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "newest-cni-150000" primary control-plane node in "newest-cni-150000" cluster
	* Restarting existing hyperkit VM for "newest-cni-150000" ...
	* Restarting existing hyperkit VM for "newest-cni-150000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:12:59.072867   16513 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:12:59.073131   16513 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:59.073138   16513 out.go:304] Setting ErrFile to fd 2...
	I0307 10:12:59.073142   16513 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:12:59.073329   16513 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:12:59.074674   16513 out.go:298] Setting JSON to false
	I0307 10:12:59.097014   16513 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":7950,"bootTime":1709827229,"procs":435,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 10:12:59.097108   16513 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 10:12:59.120855   16513 out.go:177] * [newest-cni-150000] minikube v1.32.0 on Darwin 14.3.1
	I0307 10:12:59.183789   16513 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 10:12:59.162779   16513 notify.go:220] Checking for updates...
	I0307 10:12:59.225674   16513 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 10:12:59.246843   16513 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 10:12:59.288671   16513 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 10:12:59.309664   16513 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 10:12:59.330787   16513 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 10:12:59.352455   16513 config.go:182] Loaded profile config "newest-cni-150000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0307 10:12:59.353100   16513 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:59.353183   16513 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:59.362241   16513 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61301
	I0307 10:12:59.362593   16513 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:59.363036   16513 main.go:141] libmachine: Using API Version  1
	I0307 10:12:59.363046   16513 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:59.363316   16513 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:59.363454   16513 main.go:141] libmachine: (newest-cni-150000) Calling .DriverName
	I0307 10:12:59.363669   16513 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 10:12:59.363905   16513 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:59.363928   16513 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:59.371875   16513 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61303
	I0307 10:12:59.372216   16513 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:59.372550   16513 main.go:141] libmachine: Using API Version  1
	I0307 10:12:59.372564   16513 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:59.372799   16513 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:59.372899   16513 main.go:141] libmachine: (newest-cni-150000) Calling .DriverName
	I0307 10:12:59.401715   16513 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 10:12:59.443712   16513 start.go:297] selected driver: hyperkit
	I0307 10:12:59.443740   16513 start.go:901] validating driver "hyperkit" against &{Name:newest-cni-150000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-150000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> Exp
osedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:12:59.443954   16513 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 10:12:59.448113   16513 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:59.448215   16513 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 10:12:59.456072   16513 install.go:137] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 10:12:59.459994   16513 install.go:79] stdout: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:59.460019   16513 install.go:81] /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 10:12:59.460197   16513 start_flags.go:966] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I0307 10:12:59.460254   16513 cni.go:84] Creating CNI manager for ""
	I0307 10:12:59.460269   16513 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 10:12:59.460317   16513 start.go:340] cluster config:
	{Name:newest-cni-150000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-150000 Namespace:default
APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0
CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 10:12:59.460401   16513 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 10:12:59.502652   16513 out.go:177] * Starting "newest-cni-150000" primary control-plane node in "newest-cni-150000" cluster
	I0307 10:12:59.523702   16513 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 10:12:59.523776   16513 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0307 10:12:59.523812   16513 cache.go:56] Caching tarball of preloaded images
	I0307 10:12:59.524014   16513 preload.go:173] Found /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 10:12:59.524036   16513 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0307 10:12:59.524206   16513 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/newest-cni-150000/config.json ...
	I0307 10:12:59.524996   16513 start.go:360] acquireMachinesLock for newest-cni-150000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:12:59.525063   16513 start.go:364] duration metric: took 50.296µs to acquireMachinesLock for "newest-cni-150000"
	I0307 10:12:59.525087   16513 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:12:59.525099   16513 fix.go:54] fixHost starting: 
	I0307 10:12:59.525381   16513 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:12:59.525410   16513 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:12:59.533750   16513 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61305
	I0307 10:12:59.534106   16513 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:12:59.534448   16513 main.go:141] libmachine: Using API Version  1
	I0307 10:12:59.534456   16513 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:12:59.534661   16513 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:12:59.534774   16513 main.go:141] libmachine: (newest-cni-150000) Calling .DriverName
	I0307 10:12:59.534866   16513 main.go:141] libmachine: (newest-cni-150000) Calling .GetState
	I0307 10:12:59.534950   16513 main.go:141] libmachine: (newest-cni-150000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:59.534961   16513 main.go:141] libmachine: (newest-cni-150000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000/hyperkit.json: no such file or directory
	I0307 10:12:59.534967   16513 main.go:141] libmachine: (newest-cni-150000) DBG | hyperkit pid from json: 0
	I0307 10:12:59.535003   16513 fix.go:112] recreateIfNeeded on newest-cni-150000: state=Stopped err=<nil>
	I0307 10:12:59.535017   16513 main.go:141] libmachine: (newest-cni-150000) Calling .DriverName
	W0307 10:12:59.535103   16513 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:12:59.577695   16513 out.go:177] * Restarting existing hyperkit VM for "newest-cni-150000" ...
	I0307 10:12:59.598836   16513 main.go:141] libmachine: (newest-cni-150000) Calling .Start
	I0307 10:12:59.599192   16513 main.go:141] libmachine: (newest-cni-150000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:12:59.599311   16513 main.go:141] libmachine: (newest-cni-150000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000/hyperkit.pid
	I0307 10:12:59.599429   16513 main.go:141] libmachine: (newest-cni-150000) DBG | Using UUID e3bca3c3-b280-4a8a-9ccb-1dea4d6feb53
	I0307 10:12:59.601355   16513 main.go:141] libmachine: (newest-cni-150000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:12:59.601487   16513 fix.go:56] duration metric: took 76.387161ms for fixHost
	I0307 10:12:59.601501   16513 start.go:83] releasing machines lock for "newest-cni-150000", held for 76.427448ms
	W0307 10:12:59.601520   16513 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 10:12:59.601590   16513 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:12:59.601598   16513 start.go:728] Will try again in 5 seconds ...
	I0307 10:13:04.602595   16513 start.go:360] acquireMachinesLock for newest-cni-150000: {Name:mka110980ada30389737b2ae71f910e4fd7ee49f Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 10:13:04.602801   16513 start.go:364] duration metric: took 163.2µs to acquireMachinesLock for "newest-cni-150000"
	I0307 10:13:04.602843   16513 start.go:96] Skipping create...Using existing machine configuration
	I0307 10:13:04.602851   16513 fix.go:54] fixHost starting: 
	I0307 10:13:04.603178   16513 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:13:04.603210   16513 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:13:04.612080   16513 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61307
	I0307 10:13:04.612489   16513 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:13:04.612844   16513 main.go:141] libmachine: Using API Version  1
	I0307 10:13:04.612856   16513 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:13:04.613100   16513 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:13:04.613208   16513 main.go:141] libmachine: (newest-cni-150000) Calling .DriverName
	I0307 10:13:04.613298   16513 main.go:141] libmachine: (newest-cni-150000) Calling .GetState
	I0307 10:13:04.613389   16513 main.go:141] libmachine: (newest-cni-150000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:13:04.613422   16513 main.go:141] libmachine: (newest-cni-150000) DBG | hyperkit pid from json: 0
	I0307 10:13:04.613438   16513 main.go:141] libmachine: (newest-cni-150000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000/hyperkit.json: no such file or directory
	I0307 10:13:04.613437   16513 fix.go:112] recreateIfNeeded on newest-cni-150000: state=Stopped err=<nil>
	I0307 10:13:04.613460   16513 main.go:141] libmachine: (newest-cni-150000) Calling .DriverName
	W0307 10:13:04.613551   16513 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 10:13:04.657040   16513 out.go:177] * Restarting existing hyperkit VM for "newest-cni-150000" ...
	I0307 10:13:04.678796   16513 main.go:141] libmachine: (newest-cni-150000) Calling .Start
	I0307 10:13:04.679063   16513 main.go:141] libmachine: (newest-cni-150000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:13:04.679096   16513 main.go:141] libmachine: (newest-cni-150000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000/hyperkit.pid
	I0307 10:13:04.679179   16513 main.go:141] libmachine: (newest-cni-150000) DBG | Using UUID e3bca3c3-b280-4a8a-9ccb-1dea4d6feb53
	I0307 10:13:04.718070   16513 main.go:141] libmachine: (newest-cni-150000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 10:13:04.718169   16513 fix.go:56] duration metric: took 115.315962ms for fixHost
	I0307 10:13:04.718178   16513 start.go:83] releasing machines lock for "newest-cni-150000", held for 115.357669ms
	W0307 10:13:04.718238   16513 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p newest-cni-150000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p newest-cni-150000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 10:13:04.762054   16513 out.go:177] 
	W0307 10:13:04.783033   16513 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 10:13:04.783112   16513 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 10:13:04.783128   16513 out.go:239] * Related issues:
	* Related issues:
	W0307 10:13:04.783153   16513 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 10:13:04.783173   16513 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 10:13:04.805154   16513 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p newest-cni-150000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-150000 -n newest-cni-150000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-150000 -n newest-cni-150000: exit status 7 (75.660205ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-150000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/SecondStart (5.93s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p newest-cni-150000 image list --format=json
start_stop_delete_test.go:304: v1.29.0-rc.2 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.1",
- 	"registry.k8s.io/etcd:3.5.10-0",
- 	"registry.k8s.io/kube-apiserver:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-controller-manager:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-proxy:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-scheduler:v1.29.0-rc.2",
- 	"registry.k8s.io/pause:3.9",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-150000 -n newest-cni-150000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-150000 -n newest-cni-150000: exit status 7 (74.780092ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-150000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (0.31s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p newest-cni-150000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p newest-cni-150000 --alsologtostderr -v=1: exit status 83 (166.149011ms)

                                                
                                                
-- stdout --
	* The control-plane node newest-cni-150000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p newest-cni-150000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 10:13:05.190740   16542 out.go:291] Setting OutFile to fd 1 ...
	I0307 10:13:05.190979   16542 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:13:05.190984   16542 out.go:304] Setting ErrFile to fd 2...
	I0307 10:13:05.190988   16542 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 10:13:05.191165   16542 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 10:13:05.191472   16542 out.go:298] Setting JSON to false
	I0307 10:13:05.191487   16542 mustload.go:65] Loading cluster: newest-cni-150000
	I0307 10:13:05.191756   16542 config.go:182] Loaded profile config "newest-cni-150000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0307 10:13:05.192085   16542 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit
	I0307 10:13:05.192142   16542 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 10:13:05.199896   16542 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:61317
	I0307 10:13:05.200318   16542 main.go:141] libmachine: () Calling .GetVersion
	I0307 10:13:05.200734   16542 main.go:141] libmachine: Using API Version  1
	I0307 10:13:05.200743   16542 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 10:13:05.200935   16542 main.go:141] libmachine: () Calling .GetMachineName
	I0307 10:13:05.201034   16542 main.go:141] libmachine: (newest-cni-150000) Calling .GetState
	I0307 10:13:05.201115   16542 main.go:141] libmachine: (newest-cni-150000) DBG | exe=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 10:13:05.201169   16542 main.go:141] libmachine: (newest-cni-150000) DBG | hyperkit pid from json: 0
	I0307 10:13:05.201201   16542 main.go:141] libmachine: (newest-cni-150000) Error reading pid file: open /Users/jenkins/minikube-integration/18239-10855/.minikube/machines/newest-cni-150000/hyperkit.json: no such file or directory
	I0307 10:13:05.222965   16542 out.go:177] * The control-plane node newest-cni-150000 host is not running: state=Stopped
	I0307 10:13:05.271541   16542 out.go:177]   To start a cluster, run: "minikube start -p newest-cni-150000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p newest-cni-150000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-150000 -n newest-cni-150000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-150000 -n newest-cni-150000: exit status 7 (73.939996ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-150000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-150000 -n newest-cni-150000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-150000 -n newest-cni-150000: exit status 7 (74.168705ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-150000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/Pause (0.31s)

                                                
                                    

Test pass (101/280)

Order passed test Duration
3 TestDownloadOnly/v1.20.0/json-events 27.76
4 TestDownloadOnly/v1.20.0/preload-exists 0
7 TestDownloadOnly/v1.20.0/kubectl 0
8 TestDownloadOnly/v1.20.0/LogsDuration 0.33
9 TestDownloadOnly/v1.20.0/DeleteAll 0.39
10 TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds 0.38
12 TestDownloadOnly/v1.28.4/json-events 19.8
13 TestDownloadOnly/v1.28.4/preload-exists 0
16 TestDownloadOnly/v1.28.4/kubectl 0
17 TestDownloadOnly/v1.28.4/LogsDuration 0.32
18 TestDownloadOnly/v1.28.4/DeleteAll 0.39
19 TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds 0.37
21 TestDownloadOnly/v1.29.0-rc.2/json-events 9.92
22 TestDownloadOnly/v1.29.0-rc.2/preload-exists 0
25 TestDownloadOnly/v1.29.0-rc.2/kubectl 0
26 TestDownloadOnly/v1.29.0-rc.2/LogsDuration 0.36
27 TestDownloadOnly/v1.29.0-rc.2/DeleteAll 0.4
28 TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds 0.38
30 TestBinaryMirror 1.05
34 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.15
35 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.19
36 TestAddons/Setup 254.07
38 TestAddons/parallel/Registry 14.38
39 TestAddons/parallel/Ingress 18.79
40 TestAddons/parallel/InspektorGadget 11.49
41 TestAddons/parallel/MetricsServer 5.48
42 TestAddons/parallel/HelmTiller 10.03
44 TestAddons/parallel/CSI 61.94
45 TestAddons/parallel/Headlamp 14.34
46 TestAddons/parallel/CloudSpanner 5.4
47 TestAddons/parallel/LocalPath 52.32
48 TestAddons/parallel/NvidiaDevicePlugin 5.37
49 TestAddons/parallel/Yakd 6.01
52 TestAddons/serial/GCPAuth/Namespaces 0.09
53 TestAddons/StoppedEnableDisable 5.95
61 TestHyperKitDriverInstallOrUpdate 12.23
65 TestErrorSpam/start 1.29
66 TestErrorSpam/status 0.22
67 TestErrorSpam/pause 0.42
68 TestErrorSpam/unpause 0.42
69 TestErrorSpam/stop 10.71
72 TestFunctional/serial/CopySyncFile 0
74 TestFunctional/serial/AuditLog 0
80 TestFunctional/serial/CacheCmd/cache/add_remote 1.9
81 TestFunctional/serial/CacheCmd/cache/add_local 1.38
82 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.09
83 TestFunctional/serial/CacheCmd/cache/list 0.09
86 TestFunctional/serial/CacheCmd/cache/delete 0.18
95 TestFunctional/parallel/ConfigCmd 0.64
97 TestFunctional/parallel/DryRun 0.92
98 TestFunctional/parallel/InternationalLanguage 0.54
104 TestFunctional/parallel/AddonsCmd 0.27
119 TestFunctional/parallel/License 0.7
120 TestFunctional/parallel/Version/short 0.11
127 TestFunctional/parallel/ImageCommands/Setup 2.72
141 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0.02
148 TestFunctional/parallel/ImageCommands/ImageRemove 0.2
150 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.21
151 TestFunctional/parallel/ProfileCmd/profile_not_create 0.28
152 TestFunctional/parallel/ProfileCmd/profile_list 0.23
153 TestFunctional/parallel/ProfileCmd/profile_json_output 0.23
158 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil 10.03
160 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.14
161 TestFunctional/delete_addon-resizer_images 0.13
162 TestFunctional/delete_my-image_image 0.05
163 TestFunctional/delete_minikube_cached_images 0.05
192 TestJSONOutput/start/Audit 0
198 TestJSONOutput/pause/Audit 0
200 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
201 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
204 TestJSONOutput/unpause/Audit 0
206 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
207 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
209 TestJSONOutput/stop/Command 3.65
210 TestJSONOutput/stop/Audit 0
212 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
213 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
214 TestErrorJSONOutput 0.77
219 TestMainNoArgs 0.09
264 TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current 2.64
265 TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current 6.28
266 TestStoppedBinaryUpgrade/Setup 1.26
279 TestNoKubernetes/serial/StartNoK8sWithVersion 0.41
283 TestNoKubernetes/serial/VerifyK8sNotRunning 0.14
284 TestNoKubernetes/serial/ProfileList 0.33
285 TestNoKubernetes/serial/Stop 3.24
287 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.14
303 TestStartStop/group/old-k8s-version/serial/Stop 3.39
304 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.33
308 TestStartStop/group/no-preload/serial/Stop 2.8
309 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.33
325 TestStartStop/group/embed-certs/serial/Stop 3.01
326 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.35
330 TestStartStop/group/default-k8s-diff-port/serial/Stop 1.99
331 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.33
343 TestStartStop/group/newest-cni/serial/DeployApp 0
344 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 0.21
345 TestStartStop/group/newest-cni/serial/Stop 3.67
346 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.33
348 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
349 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
x
+
TestDownloadOnly/v1.20.0/json-events (27.76s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-228000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=hyperkit 
aaa_download_only_test.go:81: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-228000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=hyperkit : (27.76150364s)
--- PASS: TestDownloadOnly/v1.20.0/json-events (27.76s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/preload-exists
--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/kubectl
--- PASS: TestDownloadOnly/v1.20.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/LogsDuration (0.33s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-228000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-228000: exit status 85 (333.625665ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-228000 | jenkins | v1.32.0 | 07 Mar 24 09:47 PST |          |
	|         | -p download-only-228000        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=hyperkit              |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/07 09:47:27
	Running on machine: MacOS-Agent-2
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0307 09:47:27.222971   11300 out.go:291] Setting OutFile to fd 1 ...
	I0307 09:47:27.223182   11300 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:47:27.223187   11300 out.go:304] Setting ErrFile to fd 2...
	I0307 09:47:27.223191   11300 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:47:27.223374   11300 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	W0307 09:47:27.223475   11300 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/18239-10855/.minikube/config/config.json: open /Users/jenkins/minikube-integration/18239-10855/.minikube/config/config.json: no such file or directory
	I0307 09:47:27.225155   11300 out.go:298] Setting JSON to true
	I0307 09:47:27.247626   11300 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":6418,"bootTime":1709827229,"procs":432,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 09:47:27.247719   11300 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 09:47:27.270780   11300 out.go:97] [download-only-228000] minikube v1.32.0 on Darwin 14.3.1
	I0307 09:47:27.298481   11300 out.go:169] MINIKUBE_LOCATION=18239
	W0307 09:47:27.270986   11300 preload.go:294] Failed to list preload files: open /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball: no such file or directory
	I0307 09:47:27.270971   11300 notify.go:220] Checking for updates...
	I0307 09:47:27.341971   11300 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 09:47:27.363055   11300 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 09:47:27.384105   11300 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 09:47:27.426061   11300 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	W0307 09:47:27.468146   11300 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0307 09:47:27.468683   11300 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 09:47:27.499062   11300 out.go:97] Using the hyperkit driver based on user configuration
	I0307 09:47:27.499135   11300 start.go:297] selected driver: hyperkit
	I0307 09:47:27.499150   11300 start.go:901] validating driver "hyperkit" against <nil>
	I0307 09:47:27.499362   11300 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 09:47:27.499578   11300 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 09:47:27.643877   11300 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 09:47:27.647955   11300 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:47:27.647977   11300 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 09:47:27.648004   11300 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 09:47:27.650994   11300 start_flags.go:393] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB
	I0307 09:47:27.651140   11300 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0307 09:47:27.651196   11300 cni.go:84] Creating CNI manager for ""
	I0307 09:47:27.651213   11300 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0307 09:47:27.651277   11300 start.go:340] cluster config:
	{Name:download-only-228000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:6000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-228000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 09:47:27.651501   11300 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 09:47:27.673187   11300 out.go:97] Downloading VM boot image ...
	I0307 09:47:27.673308   11300 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso.sha256 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso
	I0307 09:47:33.199388   11300 out.go:97] Starting "download-only-228000" primary control-plane node in "download-only-228000" cluster
	I0307 09:47:33.199426   11300 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0307 09:47:33.255605   11300 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0307 09:47:33.255672   11300 cache.go:56] Caching tarball of preloaded images
	I0307 09:47:33.256016   11300 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0307 09:47:33.277458   11300 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I0307 09:47:33.277488   11300 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...
	I0307 09:47:33.362250   11300 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4?checksum=md5:9a82241e9b8b4ad2b5cca73108f2c7a3 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0307 09:47:39.232481   11300 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...
	I0307 09:47:39.232667   11300 preload.go:255] verifying checksum of /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...
	I0307 09:47:39.782516   11300 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0307 09:47:39.782750   11300 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/download-only-228000/config.json ...
	I0307 09:47:39.782772   11300 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/download-only-228000/config.json: {Name:mk10d9b5271b5fe35fd45db1c944a49bc82ab8a7 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 09:47:39.783067   11300 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0307 09:47:39.783376   11300 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/amd64/kubectl.sha256 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/darwin/amd64/v1.20.0/kubectl
	
	
	* The control-plane node download-only-228000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-228000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.33s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAll (0.39s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-amd64 delete --all
--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (0.39s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.38s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-228000
--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.38s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/json-events (19.8s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-377000 --force --alsologtostderr --kubernetes-version=v1.28.4 --container-runtime=docker --driver=hyperkit 
aaa_download_only_test.go:81: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-377000 --force --alsologtostderr --kubernetes-version=v1.28.4 --container-runtime=docker --driver=hyperkit : (19.80414836s)
--- PASS: TestDownloadOnly/v1.28.4/json-events (19.80s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/preload-exists
--- PASS: TestDownloadOnly/v1.28.4/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/kubectl
--- PASS: TestDownloadOnly/v1.28.4/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/LogsDuration (0.32s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-377000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-377000: exit status 85 (315.635599ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-228000 | jenkins | v1.32.0 | 07 Mar 24 09:47 PST |                     |
	|         | -p download-only-228000        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |                     |
	|         | --container-runtime=docker     |                      |         |         |                     |                     |
	|         | --driver=hyperkit              |                      |         |         |                     |                     |
	| delete  | --all                          | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:47 PST | 07 Mar 24 09:47 PST |
	| delete  | -p download-only-228000        | download-only-228000 | jenkins | v1.32.0 | 07 Mar 24 09:47 PST | 07 Mar 24 09:47 PST |
	| start   | -o=json --download-only        | download-only-377000 | jenkins | v1.32.0 | 07 Mar 24 09:47 PST |                     |
	|         | -p download-only-377000        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.28.4   |                      |         |         |                     |                     |
	|         | --container-runtime=docker     |                      |         |         |                     |                     |
	|         | --driver=hyperkit              |                      |         |         |                     |                     |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/07 09:47:56
	Running on machine: MacOS-Agent-2
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0307 09:47:56.089304   11343 out.go:291] Setting OutFile to fd 1 ...
	I0307 09:47:56.089481   11343 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:47:56.089487   11343 out.go:304] Setting ErrFile to fd 2...
	I0307 09:47:56.089491   11343 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:47:56.089660   11343 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 09:47:56.091061   11343 out.go:298] Setting JSON to true
	I0307 09:47:56.113101   11343 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":6447,"bootTime":1709827229,"procs":429,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 09:47:56.113188   11343 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 09:47:56.134359   11343 out.go:97] [download-only-377000] minikube v1.32.0 on Darwin 14.3.1
	I0307 09:47:56.155910   11343 out.go:169] MINIKUBE_LOCATION=18239
	I0307 09:47:56.134584   11343 notify.go:220] Checking for updates...
	I0307 09:47:56.198109   11343 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 09:47:56.219038   11343 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 09:47:56.261176   11343 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 09:47:56.281849   11343 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	W0307 09:47:56.324140   11343 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0307 09:47:56.324637   11343 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 09:47:56.353943   11343 out.go:97] Using the hyperkit driver based on user configuration
	I0307 09:47:56.353995   11343 start.go:297] selected driver: hyperkit
	I0307 09:47:56.354010   11343 start.go:901] validating driver "hyperkit" against <nil>
	I0307 09:47:56.354204   11343 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 09:47:56.354413   11343 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 09:47:56.363574   11343 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 09:47:56.367426   11343 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:47:56.367455   11343 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 09:47:56.367485   11343 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 09:47:56.370166   11343 start_flags.go:393] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB
	I0307 09:47:56.370320   11343 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0307 09:47:56.370375   11343 cni.go:84] Creating CNI manager for ""
	I0307 09:47:56.370394   11343 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 09:47:56.370404   11343 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 09:47:56.370476   11343 start.go:340] cluster config:
	{Name:download-only-377000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:6000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:download-only-377000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 09:47:56.370565   11343 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 09:47:56.391910   11343 out.go:97] Starting "download-only-377000" primary control-plane node in "download-only-377000" cluster
	I0307 09:47:56.391944   11343 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 09:47:56.443496   11343 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.4/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 09:47:56.443570   11343 cache.go:56] Caching tarball of preloaded images
	I0307 09:47:56.446322   11343 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 09:47:56.467569   11343 out.go:97] Downloading Kubernetes v1.28.4 preload ...
	I0307 09:47:56.467599   11343 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 ...
	I0307 09:47:56.547931   11343 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.4/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4?checksum=md5:7ebdea7754e21f51b865dbfc36b53b7d -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 09:48:03.750665   11343 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 ...
	I0307 09:48:03.750851   11343 preload.go:255] verifying checksum of /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 ...
	I0307 09:48:04.330977   11343 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 09:48:04.331228   11343 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/download-only-377000/config.json ...
	I0307 09:48:04.331254   11343 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/download-only-377000/config.json: {Name:mkbceb563cbe17516c34ccbee799ae4d02e8f962 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 09:48:04.331571   11343 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 09:48:04.331786   11343 download.go:107] Downloading: https://dl.k8s.io/release/v1.28.4/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/darwin/amd64/kubectl.sha256 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/darwin/amd64/v1.28.4/kubectl
	
	
	* The control-plane node download-only-377000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-377000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.4/LogsDuration (0.32s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/DeleteAll (0.39s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-amd64 delete --all
--- PASS: TestDownloadOnly/v1.28.4/DeleteAll (0.39s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds (0.37s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-377000
--- PASS: TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds (0.37s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/json-events (9.92s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-068000 --force --alsologtostderr --kubernetes-version=v1.29.0-rc.2 --container-runtime=docker --driver=hyperkit 
aaa_download_only_test.go:81: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-068000 --force --alsologtostderr --kubernetes-version=v1.29.0-rc.2 --container-runtime=docker --driver=hyperkit : (9.91931895s)
--- PASS: TestDownloadOnly/v1.29.0-rc.2/json-events (9.92s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/preload-exists
--- PASS: TestDownloadOnly/v1.29.0-rc.2/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/kubectl
--- PASS: TestDownloadOnly/v1.29.0-rc.2/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/LogsDuration (0.36s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-068000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-068000: exit status 85 (363.074902ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |               Args                |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only           | download-only-228000 | jenkins | v1.32.0 | 07 Mar 24 09:47 PST |                     |
	|         | -p download-only-228000           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0      |                      |         |         |                     |                     |
	|         | --container-runtime=docker        |                      |         |         |                     |                     |
	|         | --driver=hyperkit                 |                      |         |         |                     |                     |
	| delete  | --all                             | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:47 PST | 07 Mar 24 09:47 PST |
	| delete  | -p download-only-228000           | download-only-228000 | jenkins | v1.32.0 | 07 Mar 24 09:47 PST | 07 Mar 24 09:47 PST |
	| start   | -o=json --download-only           | download-only-377000 | jenkins | v1.32.0 | 07 Mar 24 09:47 PST |                     |
	|         | -p download-only-377000           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.28.4      |                      |         |         |                     |                     |
	|         | --container-runtime=docker        |                      |         |         |                     |                     |
	|         | --driver=hyperkit                 |                      |         |         |                     |                     |
	| delete  | --all                             | minikube             | jenkins | v1.32.0 | 07 Mar 24 09:48 PST | 07 Mar 24 09:48 PST |
	| delete  | -p download-only-377000           | download-only-377000 | jenkins | v1.32.0 | 07 Mar 24 09:48 PST | 07 Mar 24 09:48 PST |
	| start   | -o=json --download-only           | download-only-068000 | jenkins | v1.32.0 | 07 Mar 24 09:48 PST |                     |
	|         | -p download-only-068000           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.29.0-rc.2 |                      |         |         |                     |                     |
	|         | --container-runtime=docker        |                      |         |         |                     |                     |
	|         | --driver=hyperkit                 |                      |         |         |                     |                     |
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/07 09:48:16
	Running on machine: MacOS-Agent-2
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0307 09:48:16.973865   11383 out.go:291] Setting OutFile to fd 1 ...
	I0307 09:48:16.974126   11383 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:48:16.974132   11383 out.go:304] Setting ErrFile to fd 2...
	I0307 09:48:16.974136   11383 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:48:16.974311   11383 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 09:48:16.975865   11383 out.go:298] Setting JSON to true
	I0307 09:48:16.998999   11383 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":6467,"bootTime":1709827229,"procs":420,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 09:48:16.999093   11383 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 09:48:17.020043   11383 out.go:97] [download-only-068000] minikube v1.32.0 on Darwin 14.3.1
	I0307 09:48:17.041554   11383 out.go:169] MINIKUBE_LOCATION=18239
	I0307 09:48:17.020290   11383 notify.go:220] Checking for updates...
	I0307 09:48:17.084827   11383 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 09:48:17.105521   11383 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 09:48:17.148792   11383 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 09:48:17.169717   11383 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	W0307 09:48:17.211813   11383 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0307 09:48:17.212314   11383 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 09:48:17.241639   11383 out.go:97] Using the hyperkit driver based on user configuration
	I0307 09:48:17.241719   11383 start.go:297] selected driver: hyperkit
	I0307 09:48:17.241736   11383 start.go:901] validating driver "hyperkit" against <nil>
	I0307 09:48:17.241948   11383 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 09:48:17.242177   11383 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18239-10855/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 09:48:17.251596   11383 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 09:48:17.255404   11383 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:48:17.255424   11383 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 09:48:17.255452   11383 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 09:48:17.258129   11383 start_flags.go:393] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB
	I0307 09:48:17.258271   11383 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0307 09:48:17.258327   11383 cni.go:84] Creating CNI manager for ""
	I0307 09:48:17.258345   11383 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 09:48:17.258359   11383 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 09:48:17.258430   11383 start.go:340] cluster config:
	{Name:download-only-068000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:6000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:download-only-068000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l
ocal ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 09:48:17.258519   11383 iso.go:125] acquiring lock: {Name:mkc98bd5dd871e723fa7874a282694d90e6ec239 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 09:48:17.279638   11383 out.go:97] Starting "download-only-068000" primary control-plane node in "download-only-068000" cluster
	I0307 09:48:17.279664   11383 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 09:48:17.359429   11383 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.29.0-rc.2/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0307 09:48:17.359497   11383 cache.go:56] Caching tarball of preloaded images
	I0307 09:48:17.359856   11383 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 09:48:17.381228   11383 out.go:97] Downloading Kubernetes v1.29.0-rc.2 preload ...
	I0307 09:48:17.381285   11383 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 ...
	I0307 09:48:17.462067   11383 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.29.0-rc.2/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4?checksum=md5:47acda482c3add5b56147c92b8d7f468 -> /Users/jenkins/minikube-integration/18239-10855/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	
	
	* The control-plane node download-only-068000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-068000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.29.0-rc.2/LogsDuration (0.36s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/DeleteAll (0.4s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-amd64 delete --all
--- PASS: TestDownloadOnly/v1.29.0-rc.2/DeleteAll (0.40s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds (0.38s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-068000
--- PASS: TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds (0.38s)

                                                
                                    
x
+
TestBinaryMirror (1.05s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-darwin-amd64 start --download-only -p binary-mirror-853000 --alsologtostderr --binary-mirror http://127.0.0.1:58552 --driver=hyperkit 
helpers_test.go:175: Cleaning up "binary-mirror-853000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p binary-mirror-853000
--- PASS: TestBinaryMirror (1.05s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.15s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:928: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p addons-392000
addons_test.go:928: (dbg) Non-zero exit: out/minikube-darwin-amd64 addons enable dashboard -p addons-392000: exit status 85 (153.336442ms)

                                                
                                                
-- stdout --
	* Profile "addons-392000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-392000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.15s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.19s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:939: (dbg) Run:  out/minikube-darwin-amd64 addons disable dashboard -p addons-392000
addons_test.go:939: (dbg) Non-zero exit: out/minikube-darwin-amd64 addons disable dashboard -p addons-392000: exit status 85 (194.72663ms)

                                                
                                                
-- stdout --
	* Profile "addons-392000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-392000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.19s)

                                                
                                    
x
+
TestAddons/Setup (254.07s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:109: (dbg) Run:  out/minikube-darwin-amd64 start -p addons-392000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller
addons_test.go:109: (dbg) Done: out/minikube-darwin-amd64 start -p addons-392000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller: (4m14.070854083s)
--- PASS: TestAddons/Setup (254.07s)

                                                
                                    
x
+
TestAddons/parallel/Registry (14.38s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:330: registry stabilized in 10.505068ms
addons_test.go:332: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-gtj99" [1d53fc64-1948-4687-8bb7-fe12891cec09] Running
addons_test.go:332: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.004869787s
addons_test.go:335: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-sk2hz" [dd54c57e-f483-43f1-b0f0-94b786e9477d] Running
addons_test.go:335: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.006083944s
addons_test.go:340: (dbg) Run:  kubectl --context addons-392000 delete po -l run=registry-test --now
addons_test.go:345: (dbg) Run:  kubectl --context addons-392000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:345: (dbg) Done: kubectl --context addons-392000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.678189356s)
addons_test.go:359: (dbg) Run:  out/minikube-darwin-amd64 -p addons-392000 ip
2024/03/07 09:52:58 [DEBUG] GET http://192.169.0.50:5000
addons_test.go:388: (dbg) Run:  out/minikube-darwin-amd64 -p addons-392000 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (14.38s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (18.79s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:207: (dbg) Run:  kubectl --context addons-392000 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:232: (dbg) Run:  kubectl --context addons-392000 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:245: (dbg) Run:  kubectl --context addons-392000 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [69bde4a9-9ded-4c3b-9aa8-0e3d8eda74e1] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [69bde4a9-9ded-4c3b-9aa8-0e3d8eda74e1] Running
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 9.004731829s
addons_test.go:262: (dbg) Run:  out/minikube-darwin-amd64 -p addons-392000 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:286: (dbg) Run:  kubectl --context addons-392000 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:291: (dbg) Run:  out/minikube-darwin-amd64 -p addons-392000 ip
addons_test.go:297: (dbg) Run:  nslookup hello-john.test 192.169.0.50
addons_test.go:306: (dbg) Run:  out/minikube-darwin-amd64 -p addons-392000 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:306: (dbg) Done: out/minikube-darwin-amd64 -p addons-392000 addons disable ingress-dns --alsologtostderr -v=1: (1.266371093s)
addons_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 -p addons-392000 addons disable ingress --alsologtostderr -v=1
addons_test.go:311: (dbg) Done: out/minikube-darwin-amd64 -p addons-392000 addons disable ingress --alsologtostderr -v=1: (7.487324667s)
--- PASS: TestAddons/parallel/Ingress (18.79s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (11.49s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:838: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-vknbx" [4573a829-bd8a-41fa-95d6-2fe13f99ebb1] Running / Ready:ContainersNotReady (containers with unready status: [gadget]) / ContainersReady:ContainersNotReady (containers with unready status: [gadget])
addons_test.go:838: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 6.002639436s
addons_test.go:841: (dbg) Run:  out/minikube-darwin-amd64 addons disable inspektor-gadget -p addons-392000
addons_test.go:841: (dbg) Done: out/minikube-darwin-amd64 addons disable inspektor-gadget -p addons-392000: (5.490206861s)
--- PASS: TestAddons/parallel/InspektorGadget (11.49s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.48s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:407: metrics-server stabilized in 2.52946ms
addons_test.go:409: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-69cf46c98-nmqt7" [c3df55cc-f8ef-47a5-93a6-d18a60e55311] Running
addons_test.go:409: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.005101614s
addons_test.go:415: (dbg) Run:  kubectl --context addons-392000 top pods -n kube-system
addons_test.go:432: (dbg) Run:  out/minikube-darwin-amd64 -p addons-392000 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.48s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (10.03s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:456: tiller-deploy stabilized in 11.169063ms
addons_test.go:458: (dbg) TestAddons/parallel/HelmTiller: waiting 6m0s for pods matching "app=helm" in namespace "kube-system" ...
helpers_test.go:344: "tiller-deploy-7b677967b9-s9lnt" [95fb7595-f8e5-420c-91e1-c05395c1c764] Running
addons_test.go:458: (dbg) TestAddons/parallel/HelmTiller: app=helm healthy within 5.003850312s
addons_test.go:473: (dbg) Run:  kubectl --context addons-392000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version
addons_test.go:473: (dbg) Done: kubectl --context addons-392000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version: (4.579183438s)
addons_test.go:490: (dbg) Run:  out/minikube-darwin-amd64 -p addons-392000 addons disable helm-tiller --alsologtostderr -v=1
--- PASS: TestAddons/parallel/HelmTiller (10.03s)

                                                
                                    
x
+
TestAddons/parallel/CSI (61.94s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:561: csi-hostpath-driver pods stabilized in 11.251681ms
addons_test.go:564: (dbg) Run:  kubectl --context addons-392000 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:569: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:574: (dbg) Run:  kubectl --context addons-392000 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:579: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [4c33048c-7f6e-45d6-a391-52a0d306a6c5] Pending
helpers_test.go:344: "task-pv-pod" [4c33048c-7f6e-45d6-a391-52a0d306a6c5] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [4c33048c-7f6e-45d6-a391-52a0d306a6c5] Running
addons_test.go:579: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 12.004498327s
addons_test.go:584: (dbg) Run:  kubectl --context addons-392000 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:589: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-392000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:427: TestAddons/parallel/CSI: WARNING: volume snapshot get for "default" "new-snapshot-demo" returned: 
helpers_test.go:419: (dbg) Run:  kubectl --context addons-392000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:594: (dbg) Run:  kubectl --context addons-392000 delete pod task-pv-pod
addons_test.go:594: (dbg) Done: kubectl --context addons-392000 delete pod task-pv-pod: (1.025088322s)
addons_test.go:600: (dbg) Run:  kubectl --context addons-392000 delete pvc hpvc
addons_test.go:606: (dbg) Run:  kubectl --context addons-392000 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:611: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:616: (dbg) Run:  kubectl --context addons-392000 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:621: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [669b9fd0-2f6e-40ae-8041-f4bc7fef0032] Pending
helpers_test.go:344: "task-pv-pod-restore" [669b9fd0-2f6e-40ae-8041-f4bc7fef0032] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [669b9fd0-2f6e-40ae-8041-f4bc7fef0032] Running
addons_test.go:621: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 8.004048491s
addons_test.go:626: (dbg) Run:  kubectl --context addons-392000 delete pod task-pv-pod-restore
addons_test.go:630: (dbg) Run:  kubectl --context addons-392000 delete pvc hpvc-restore
addons_test.go:634: (dbg) Run:  kubectl --context addons-392000 delete volumesnapshot new-snapshot-demo
addons_test.go:638: (dbg) Run:  out/minikube-darwin-amd64 -p addons-392000 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:638: (dbg) Done: out/minikube-darwin-amd64 -p addons-392000 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.398881991s)
addons_test.go:642: (dbg) Run:  out/minikube-darwin-amd64 -p addons-392000 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (61.94s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (14.34s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:824: (dbg) Run:  out/minikube-darwin-amd64 addons enable headlamp -p addons-392000 --alsologtostderr -v=1
addons_test.go:824: (dbg) Done: out/minikube-darwin-amd64 addons enable headlamp -p addons-392000 --alsologtostderr -v=1: (1.332989954s)
addons_test.go:829: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-7ddfbb94ff-jrqzq" [7e081675-79e8-4525-9aa6-a9fdc0532342] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-7ddfbb94ff-jrqzq" [7e081675-79e8-4525-9aa6-a9fdc0532342] Running
addons_test.go:829: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 13.004476508s
--- PASS: TestAddons/parallel/Headlamp (14.34s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.4s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:857: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-6548d5df46-jzjjp" [f2bd6d52-c1a0-4026-9aa7-5eb2a480f70e] Running
addons_test.go:857: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.005271358s
addons_test.go:860: (dbg) Run:  out/minikube-darwin-amd64 addons disable cloud-spanner -p addons-392000
--- PASS: TestAddons/parallel/CloudSpanner (5.40s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (52.32s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:873: (dbg) Run:  kubectl --context addons-392000 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:879: (dbg) Run:  kubectl --context addons-392000 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:883: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-392000 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:886: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [f51d566f-a447-4f52-9f19-785dca38dca0] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [f51d566f-a447-4f52-9f19-785dca38dca0] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [f51d566f-a447-4f52-9f19-785dca38dca0] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:886: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 4.004697616s
addons_test.go:891: (dbg) Run:  kubectl --context addons-392000 get pvc test-pvc -o=json
addons_test.go:900: (dbg) Run:  out/minikube-darwin-amd64 -p addons-392000 ssh "cat /opt/local-path-provisioner/pvc-7a18c37d-2d4d-4f64-8618-18046acb553b_default_test-pvc/file1"
addons_test.go:912: (dbg) Run:  kubectl --context addons-392000 delete pod test-local-path
addons_test.go:916: (dbg) Run:  kubectl --context addons-392000 delete pvc test-pvc
addons_test.go:920: (dbg) Run:  out/minikube-darwin-amd64 -p addons-392000 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:920: (dbg) Done: out/minikube-darwin-amd64 -p addons-392000 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (42.69354535s)
--- PASS: TestAddons/parallel/LocalPath (52.32s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (5.37s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:952: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-bljgf" [9711c2e7-cada-4a56-afda-7372e7d0d105] Running
addons_test.go:952: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 5.002684732s
addons_test.go:955: (dbg) Run:  out/minikube-darwin-amd64 addons disable nvidia-device-plugin -p addons-392000
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (5.37s)

                                                
                                    
x
+
TestAddons/parallel/Yakd (6.01s)

                                                
                                                
=== RUN   TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Yakd
addons_test.go:963: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:344: "yakd-dashboard-9947fc6bf-knrtg" [148d3dc2-3820-4450-b7a3-d175dd178070] Running
addons_test.go:963: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 6.004167052s
--- PASS: TestAddons/parallel/Yakd (6.01s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.09s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:650: (dbg) Run:  kubectl --context addons-392000 create ns new-namespace
addons_test.go:664: (dbg) Run:  kubectl --context addons-392000 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.09s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (5.95s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:172: (dbg) Run:  out/minikube-darwin-amd64 stop -p addons-392000
addons_test.go:172: (dbg) Done: out/minikube-darwin-amd64 stop -p addons-392000: (5.383084482s)
addons_test.go:176: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p addons-392000
addons_test.go:180: (dbg) Run:  out/minikube-darwin-amd64 addons disable dashboard -p addons-392000
addons_test.go:185: (dbg) Run:  out/minikube-darwin-amd64 addons disable gvisor -p addons-392000
--- PASS: TestAddons/StoppedEnableDisable (5.95s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (12.23s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
=== PAUSE TestHyperKitDriverInstallOrUpdate

                                                
                                                

                                                
                                                
=== CONT  TestHyperKitDriverInstallOrUpdate
* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:

                                                
                                                
$ sudo chown root:wheel /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current3631376909/001/.minikube/bin/docker-machine-driver-hyperkit 
$ sudo chmod u+s /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current3631376909/001/.minikube/bin/docker-machine-driver-hyperkit 

                                                
                                                

                                                
                                                
! Unable to update hyperkit driver: [sudo chown root:wheel /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current3631376909/001/.minikube/bin/docker-machine-driver-hyperkit] requires a password, and --interactive=false
* Starting "minikube" primary control-plane node in "minikube" cluster
* Download complete!
--- PASS: TestHyperKitDriverInstallOrUpdate (12.23s)

                                                
                                    
x
+
TestErrorSpam/start (1.29s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 start --dry-run
--- PASS: TestErrorSpam/start (1.29s)

                                                
                                    
x
+
TestErrorSpam/status (0.22s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 status
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 status: exit status 7 (74.545415ms)

                                                
                                                
-- stdout --
	nospam-025000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 status" failed: exit status 7
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 status
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 status: exit status 7 (74.133556ms)

                                                
                                                
-- stdout --
	nospam-025000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 status" failed: exit status 7
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 status
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 status: exit status 7 (74.309102ms)

                                                
                                                
-- stdout --
	nospam-025000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 status" failed: exit status 7
--- PASS: TestErrorSpam/status (0.22s)

                                                
                                    
x
+
TestErrorSpam/pause (0.42s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 pause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 pause: exit status 83 (137.605888ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-025000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-025000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 pause" failed: exit status 83
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 pause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 pause: exit status 83 (137.659879ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-025000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-025000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 pause" failed: exit status 83
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 pause
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 pause: exit status 83 (139.001622ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-025000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-025000"

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 pause" failed: exit status 83
--- PASS: TestErrorSpam/pause (0.42s)

                                                
                                    
x
+
TestErrorSpam/unpause (0.42s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 unpause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 unpause: exit status 83 (139.482977ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-025000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-025000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 unpause" failed: exit status 83
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 unpause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 unpause: exit status 83 (138.436235ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-025000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-025000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 unpause" failed: exit status 83
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 unpause
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 unpause: exit status 83 (138.0995ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-025000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-025000"

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 unpause" failed: exit status 83
--- PASS: TestErrorSpam/unpause (0.42s)

                                                
                                    
x
+
TestErrorSpam/stop (10.71s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 stop
error_spam_test.go:159: (dbg) Done: out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 stop: (3.093526212s)
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 stop
error_spam_test.go:159: (dbg) Done: out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 stop: (3.514888742s)
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 stop
error_spam_test.go:182: (dbg) Done: out/minikube-darwin-amd64 -p nospam-025000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-025000 stop: (4.100452237s)
--- PASS: TestErrorSpam/stop (10.71s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /Users/jenkins/minikube-integration/18239-10855/.minikube/files/etc/test/nested/copy/11298/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (1.9s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (1.90s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.38s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-899000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalserialCacheCmdcacheadd_local3451522084/001
functional_test.go:1085: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 cache add minikube-local-cache-test:functional-899000
functional_test.go:1090: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 cache delete minikube-local-cache-test:functional-899000
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-899000
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.38s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-darwin-amd64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.18s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.64s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 config get cpus: exit status 14 (63.572003ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 config get cpus: exit status 14 (128.880546ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.64s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.92s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-899000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit 
functional_test.go:970: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-899000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit : exit status 23 (459.83192ms)

                                                
                                                
-- stdout --
	* [functional-899000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 09:56:50.365492   12612 out.go:291] Setting OutFile to fd 1 ...
	I0307 09:56:50.365740   12612 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:56:50.365745   12612 out.go:304] Setting ErrFile to fd 2...
	I0307 09:56:50.365750   12612 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:56:50.365919   12612 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 09:56:50.367365   12612 out.go:298] Setting JSON to false
	I0307 09:56:50.389945   12612 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":6981,"bootTime":1709827229,"procs":433,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 09:56:50.390041   12612 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 09:56:50.411982   12612 out.go:177] * [functional-899000] minikube v1.32.0 on Darwin 14.3.1
	I0307 09:56:50.454158   12612 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 09:56:50.454212   12612 notify.go:220] Checking for updates...
	I0307 09:56:50.475821   12612 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 09:56:50.497015   12612 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 09:56:50.517792   12612 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 09:56:50.538660   12612 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 09:56:50.559992   12612 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 09:56:50.581634   12612 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 09:56:50.582198   12612 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:56:50.582270   12612 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:56:50.591219   12612 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59274
	I0307 09:56:50.591596   12612 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:56:50.592001   12612 main.go:141] libmachine: Using API Version  1
	I0307 09:56:50.592016   12612 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:56:50.592221   12612 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:56:50.592321   12612 main.go:141] libmachine: (functional-899000) Calling .DriverName
	I0307 09:56:50.592494   12612 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 09:56:50.592718   12612 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:56:50.592747   12612 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:56:50.601023   12612 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59276
	I0307 09:56:50.601364   12612 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:56:50.601670   12612 main.go:141] libmachine: Using API Version  1
	I0307 09:56:50.601681   12612 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:56:50.601921   12612 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:56:50.602031   12612 main.go:141] libmachine: (functional-899000) Calling .DriverName
	I0307 09:56:50.630626   12612 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 09:56:50.651774   12612 start.go:297] selected driver: hyperkit
	I0307 09:56:50.651793   12612 start.go:901] validating driver "hyperkit" against &{Name:functional-899000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-899000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PV
ersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 09:56:50.651949   12612 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 09:56:50.676004   12612 out.go:177] 
	W0307 09:56:50.696810   12612 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0307 09:56:50.718111   12612 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-899000 --dry-run --alsologtostderr -v=1 --driver=hyperkit 
--- PASS: TestFunctional/parallel/DryRun (0.92s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.54s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-899000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit 
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-899000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit : exit status 23 (535.207542ms)

                                                
                                                
-- stdout --
	* [functional-899000] minikube v1.32.0 sur Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote hyperkit basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 09:56:51.276493   12628 out.go:291] Setting OutFile to fd 1 ...
	I0307 09:56:51.276649   12628 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:56:51.276654   12628 out.go:304] Setting ErrFile to fd 2...
	I0307 09:56:51.276658   12628 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 09:56:51.276857   12628 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18239-10855/.minikube/bin
	I0307 09:56:51.278367   12628 out.go:298] Setting JSON to false
	I0307 09:56:51.301108   12628 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":6982,"bootTime":1709827229,"procs":437,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0307 09:56:51.301205   12628 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 09:56:51.322661   12628 out.go:177] * [functional-899000] minikube v1.32.0 sur Darwin 14.3.1
	I0307 09:56:51.364600   12628 out.go:177]   - MINIKUBE_LOCATION=18239
	I0307 09:56:51.364644   12628 notify.go:220] Checking for updates...
	I0307 09:56:51.407275   12628 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	I0307 09:56:51.428386   12628 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 09:56:51.449305   12628 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 09:56:51.491446   12628 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	I0307 09:56:51.533055   12628 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 09:56:51.555181   12628 config.go:182] Loaded profile config "functional-899000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 09:56:51.556040   12628 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:56:51.556120   12628 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:56:51.565198   12628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59284
	I0307 09:56:51.565566   12628 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:56:51.565999   12628 main.go:141] libmachine: Using API Version  1
	I0307 09:56:51.566014   12628 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:56:51.566274   12628 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:56:51.566387   12628 main.go:141] libmachine: (functional-899000) Calling .DriverName
	I0307 09:56:51.566579   12628 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 09:56:51.566825   12628 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 09:56:51.566849   12628 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 09:56:51.574774   12628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:59286
	I0307 09:56:51.575102   12628 main.go:141] libmachine: () Calling .GetVersion
	I0307 09:56:51.575458   12628 main.go:141] libmachine: Using API Version  1
	I0307 09:56:51.575482   12628 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 09:56:51.575680   12628 main.go:141] libmachine: () Calling .GetMachineName
	I0307 09:56:51.575770   12628 main.go:141] libmachine: (functional-899000) Calling .DriverName
	I0307 09:56:51.604521   12628 out.go:177] * Utilisation du pilote hyperkit basé sur le profil existant
	I0307 09:56:51.646346   12628 start.go:297] selected driver: hyperkit
	I0307 09:56:51.646373   12628 start.go:901] validating driver "hyperkit" against &{Name:functional-899000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-899000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PV
ersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 09:56:51.646539   12628 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 09:56:51.671342   12628 out.go:177] 
	W0307 09:56:51.692306   12628 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0307 09:56:51.713333   12628 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.54s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1686: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 addons list
functional_test.go:1698: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.7s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-darwin-amd64 license
--- PASS: TestFunctional/parallel/License (0.70s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 version --short
--- PASS: TestFunctional/parallel/Version/short (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (2.72s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (2.582020534s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-899000
--- PASS: TestFunctional/parallel/ImageCommands/Setup (2.72s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-899000 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.02s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image rm gcr.io/google-containers/addon-resizer:functional-899000 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-899000
functional_test.go:423: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 image save --daemon gcr.io/google-containers/addon-resizer:functional-899000 --alsologtostderr
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-899000
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1266: (dbg) Run:  out/minikube-darwin-amd64 profile lis
functional_test.go:1271: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1306: (dbg) Run:  out/minikube-darwin-amd64 profile list
functional_test.go:1311: Took "146.243434ms" to run "out/minikube-darwin-amd64 profile list"
functional_test.go:1320: (dbg) Run:  out/minikube-darwin-amd64 profile list -l
functional_test.go:1325: Took "86.586266ms" to run "out/minikube-darwin-amd64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1357: (dbg) Run:  out/minikube-darwin-amd64 profile list -o json
functional_test.go:1362: Took "146.265315ms" to run "out/minikube-darwin-amd64 profile list -o json"
functional_test.go:1370: (dbg) Run:  out/minikube-darwin-amd64 profile list -o json --light
functional_test.go:1375: Took "86.39029ms" to run "out/minikube-darwin-amd64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (10.03s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:351: (dbg) Run:  dscacheutil -q host -a name nginx-svc.default.svc.cluster.local.
E0307 09:58:04.937119   11298 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18239-10855/.minikube/profiles/addons-392000/client.crt: no such file or directory
functional_test_tunnel_test.go:351: (dbg) Done: dscacheutil -q host -a name nginx-svc.default.svc.cluster.local.: (10.009260686s)
functional_test_tunnel_test.go:359: DNS resolution by dscacheutil for nginx-svc.default.svc.cluster.local. is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (10.03s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-darwin-amd64 -p functional-899000 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.14s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.13s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-899000
--- PASS: TestFunctional/delete_addon-resizer_images (0.13s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.05s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-899000
--- PASS: TestFunctional/delete_my-image_image (0.05s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.05s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-899000
--- PASS: TestFunctional/delete_minikube_cached_images (0.05s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (3.65s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 stop -p json-output-110000 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-darwin-amd64 stop -p json-output-110000 --output=json --user=testUser: (3.647406069s)
--- PASS: TestJSONOutput/stop/Command (3.65s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.77s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-darwin-amd64 start -p json-output-error-299000 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p json-output-error-299000 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (386.428306ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"4282be64-7c2c-485a-ac6d-d1d4a2a77cc8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-299000] minikube v1.32.0 on Darwin 14.3.1","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"128ba8d9-35b4-4103-985d-b0445d47f926","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=18239"}}
	{"specversion":"1.0","id":"2328c37a-0ef7-422c-ad7c-9ef8fcc3cce1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig"}}
	{"specversion":"1.0","id":"40884243-8054-48e4-8dae-7dd56e460b03","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-amd64"}}
	{"specversion":"1.0","id":"174f4878-978e-4ad6-8793-6af6d1fe9295","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"edae0ef2-aa36-4ffc-992c-68547cd87dad","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube"}}
	{"specversion":"1.0","id":"365d08ea-f910-45eb-b0fd-0020bf653eb1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"43f2151b-8821-46bf-b77d-a575fe61d8be","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on darwin/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-299000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p json-output-error-299000
--- PASS: TestErrorJSONOutput (0.77s)

                                                
                                    
x
+
TestMainNoArgs (0.09s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-darwin-amd64
--- PASS: TestMainNoArgs (0.09s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (2.64s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current
* minikube v1.32.0 on darwin
- MINIKUBE_LOCATION=18239
- KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current2789313434/001
* Using the hyperkit driver based on user configuration
* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:

                                                
                                                
$ sudo chown root:wheel /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current2789313434/001/.minikube/bin/docker-machine-driver-hyperkit 
$ sudo chmod u+s /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current2789313434/001/.minikube/bin/docker-machine-driver-hyperkit 

                                                
                                                

                                                
                                                
! Unable to update hyperkit driver: [sudo chown root:wheel /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current2789313434/001/.minikube/bin/docker-machine-driver-hyperkit] requires a password, and --interactive=false
* Starting "minikube" primary control-plane node in "minikube" cluster
* Download complete!
--- PASS: TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (2.64s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (6.28s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current
* minikube v1.32.0 on darwin
- MINIKUBE_LOCATION=18239
- KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current3631376909/001
* Using the hyperkit driver based on user configuration
* Downloading driver docker-machine-driver-hyperkit:
--- PASS: TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (6.28s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (1.26s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (1.26s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.41s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-787000 --no-kubernetes --kubernetes-version=1.20 --driver=hyperkit 
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-787000 --no-kubernetes --kubernetes-version=1.20 --driver=hyperkit : exit status 14 (413.031538ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-787000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18239
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18239-10855/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18239-10855/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.41s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.14s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-amd64 ssh -p NoKubernetes-787000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p NoKubernetes-787000 "sudo systemctl is-active --quiet service kubelet": exit status 83 (138.865282ms)

                                                
                                                
-- stdout --
	* The control-plane node NoKubernetes-787000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p NoKubernetes-787000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.14s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (0.33s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-darwin-amd64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-darwin-amd64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (0.33s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (3.24s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-darwin-amd64 stop -p NoKubernetes-787000
no_kubernetes_test.go:158: (dbg) Done: out/minikube-darwin-amd64 stop -p NoKubernetes-787000: (3.242775919s)
--- PASS: TestNoKubernetes/serial/Stop (3.24s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.14s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-amd64 ssh -p NoKubernetes-787000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p NoKubernetes-787000 "sudo systemctl is-active --quiet service kubelet": exit status 83 (138.711797ms)

                                                
                                                
-- stdout --
	* The control-plane node NoKubernetes-787000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p NoKubernetes-787000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.14s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (3.39s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p old-k8s-version-169000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p old-k8s-version-169000 --alsologtostderr -v=3: (3.394848119s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (3.39s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.33s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-169000 -n old-k8s-version-169000: exit status 7 (73.026208ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p old-k8s-version-169000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.33s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (2.8s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p no-preload-947000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p no-preload-947000 --alsologtostderr -v=3: (2.799072005s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (2.80s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.33s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-947000 -n no-preload-947000: exit status 7 (74.746978ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p no-preload-947000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.33s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (3.01s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p embed-certs-026000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p embed-certs-026000 --alsologtostderr -v=3: (3.012781948s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (3.01s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.35s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-026000 -n embed-certs-026000: exit status 7 (73.707673ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p embed-certs-026000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.35s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (1.99s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p default-k8s-diff-port-061000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p default-k8s-diff-port-061000 --alsologtostderr -v=3: (1.994614686s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (1.99s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.33s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-061000 -n default-k8s-diff-port-061000: exit status 7 (74.00232ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p default-k8s-diff-port-061000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.33s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p newest-cni-150000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.21s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (3.67s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p newest-cni-150000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p newest-cni-150000 --alsologtostderr -v=3: (3.669350911s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (3.67s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.33s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-150000 -n newest-cni-150000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-150000 -n newest-cni-150000: exit status 7 (73.980157ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p newest-cni-150000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.33s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    

Test skip (24/280)

x
+
TestDownloadOnly/v1.20.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.20.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.20.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.4/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.4/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.29.0-rc.2/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.29.0-rc.2/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:220: skipping, only for docker or podman driver
--- SKIP: TestDownloadOnlyKic (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:498: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with docker false darwin amd64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:41: Skip if not linux.
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing docker
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (14.6s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-899000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdany-port620292620/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1709834170479919000" to /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdany-port620292620/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1709834170479919000" to /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdany-port620292620/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1709834170479919000" to /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdany-port620292620/001/test-1709834170479919000
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (225.159306ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (143.101019ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (142.928375ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (160.66552ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (161.458361ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (139.173472ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (139.582969ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (145.405548ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:123: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:90: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "sudo umount -f /mount-9p": exit status 83 (139.262811ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:92: "out/minikube-darwin-amd64 -p functional-899000 ssh \"sudo umount -f /mount-9p\"": exit status 83
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-899000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdany-port620292620/001:/mount-9p --alsologtostderr -v=1] ...
--- SKIP: TestFunctional/parallel/MountCmd/any-port (14.60s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (13.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-899000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdspecific-port2553946802/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (176.504542ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (138.729822ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (140.550495ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (139.892036ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (138.372584ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (162.48845ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (137.43482ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:251: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "sudo umount -f /mount-9p": exit status 83 (138.090357ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:232: "out/minikube-darwin-amd64 -p functional-899000 ssh \"sudo umount -f /mount-9p\"": exit status 83
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-899000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdspecific-port2553946802/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- SKIP: TestFunctional/parallel/MountCmd/specific-port (13.05s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (12.17s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-899000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup790370960/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-899000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup790370960/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-899000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup790370960/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T" /mount1: exit status 83 (237.310635ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T" /mount1: exit status 83 (139.705095ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T" /mount1: exit status 83 (141.601002ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T" /mount1: exit status 83 (143.964711ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T" /mount1: exit status 83 (136.962533ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T" /mount1: exit status 83 (165.163066ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-899000 ssh "findmnt -T" /mount1: exit status 83 (138.348965ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-899000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-899000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:340: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-899000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup790370960/001:/mount1 --alsologtostderr -v=1] ...
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-899000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup790370960/001:/mount2 --alsologtostderr -v=1] ...
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-899000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup790370960/001:/mount3 --alsologtostderr -v=1] ...
--- SKIP: TestFunctional/parallel/MountCmd/VerifyCleanup (12.17s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestKicCustomNetwork (0s)

                                                
                                                
=== RUN   TestKicCustomNetwork
kic_custom_network_test.go:34: only runs with docker driver
--- SKIP: TestKicCustomNetwork (0.00s)

                                                
                                    
x
+
TestKicExistingNetwork (0s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:73: only runs with docker driver
--- SKIP: TestKicExistingNetwork (0.00s)

                                                
                                    
x
+
TestKicCustomSubnet (0s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:102: only runs with docker/podman driver
--- SKIP: TestKicCustomSubnet (0.00s)

                                                
                                    
x
+
TestKicStaticIP (0s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:123: only run with docker/podman driver
--- SKIP: TestKicStaticIP (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestInsufficientStorage (0s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:38: only runs with docker driver
--- SKIP: TestInsufficientStorage (0.00s)

                                                
                                    
x
+
TestMissingContainerUpgrade (0s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
version_upgrade_test.go:284: This test is only for Docker
--- SKIP: TestMissingContainerUpgrade (0.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (6.13s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:626: 
----------------------- debugLogs start: cilium-094000 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-094000" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-094000

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-094000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-094000"

                                                
                                                
----------------------- debugLogs end: cilium-094000 [took: 5.753652398s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-094000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cilium-094000
--- SKIP: TestNetworkPlugins/group/cilium (6.13s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.39s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-087000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p disable-driver-mounts-087000
--- SKIP: TestStartStop/group/disable-driver-mounts (0.39s)

                                                
                                    
Copied to clipboard