Test Report: Hyperkit_macOS 17909

                    
                      8c4e1a0f8b9318dd26c2bbdca1104d823a34cf29:2024-03-04:33419
                    
                

Test fail (155/280)

Order failed test Duration
31 TestOffline 12.54
54 TestCertOptions 14.04
55 TestCertExpiration 201.32
56 TestDockerFlags 15.28
57 TestForceSystemdFlag 12.25
58 TestForceSystemdEnv 17.81
64 TestErrorSpam/setup 11.14
73 TestFunctional/serial/StartWithProxy 11.67
75 TestFunctional/serial/SoftStart 5.88
76 TestFunctional/serial/KubeContext 0.11
77 TestFunctional/serial/KubectlGetPods 0.11
84 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.14
85 TestFunctional/serial/CacheCmd/cache/cache_reload 0.52
87 TestFunctional/serial/MinikubeKubectlCmd 0.56
88 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.73
89 TestFunctional/serial/ExtraConfig 5.94
90 TestFunctional/serial/ComponentHealth 0.11
91 TestFunctional/serial/LogsCmd 0.32
92 TestFunctional/serial/LogsFileCmd 0.28
93 TestFunctional/serial/InvalidService 0.04
96 TestFunctional/parallel/DashboardCmd 0.33
99 TestFunctional/parallel/StatusCmd 0.3
103 TestFunctional/parallel/ServiceCmdConnect 0.22
105 TestFunctional/parallel/PersistentVolumeClaim 0.08
107 TestFunctional/parallel/SSHCmd 0.37
108 TestFunctional/parallel/CpCmd 0.96
109 TestFunctional/parallel/MySQL 0.19
110 TestFunctional/parallel/FileSync 0.33
111 TestFunctional/parallel/CertSync 1.28
115 TestFunctional/parallel/NodeLabels 0.12
117 TestFunctional/parallel/NonActiveRuntimeDisabled 0.24
121 TestFunctional/parallel/Version/components 0.18
122 TestFunctional/parallel/ImageCommands/ImageListShort 0.1
123 TestFunctional/parallel/ImageCommands/ImageListTable 0.1
124 TestFunctional/parallel/ImageCommands/ImageListJson 0.1
125 TestFunctional/parallel/ImageCommands/ImageListYaml 0.1
126 TestFunctional/parallel/ImageCommands/ImageBuild 0.34
128 TestFunctional/parallel/DockerEnv/bash 0.17
129 TestFunctional/parallel/UpdateContextCmd/no_changes 0.14
130 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.14
131 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.14
132 TestFunctional/parallel/ServiceCmd/DeployApp 0.05
133 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 2.26
134 TestFunctional/parallel/ServiceCmd/List 0.19
135 TestFunctional/parallel/ServiceCmd/JSONOutput 0.15
136 TestFunctional/parallel/ServiceCmd/HTTPS 0.16
137 TestFunctional/parallel/ServiceCmd/Format 0.17
138 TestFunctional/parallel/ServiceCmd/URL 0.19
140 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.32
143 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 0
144 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 104.41
145 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 1.86
146 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 3.56
147 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.1
149 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.2
157 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig 15.06
159 TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS 38.99
167 TestMutliControlPlane/serial/StartCluster 11.21
168 TestMutliControlPlane/serial/DeployApp 120.48
169 TestMutliControlPlane/serial/PingHostFromPods 0.18
170 TestMutliControlPlane/serial/AddWorkerNode 0.22
171 TestMutliControlPlane/serial/NodeLabels 0.11
172 TestMutliControlPlane/serial/HAppyAfterClusterStart 0.22
173 TestMutliControlPlane/serial/CopyFile 0.15
174 TestMutliControlPlane/serial/StopSecondaryNode 0.33
175 TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop 0.22
176 TestMutliControlPlane/serial/RestartSecondaryNode 45.53
177 TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart 0.22
178 TestMutliControlPlane/serial/RestartClusterKeepsNodes 9.72
179 TestMutliControlPlane/serial/DeleteSecondaryNode 0.29
180 TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete 0.22
181 TestMutliControlPlane/serial/StopCluster 2.29
182 TestMutliControlPlane/serial/RestartCluster 5.88
183 TestMutliControlPlane/serial/DegradedAfterClusterRestart 0.22
184 TestMutliControlPlane/serial/AddSecondaryNode 0.24
185 TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd 0.22
188 TestImageBuild/serial/Setup 11.35
191 TestJSONOutput/start/Command 11.07
194 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
195 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
197 TestJSONOutput/pause/Command 0.14
203 TestJSONOutput/unpause/Command 0.14
220 TestMinikubeProfile 12.13
223 TestMountStart/serial/StartWithMountFirst 11.36
226 TestMultiNode/serial/FreshStart2Nodes 11.24
227 TestMultiNode/serial/DeployApp2Nodes 92.54
228 TestMultiNode/serial/PingHostFrom2Pods 0.18
229 TestMultiNode/serial/AddNode 0.22
230 TestMultiNode/serial/MultiNodeLabels 0.11
231 TestMultiNode/serial/ProfileList 0.22
232 TestMultiNode/serial/CopyFile 0.15
233 TestMultiNode/serial/StopNode 0.39
234 TestMultiNode/serial/StartAfterStop 47.06
235 TestMultiNode/serial/RestartKeepsNodes 8.9
236 TestMultiNode/serial/DeleteNode 0.29
237 TestMultiNode/serial/StopMultiNode 2.15
238 TestMultiNode/serial/RestartMultiNode 5.89
239 TestMultiNode/serial/ValidateNameConflict 23.35
243 TestPreload 11.61
245 TestScheduledStopUnix 11.41
246 TestSkaffold 14.32
249 TestRunningBinaryUpgrade 43.71
251 TestKubernetesUpgrade 20.67
267 TestStoppedBinaryUpgrade/Upgrade 25.93
268 TestStoppedBinaryUpgrade/MinikubeLogs 0.32
270 TestPause/serial/Start 11.27
280 TestNoKubernetes/serial/StartWithK8s 11.24
281 TestNoKubernetes/serial/StartWithStopK8s 5.94
282 TestNoKubernetes/serial/Start 5.96
286 TestNoKubernetes/serial/StartNoArgs 5.86
288 TestNetworkPlugins/group/auto/Start 11.68
289 TestNetworkPlugins/group/calico/Start 11.34
290 TestNetworkPlugins/group/custom-flannel/Start 11.29
291 TestNetworkPlugins/group/false/Start 11.52
292 TestNetworkPlugins/group/kindnet/Start 12.07
293 TestNetworkPlugins/group/flannel/Start 11.48
294 TestNetworkPlugins/group/enable-default-cni/Start 11.77
295 TestNetworkPlugins/group/bridge/Start 11.42
296 TestNetworkPlugins/group/kubenet/Start 11.84
298 TestStartStop/group/old-k8s-version/serial/FirstStart 12.04
299 TestStartStop/group/old-k8s-version/serial/DeployApp 0.22
300 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 0.4
303 TestStartStop/group/no-preload/serial/FirstStart 11.62
305 TestStartStop/group/old-k8s-version/serial/SecondStart 10.22
306 TestStartStop/group/no-preload/serial/DeployApp 0.19
307 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 0.08
308 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 0.32
309 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 0.12
310 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.2
312 TestStartStop/group/old-k8s-version/serial/Pause 0.37
314 TestStartStop/group/embed-certs/serial/FirstStart 11.75
316 TestStartStop/group/no-preload/serial/SecondStart 6.08
317 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 0.08
318 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 0.11
319 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.2
320 TestStartStop/group/no-preload/serial/Pause 0.3
322 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 12.1
323 TestStartStop/group/embed-certs/serial/DeployApp 0.19
324 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 0.34
327 TestStartStop/group/embed-certs/serial/SecondStart 8.22
328 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 0.22
329 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 0.11
330 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 0.36
331 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 0.13
332 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.19
334 TestStartStop/group/embed-certs/serial/Pause 0.32
336 TestStartStop/group/newest-cni/serial/FirstStart 11.93
338 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 7.6
339 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 0.08
340 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 0.12
341 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.19
342 TestStartStop/group/default-k8s-diff-port/serial/Pause 0.3
347 TestStartStop/group/newest-cni/serial/SecondStart 5.89
350 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.18
351 TestStartStop/group/newest-cni/serial/Pause 0.29
x
+
TestOffline (12.54s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-amd64 start -p offline-docker-929000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit 
aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p offline-docker-929000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit : exit status 60 (12.201910525s)

                                                
                                                
-- stdout --
	* [offline-docker-929000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "offline-docker-929000" primary control-plane node in "offline-docker-929000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "offline-docker-929000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:56:32.538135   95995 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:56:32.538305   95995 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:56:32.538311   95995 out.go:304] Setting ErrFile to fd 2...
	I0304 17:56:32.538314   95995 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:56:32.538495   95995 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:56:32.540041   95995 out.go:298] Setting JSON to false
	I0304 17:56:32.563886   95995 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24961,"bootTime":1709578831,"procs":490,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:56:32.563980   95995 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:56:32.585831   95995 out.go:177] * [offline-docker-929000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:56:32.627793   95995 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:56:32.627817   95995 notify.go:220] Checking for updates...
	I0304 17:56:32.669565   95995 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:56:32.690474   95995 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:56:32.711540   95995 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:56:32.732592   95995 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:56:32.753425   95995 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:56:32.774985   95995 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:56:32.775091   95995 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:56:32.803548   95995 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 17:56:32.845497   95995 start.go:297] selected driver: hyperkit
	I0304 17:56:32.845513   95995 start.go:901] validating driver "hyperkit" against <nil>
	I0304 17:56:32.845534   95995 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:56:32.848530   95995 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:56:32.848659   95995 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:56:32.856738   95995 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:56:32.860796   95995 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:56:32.860828   95995 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0304 17:56:32.860866   95995 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 17:56:32.861098   95995 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 17:56:32.861155   95995 cni.go:84] Creating CNI manager for ""
	I0304 17:56:32.861173   95995 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 17:56:32.861180   95995 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0304 17:56:32.861258   95995 start.go:340] cluster config:
	{Name:offline-docker-929000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-929000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loca
l ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:56:32.861346   95995 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:56:32.903566   95995 out.go:177] * Starting "offline-docker-929000" primary control-plane node in "offline-docker-929000" cluster
	I0304 17:56:32.924618   95995 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:56:32.924661   95995 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:56:32.924678   95995 cache.go:56] Caching tarball of preloaded images
	I0304 17:56:32.924800   95995 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:56:32.924812   95995 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 17:56:32.924892   95995 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/offline-docker-929000/config.json ...
	I0304 17:56:32.924910   95995 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/offline-docker-929000/config.json: {Name:mkbda6c4aa2c69cd6379009530fbbeae537efbf8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 17:56:32.925219   95995 start.go:360] acquireMachinesLock for offline-docker-929000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:56:32.925275   95995 start.go:364] duration metric: took 42.911µs to acquireMachinesLock for "offline-docker-929000"
	I0304 17:56:32.925296   95995 start.go:93] Provisioning new machine with config: &{Name:offline-docker-929000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-929000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:56:32.925358   95995 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:56:32.946835   95995 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0304 17:56:32.947146   95995 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:56:32.947221   95995 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:56:32.956313   95995 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64060
	I0304 17:56:32.956644   95995 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:56:32.957088   95995 main.go:141] libmachine: Using API Version  1
	I0304 17:56:32.957098   95995 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:56:32.957325   95995 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:56:32.957448   95995 main.go:141] libmachine: (offline-docker-929000) Calling .GetMachineName
	I0304 17:56:32.957544   95995 main.go:141] libmachine: (offline-docker-929000) Calling .DriverName
	I0304 17:56:32.957658   95995 start.go:159] libmachine.API.Create for "offline-docker-929000" (driver="hyperkit")
	I0304 17:56:32.957683   95995 client.go:168] LocalClient.Create starting
	I0304 17:56:32.957725   95995 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:56:32.957775   95995 main.go:141] libmachine: Decoding PEM data...
	I0304 17:56:32.957792   95995 main.go:141] libmachine: Parsing certificate...
	I0304 17:56:32.957871   95995 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:56:32.957908   95995 main.go:141] libmachine: Decoding PEM data...
	I0304 17:56:32.957919   95995 main.go:141] libmachine: Parsing certificate...
	I0304 17:56:32.957933   95995 main.go:141] libmachine: Running pre-create checks...
	I0304 17:56:32.957940   95995 main.go:141] libmachine: (offline-docker-929000) Calling .PreCreateCheck
	I0304 17:56:32.958019   95995 main.go:141] libmachine: (offline-docker-929000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:56:32.958183   95995 main.go:141] libmachine: (offline-docker-929000) Calling .GetConfigRaw
	I0304 17:56:32.967999   95995 main.go:141] libmachine: Creating machine...
	I0304 17:56:32.968013   95995 main.go:141] libmachine: (offline-docker-929000) Calling .Create
	I0304 17:56:32.968121   95995 main.go:141] libmachine: (offline-docker-929000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:56:32.968274   95995 main.go:141] libmachine: (offline-docker-929000) DBG | I0304 17:56:32.968106   96015 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:56:32.968372   95995 main.go:141] libmachine: (offline-docker-929000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:56:33.482304   95995 main.go:141] libmachine: (offline-docker-929000) DBG | I0304 17:56:33.482221   96015 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/offline-docker-929000/id_rsa...
	I0304 17:56:33.601546   95995 main.go:141] libmachine: (offline-docker-929000) DBG | I0304 17:56:33.601461   96015 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/offline-docker-929000/offline-docker-929000.rawdisk...
	I0304 17:56:33.601571   95995 main.go:141] libmachine: (offline-docker-929000) DBG | Writing magic tar header
	I0304 17:56:33.601636   95995 main.go:141] libmachine: (offline-docker-929000) DBG | Writing SSH key tar header
	I0304 17:56:33.602016   95995 main.go:141] libmachine: (offline-docker-929000) DBG | I0304 17:56:33.601965   96015 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/offline-docker-929000 ...
	I0304 17:56:33.966287   95995 main.go:141] libmachine: (offline-docker-929000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:56:33.966310   95995 main.go:141] libmachine: (offline-docker-929000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/offline-docker-929000/hyperkit.pid
	I0304 17:56:33.966347   95995 main.go:141] libmachine: (offline-docker-929000) DBG | Using UUID f6413d42-21f9-468f-9f6e-19e2c932bdaf
	I0304 17:56:34.002564   95995 main.go:141] libmachine: (offline-docker-929000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:56:34.002674   95995 client.go:171] duration metric: took 1.044970034s to LocalClient.Create
	I0304 17:56:36.003910   95995 start.go:128] duration metric: took 3.078499702s to createHost
	I0304 17:56:36.003934   95995 start.go:83] releasing machines lock for "offline-docker-929000", held for 3.078619201s
	W0304 17:56:36.003950   95995 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 17:56:36.004312   95995 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:56:36.004340   95995 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:56:36.013148   95995 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64062
	I0304 17:56:36.013570   95995 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:56:36.013944   95995 main.go:141] libmachine: Using API Version  1
	I0304 17:56:36.013954   95995 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:56:36.014211   95995 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:56:36.014628   95995 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:56:36.014652   95995 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:56:36.022873   95995 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64064
	I0304 17:56:36.023242   95995 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:56:36.023864   95995 main.go:141] libmachine: Using API Version  1
	I0304 17:56:36.023895   95995 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:56:36.024134   95995 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:56:36.024254   95995 main.go:141] libmachine: (offline-docker-929000) Calling .GetState
	I0304 17:56:36.024359   95995 main.go:141] libmachine: (offline-docker-929000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:56:36.024438   95995 main.go:141] libmachine: (offline-docker-929000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/offline-docker-929000/hyperkit.json: no such file or directory
	I0304 17:56:36.024465   95995 main.go:141] libmachine: (offline-docker-929000) DBG | hyperkit pid from json: 0
	I0304 17:56:36.024523   95995 main.go:141] libmachine: (offline-docker-929000) Calling .DriverName
	I0304 17:56:36.067227   95995 out.go:177] * Deleting "offline-docker-929000" in hyperkit ...
	I0304 17:56:36.088138   95995 main.go:141] libmachine: (offline-docker-929000) Calling .Remove
	I0304 17:56:36.088430   95995 main.go:141] libmachine: (offline-docker-929000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:56:36.088450   95995 main.go:141] libmachine: (offline-docker-929000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:56:36.088478   95995 main.go:141] libmachine: (offline-docker-929000) DBG | hyperkit pid from json: 0
	I0304 17:56:36.088513   95995 main.go:141] libmachine: (offline-docker-929000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/offline-docker-929000/hyperkit.json: no such file or directory
	W0304 17:56:36.177024   95995 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:56:36.177043   95995 start.go:728] Will try again in 5 seconds ...
	I0304 17:56:41.177819   95995 start.go:360] acquireMachinesLock for offline-docker-929000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:56:41.177993   95995 start.go:364] duration metric: took 139.183µs to acquireMachinesLock for "offline-docker-929000"
	I0304 17:56:41.178024   95995 start.go:93] Provisioning new machine with config: &{Name:offline-docker-929000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-929000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:56:41.178130   95995 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:56:41.234397   95995 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0304 17:56:41.234553   95995 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:56:41.234589   95995 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:56:41.243413   95995 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64067
	I0304 17:56:41.243767   95995 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:56:41.244152   95995 main.go:141] libmachine: Using API Version  1
	I0304 17:56:41.244167   95995 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:56:41.244411   95995 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:56:41.244541   95995 main.go:141] libmachine: (offline-docker-929000) Calling .GetMachineName
	I0304 17:56:41.244637   95995 main.go:141] libmachine: (offline-docker-929000) Calling .DriverName
	I0304 17:56:41.244764   95995 start.go:159] libmachine.API.Create for "offline-docker-929000" (driver="hyperkit")
	I0304 17:56:41.244782   95995 client.go:168] LocalClient.Create starting
	I0304 17:56:41.244810   95995 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:56:41.244858   95995 main.go:141] libmachine: Decoding PEM data...
	I0304 17:56:41.244871   95995 main.go:141] libmachine: Parsing certificate...
	I0304 17:56:41.244935   95995 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:56:41.244970   95995 main.go:141] libmachine: Decoding PEM data...
	I0304 17:56:41.244983   95995 main.go:141] libmachine: Parsing certificate...
	I0304 17:56:41.244998   95995 main.go:141] libmachine: Running pre-create checks...
	I0304 17:56:41.245003   95995 main.go:141] libmachine: (offline-docker-929000) Calling .PreCreateCheck
	I0304 17:56:41.245097   95995 main.go:141] libmachine: (offline-docker-929000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:56:41.245122   95995 main.go:141] libmachine: (offline-docker-929000) Calling .GetConfigRaw
	I0304 17:56:41.245533   95995 main.go:141] libmachine: Creating machine...
	I0304 17:56:41.245542   95995 main.go:141] libmachine: (offline-docker-929000) Calling .Create
	I0304 17:56:41.245613   95995 main.go:141] libmachine: (offline-docker-929000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:56:41.245742   95995 main.go:141] libmachine: (offline-docker-929000) DBG | I0304 17:56:41.245608   96134 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:56:41.245786   95995 main.go:141] libmachine: (offline-docker-929000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:56:41.790918   95995 main.go:141] libmachine: (offline-docker-929000) DBG | I0304 17:56:41.790855   96134 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/offline-docker-929000/id_rsa...
	I0304 17:56:42.052057   95995 main.go:141] libmachine: (offline-docker-929000) DBG | I0304 17:56:42.051884   96134 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/offline-docker-929000/offline-docker-929000.rawdisk...
	I0304 17:56:42.052091   95995 main.go:141] libmachine: (offline-docker-929000) DBG | Writing magic tar header
	I0304 17:56:42.052115   95995 main.go:141] libmachine: (offline-docker-929000) DBG | Writing SSH key tar header
	I0304 17:56:42.052631   95995 main.go:141] libmachine: (offline-docker-929000) DBG | I0304 17:56:42.052558   96134 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/offline-docker-929000 ...
	I0304 17:56:42.476193   95995 main.go:141] libmachine: (offline-docker-929000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:56:42.476226   95995 main.go:141] libmachine: (offline-docker-929000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/offline-docker-929000/hyperkit.pid
	I0304 17:56:42.476267   95995 main.go:141] libmachine: (offline-docker-929000) DBG | Using UUID ac9bf73f-4707-4916-95a0-2456b7818304
	I0304 17:56:42.528614   95995 main.go:141] libmachine: (offline-docker-929000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:56:42.528709   95995 client.go:171] duration metric: took 1.283906138s to LocalClient.Create
	I0304 17:56:44.528899   95995 start.go:128] duration metric: took 3.350717189s to createHost
	I0304 17:56:44.528924   95995 start.go:83] releasing machines lock for "offline-docker-929000", held for 3.350881685s
	W0304 17:56:44.529049   95995 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p offline-docker-929000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p offline-docker-929000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:56:44.572276   95995 out.go:177] 
	W0304 17:56:44.593401   95995 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:56:44.593506   95995 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:56:44.593546   95995 out.go:239] * Related issues:
	* Related issues:
	W0304 17:56:44.593566   95995 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:56:44.593597   95995 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:56:44.614605   95995 out.go:177] 

                                                
                                                
** /stderr **
aab_offline_test.go:58: out/minikube-darwin-amd64 start -p offline-docker-929000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit  failed: exit status 60
panic.go:626: *** TestOffline FAILED at 2024-03-04 17:56:44.680218 -0800 PST m=+1203.380481828
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p offline-docker-929000 -n offline-docker-929000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p offline-docker-929000 -n offline-docker-929000: exit status 7 (74.429186ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "offline-docker-929000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "offline-docker-929000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p offline-docker-929000
--- FAIL: TestOffline (12.54s)

                                                
                                    
x
+
TestCertOptions (14.04s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-options-223000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit 
cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-options-223000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit : exit status 60 (13.376790583s)

                                                
                                                
-- stdout --
	* [cert-options-223000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "cert-options-223000" primary control-plane node in "cert-options-223000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "cert-options-223000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-options-223000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-amd64 start -p cert-options-223000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit " : exit status 60
cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-amd64 -p cert-options-223000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p cert-options-223000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 83 (141.911254ms)

                                                
                                                
-- stdout --
	* The control-plane node cert-options-223000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-223000"

                                                
                                                
-- /stdout --
cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-amd64 -p cert-options-223000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 83
cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.
cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.
cert_options_test.go:69: apiserver cert does not include localhost in SAN.
cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-223000 config view
cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 
'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"
cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-amd64 ssh -p cert-options-223000 -- "sudo cat /etc/kubernetes/admin.conf"
cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p cert-options-223000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 83 (140.313402ms)

                                                
                                                
-- stdout --
	* The control-plane node cert-options-223000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-223000"

                                                
                                                
-- /stdout --
cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-amd64 ssh -p cert-options-223000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 83
cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 
-- stdout --
	* The control-plane node cert-options-223000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-223000"

                                                
                                                
-- /stdout --
cert_options_test.go:109: *** TestCertOptions FAILED at 2024-03-04 17:57:34.087335 -0800 PST m=+1252.787052486
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p cert-options-223000 -n cert-options-223000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p cert-options-223000 -n cert-options-223000: exit status 7 (76.141275ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-options-223000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-options-223000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-options-223000
--- FAIL: TestCertOptions (14.04s)

                                                
                                    
x
+
TestCertExpiration (201.32s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-767000 --memory=2048 --cert-expiration=3m --driver=hyperkit 
cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-expiration-767000 --memory=2048 --cert-expiration=3m --driver=hyperkit : exit status 60 (13.97185313s)

                                                
                                                
-- stdout --
	* [cert-expiration-767000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "cert-expiration-767000" primary control-plane node in "cert-expiration-767000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "cert-expiration-767000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-767000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-amd64 start -p cert-expiration-767000 --memory=2048 --cert-expiration=3m --driver=hyperkit " : exit status 60
E0304 17:57:26.240390   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-767000 --memory=2048 --cert-expiration=8760h --driver=hyperkit 
cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-expiration-767000 --memory=2048 --cert-expiration=8760h --driver=hyperkit : exit status 60 (6.998392792s)

                                                
                                                
-- stdout --
	* [cert-expiration-767000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "cert-expiration-767000" primary control-plane node in "cert-expiration-767000" cluster
	* Restarting existing hyperkit VM for "cert-expiration-767000" ...
	* Restarting existing hyperkit VM for "cert-expiration-767000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-767000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-amd64 start -p cert-expiration-767000 --memory=2048 --cert-expiration=8760h --driver=hyperkit " : exit status 60
cert_options_test.go:136: minikube start output did not warn about expired certs: 
-- stdout --
	* [cert-expiration-767000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "cert-expiration-767000" primary control-plane node in "cert-expiration-767000" cluster
	* Restarting existing hyperkit VM for "cert-expiration-767000" ...
	* Restarting existing hyperkit VM for "cert-expiration-767000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-767000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:138: *** TestCertExpiration FAILED at 2024-03-04 18:00:30.113661 -0800 PST m=+1428.811432596
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p cert-expiration-767000 -n cert-expiration-767000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p cert-expiration-767000 -n cert-expiration-767000: exit status 7 (75.603449ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-expiration-767000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-expiration-767000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-expiration-767000
--- FAIL: TestCertExpiration (201.32s)

                                                
                                    
x
+
TestDockerFlags (15.28s)

                                                
                                                
=== RUN   TestDockerFlags
=== PAUSE TestDockerFlags

                                                
                                                

                                                
                                                
=== CONT  TestDockerFlags
docker_test.go:51: (dbg) Run:  out/minikube-darwin-amd64 start -p docker-flags-377000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p docker-flags-377000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (14.556917748s)

                                                
                                                
-- stdout --
	* [docker-flags-377000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "docker-flags-377000" primary control-plane node in "docker-flags-377000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "docker-flags-377000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:57:05.169604   96236 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:57:05.169853   96236 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:57:05.169858   96236 out.go:304] Setting ErrFile to fd 2...
	I0304 17:57:05.169862   96236 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:57:05.170040   96236 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:57:05.171621   96236 out.go:298] Setting JSON to false
	I0304 17:57:05.194158   96236 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24994,"bootTime":1709578831,"procs":498,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:57:05.194247   96236 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:57:05.215798   96236 out.go:177] * [docker-flags-377000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:57:05.258457   96236 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:57:05.258510   96236 notify.go:220] Checking for updates...
	I0304 17:57:05.321681   96236 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:57:05.379422   96236 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:57:05.421342   96236 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:57:05.463608   96236 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:57:05.505607   96236 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:57:05.527337   96236 config.go:182] Loaded profile config "force-systemd-flag-728000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:57:05.527535   96236 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:57:05.527712   96236 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:57:05.564663   96236 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 17:57:05.585547   96236 start.go:297] selected driver: hyperkit
	I0304 17:57:05.585576   96236 start.go:901] validating driver "hyperkit" against <nil>
	I0304 17:57:05.585598   96236 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:57:05.589828   96236 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:57:05.589952   96236 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:57:05.598232   96236 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:57:05.602392   96236 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:57:05.602433   96236 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 17:57:05.602482   96236 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 17:57:05.602681   96236 start_flags.go:942] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]
	I0304 17:57:05.602746   96236 cni.go:84] Creating CNI manager for ""
	I0304 17:57:05.602769   96236 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 17:57:05.602777   96236 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0304 17:57:05.602843   96236 start.go:340] cluster config:
	{Name:docker-flags-377000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-377000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:
[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientP
ath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:57:05.602933   96236 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:57:05.628670   96236 out.go:177] * Starting "docker-flags-377000" primary control-plane node in "docker-flags-377000" cluster
	I0304 17:57:05.670524   96236 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:57:05.670597   96236 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:57:05.670632   96236 cache.go:56] Caching tarball of preloaded images
	I0304 17:57:05.670838   96236 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:57:05.670857   96236 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 17:57:05.671064   96236 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/docker-flags-377000/config.json ...
	I0304 17:57:05.671105   96236 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/docker-flags-377000/config.json: {Name:mkf91f17fd945d465f0203339329817399770ac4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 17:57:05.671710   96236 start.go:360] acquireMachinesLock for docker-flags-377000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:57:08.420753   96236 start.go:364] duration metric: took 2.748985296s to acquireMachinesLock for "docker-flags-377000"
	I0304 17:57:08.420859   96236 start.go:93] Provisioning new machine with config: &{Name:docker-flags-377000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSH
Key: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-377000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountI
P: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:57:08.420949   96236 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:57:08.464066   96236 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0304 17:57:08.464366   96236 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:57:08.464444   96236 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:57:08.473934   96236 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64145
	I0304 17:57:08.474325   96236 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:57:08.474750   96236 main.go:141] libmachine: Using API Version  1
	I0304 17:57:08.474759   96236 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:57:08.474991   96236 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:57:08.475094   96236 main.go:141] libmachine: (docker-flags-377000) Calling .GetMachineName
	I0304 17:57:08.475187   96236 main.go:141] libmachine: (docker-flags-377000) Calling .DriverName
	I0304 17:57:08.475288   96236 start.go:159] libmachine.API.Create for "docker-flags-377000" (driver="hyperkit")
	I0304 17:57:08.475314   96236 client.go:168] LocalClient.Create starting
	I0304 17:57:08.475347   96236 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:57:08.475382   96236 main.go:141] libmachine: Decoding PEM data...
	I0304 17:57:08.475405   96236 main.go:141] libmachine: Parsing certificate...
	I0304 17:57:08.475460   96236 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:57:08.475486   96236 main.go:141] libmachine: Decoding PEM data...
	I0304 17:57:08.475497   96236 main.go:141] libmachine: Parsing certificate...
	I0304 17:57:08.475510   96236 main.go:141] libmachine: Running pre-create checks...
	I0304 17:57:08.475516   96236 main.go:141] libmachine: (docker-flags-377000) Calling .PreCreateCheck
	I0304 17:57:08.475598   96236 main.go:141] libmachine: (docker-flags-377000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:08.475744   96236 main.go:141] libmachine: (docker-flags-377000) Calling .GetConfigRaw
	I0304 17:57:08.507577   96236 main.go:141] libmachine: Creating machine...
	I0304 17:57:08.507598   96236 main.go:141] libmachine: (docker-flags-377000) Calling .Create
	I0304 17:57:08.507828   96236 main.go:141] libmachine: (docker-flags-377000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:08.508031   96236 main.go:141] libmachine: (docker-flags-377000) DBG | I0304 17:57:08.507786   96247 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:57:08.508199   96236 main.go:141] libmachine: (docker-flags-377000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:57:08.875196   96236 main.go:141] libmachine: (docker-flags-377000) DBG | I0304 17:57:08.875126   96247 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/docker-flags-377000/id_rsa...
	I0304 17:57:08.955617   96236 main.go:141] libmachine: (docker-flags-377000) DBG | I0304 17:57:08.955544   96247 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/docker-flags-377000/docker-flags-377000.rawdisk...
	I0304 17:57:08.955643   96236 main.go:141] libmachine: (docker-flags-377000) DBG | Writing magic tar header
	I0304 17:57:08.955659   96236 main.go:141] libmachine: (docker-flags-377000) DBG | Writing SSH key tar header
	I0304 17:57:08.956047   96236 main.go:141] libmachine: (docker-flags-377000) DBG | I0304 17:57:08.956003   96247 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/docker-flags-377000 ...
	I0304 17:57:09.497113   96236 main.go:141] libmachine: (docker-flags-377000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:09.497150   96236 main.go:141] libmachine: (docker-flags-377000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/docker-flags-377000/hyperkit.pid
	I0304 17:57:09.497176   96236 main.go:141] libmachine: (docker-flags-377000) DBG | Using UUID b44a48bb-e04a-4e2c-bb4c-1406b13643f2
	I0304 17:57:09.627089   96236 main.go:141] libmachine: (docker-flags-377000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:57:09.627160   96236 client.go:171] duration metric: took 1.151822149s to LocalClient.Create
	I0304 17:57:11.627335   96236 start.go:128] duration metric: took 3.206334155s to createHost
	I0304 17:57:11.627350   96236 start.go:83] releasing machines lock for "docker-flags-377000", held for 3.206517198s
	W0304 17:57:11.627367   96236 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 17:57:11.627754   96236 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:57:11.627781   96236 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:57:11.635833   96236 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64157
	I0304 17:57:11.636179   96236 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:57:11.636552   96236 main.go:141] libmachine: Using API Version  1
	I0304 17:57:11.636574   96236 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:57:11.636778   96236 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:57:11.637116   96236 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:57:11.637137   96236 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:57:11.645051   96236 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64159
	I0304 17:57:11.645382   96236 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:57:11.645699   96236 main.go:141] libmachine: Using API Version  1
	I0304 17:57:11.645708   96236 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:57:11.645911   96236 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:57:11.646016   96236 main.go:141] libmachine: (docker-flags-377000) Calling .GetState
	I0304 17:57:11.646094   96236 main.go:141] libmachine: (docker-flags-377000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:11.646144   96236 main.go:141] libmachine: (docker-flags-377000) DBG | hyperkit pid from json: 0
	I0304 17:57:11.646158   96236 main.go:141] libmachine: (docker-flags-377000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/docker-flags-377000/hyperkit.json: no such file or directory
	I0304 17:57:11.646229   96236 main.go:141] libmachine: (docker-flags-377000) Calling .DriverName
	I0304 17:57:11.738561   96236 out.go:177] * Deleting "docker-flags-377000" in hyperkit ...
	I0304 17:57:11.801031   96236 main.go:141] libmachine: (docker-flags-377000) Calling .Remove
	I0304 17:57:11.801384   96236 main.go:141] libmachine: (docker-flags-377000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:11.801444   96236 main.go:141] libmachine: (docker-flags-377000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/docker-flags-377000/hyperkit.json: no such file or directory
	I0304 17:57:11.801475   96236 main.go:141] libmachine: (docker-flags-377000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:11.801497   96236 main.go:141] libmachine: (docker-flags-377000) DBG | hyperkit pid from json: 0
	W0304 17:57:11.820992   96236 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:57:11.821010   96236 start.go:728] Will try again in 5 seconds ...
	I0304 17:57:16.821614   96236 start.go:360] acquireMachinesLock for docker-flags-377000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:57:16.821698   96236 start.go:364] duration metric: took 62.137µs to acquireMachinesLock for "docker-flags-377000"
	I0304 17:57:16.821721   96236 start.go:93] Provisioning new machine with config: &{Name:docker-flags-377000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSH
Key: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-377000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountI
P: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:57:16.821787   96236 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:57:16.865255   96236 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0304 17:57:16.865330   96236 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:57:16.865359   96236 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:57:16.873499   96236 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64167
	I0304 17:57:16.873884   96236 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:57:16.874252   96236 main.go:141] libmachine: Using API Version  1
	I0304 17:57:16.874267   96236 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:57:16.874489   96236 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:57:16.874602   96236 main.go:141] libmachine: (docker-flags-377000) Calling .GetMachineName
	I0304 17:57:16.874690   96236 main.go:141] libmachine: (docker-flags-377000) Calling .DriverName
	I0304 17:57:16.874827   96236 start.go:159] libmachine.API.Create for "docker-flags-377000" (driver="hyperkit")
	I0304 17:57:16.874858   96236 client.go:168] LocalClient.Create starting
	I0304 17:57:16.874886   96236 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:57:16.874944   96236 main.go:141] libmachine: Decoding PEM data...
	I0304 17:57:16.874957   96236 main.go:141] libmachine: Parsing certificate...
	I0304 17:57:16.874996   96236 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:57:16.875034   96236 main.go:141] libmachine: Decoding PEM data...
	I0304 17:57:16.875045   96236 main.go:141] libmachine: Parsing certificate...
	I0304 17:57:16.875056   96236 main.go:141] libmachine: Running pre-create checks...
	I0304 17:57:16.875062   96236 main.go:141] libmachine: (docker-flags-377000) Calling .PreCreateCheck
	I0304 17:57:16.875153   96236 main.go:141] libmachine: (docker-flags-377000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:16.875170   96236 main.go:141] libmachine: (docker-flags-377000) Calling .GetConfigRaw
	I0304 17:57:16.875612   96236 main.go:141] libmachine: Creating machine...
	I0304 17:57:16.875620   96236 main.go:141] libmachine: (docker-flags-377000) Calling .Create
	I0304 17:57:16.875691   96236 main.go:141] libmachine: (docker-flags-377000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:16.875809   96236 main.go:141] libmachine: (docker-flags-377000) DBG | I0304 17:57:16.875681   96278 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:57:16.875896   96236 main.go:141] libmachine: (docker-flags-377000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:57:17.049165   96236 main.go:141] libmachine: (docker-flags-377000) DBG | I0304 17:57:17.049056   96278 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/docker-flags-377000/id_rsa...
	I0304 17:57:17.096632   96236 main.go:141] libmachine: (docker-flags-377000) DBG | I0304 17:57:17.096561   96278 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/docker-flags-377000/docker-flags-377000.rawdisk...
	I0304 17:57:17.096642   96236 main.go:141] libmachine: (docker-flags-377000) DBG | Writing magic tar header
	I0304 17:57:17.096650   96236 main.go:141] libmachine: (docker-flags-377000) DBG | Writing SSH key tar header
	I0304 17:57:17.097029   96236 main.go:141] libmachine: (docker-flags-377000) DBG | I0304 17:57:17.096978   96278 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/docker-flags-377000 ...
	I0304 17:57:17.457552   96236 main.go:141] libmachine: (docker-flags-377000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:17.457571   96236 main.go:141] libmachine: (docker-flags-377000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/docker-flags-377000/hyperkit.pid
	I0304 17:57:17.457629   96236 main.go:141] libmachine: (docker-flags-377000) DBG | Using UUID e454898c-dddf-4f00-863d-c5aca8fb8d62
	I0304 17:57:17.492616   96236 main.go:141] libmachine: (docker-flags-377000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:57:17.492730   96236 client.go:171] duration metric: took 617.855712ms to LocalClient.Create
	I0304 17:57:19.492953   96236 start.go:128] duration metric: took 2.671119756s to createHost
	I0304 17:57:19.492981   96236 start.go:83] releasing machines lock for "docker-flags-377000", held for 2.671244973s
	W0304 17:57:19.493111   96236 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p docker-flags-377000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p docker-flags-377000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:57:19.535766   96236 out.go:177] 
	W0304 17:57:19.558827   96236 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:57:19.558884   96236 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:57:19.558909   96236 out.go:239] * Related issues:
	* Related issues:
	W0304 17:57:19.558949   96236 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:57:19.558975   96236 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:57:19.601743   96236 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-amd64 start -p docker-flags-377000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:56: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-377000 ssh "sudo systemctl show docker --property=Environment --no-pager"
docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p docker-flags-377000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 83 (177.696022ms)

                                                
                                                
-- stdout --
	* The control-plane node docker-flags-377000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p docker-flags-377000"

                                                
                                                
-- /stdout --
docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-amd64 -p docker-flags-377000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 83
docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-377000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-377000\"\n"*.
docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-377000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-377000\"\n"*.
docker_test.go:67: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-377000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"
docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p docker-flags-377000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 83 (182.203236ms)

                                                
                                                
-- stdout --
	* The control-plane node docker-flags-377000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p docker-flags-377000"

                                                
                                                
-- /stdout --
docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-amd64 -p docker-flags-377000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 83
docker_test.go:73: expected "out/minikube-darwin-amd64 -p docker-flags-377000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control-plane node docker-flags-377000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-377000\"\n"
panic.go:626: *** TestDockerFlags FAILED at 2024-03-04 17:57:20.029136 -0800 PST m=+1238.729009056
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p docker-flags-377000 -n docker-flags-377000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p docker-flags-377000 -n docker-flags-377000: exit status 7 (74.543567ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "docker-flags-377000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "docker-flags-377000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p docker-flags-377000
--- FAIL: TestDockerFlags (15.28s)

                                                
                                    
x
+
TestForceSystemdFlag (12.25s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-flag-728000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-flag-728000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (11.701914614s)

                                                
                                                
-- stdout --
	* [force-systemd-flag-728000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "force-systemd-flag-728000" primary control-plane node in "force-systemd-flag-728000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "force-systemd-flag-728000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:56:56.950050   96206 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:56:56.950248   96206 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:56:56.950253   96206 out.go:304] Setting ErrFile to fd 2...
	I0304 17:56:56.950257   96206 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:56:56.950440   96206 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:56:56.952462   96206 out.go:298] Setting JSON to false
	I0304 17:56:56.977056   96206 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24985,"bootTime":1709578831,"procs":488,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:56:56.977158   96206 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:56:56.999549   96206 out.go:177] * [force-systemd-flag-728000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:56:57.063345   96206 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:56:57.041408   96206 notify.go:220] Checking for updates...
	I0304 17:56:57.106320   96206 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:56:57.148246   96206 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:56:57.190415   96206 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:56:57.232289   96206 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:56:57.274311   96206 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:56:57.296284   96206 config.go:182] Loaded profile config "force-systemd-env-702000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:56:57.296483   96206 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:56:57.296656   96206 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:56:57.326184   96206 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 17:56:57.368322   96206 start.go:297] selected driver: hyperkit
	I0304 17:56:57.368348   96206 start.go:901] validating driver "hyperkit" against <nil>
	I0304 17:56:57.368370   96206 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:56:57.372540   96206 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:56:57.372638   96206 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:56:57.380555   96206 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:56:57.384398   96206 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:56:57.384421   96206 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 17:56:57.384450   96206 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 17:56:57.384657   96206 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0304 17:56:57.384713   96206 cni.go:84] Creating CNI manager for ""
	I0304 17:56:57.384732   96206 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 17:56:57.384743   96206 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0304 17:56:57.384816   96206 start.go:340] cluster config:
	{Name:force-systemd-flag-728000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-728000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:56:57.384901   96206 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:56:57.431424   96206 out.go:177] * Starting "force-systemd-flag-728000" primary control-plane node in "force-systemd-flag-728000" cluster
	I0304 17:56:57.452355   96206 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:56:57.452429   96206 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:56:57.452463   96206 cache.go:56] Caching tarball of preloaded images
	I0304 17:56:57.452664   96206 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:56:57.452684   96206 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 17:56:57.452837   96206 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/force-systemd-flag-728000/config.json ...
	I0304 17:56:57.452874   96206 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/force-systemd-flag-728000/config.json: {Name:mk3c21e0f0a0e0dffae7bc75d896b59a73d5f939 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 17:56:57.453639   96206 start.go:360] acquireMachinesLock for force-systemd-flag-728000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:56:57.453768   96206 start.go:364] duration metric: took 97.466µs to acquireMachinesLock for "force-systemd-flag-728000"
	I0304 17:56:57.453815   96206 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-728000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-728000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disable
Optimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:56:57.453888   96206 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:56:57.475548   96206 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0304 17:56:57.475816   96206 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:56:57.475886   96206 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:56:57.485368   96206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64125
	I0304 17:56:57.485776   96206 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:56:57.486210   96206 main.go:141] libmachine: Using API Version  1
	I0304 17:56:57.486221   96206 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:56:57.486438   96206 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:56:57.486551   96206 main.go:141] libmachine: (force-systemd-flag-728000) Calling .GetMachineName
	I0304 17:56:57.486625   96206 main.go:141] libmachine: (force-systemd-flag-728000) Calling .DriverName
	I0304 17:56:57.486724   96206 start.go:159] libmachine.API.Create for "force-systemd-flag-728000" (driver="hyperkit")
	I0304 17:56:57.486757   96206 client.go:168] LocalClient.Create starting
	I0304 17:56:57.486790   96206 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:56:57.486839   96206 main.go:141] libmachine: Decoding PEM data...
	I0304 17:56:57.486855   96206 main.go:141] libmachine: Parsing certificate...
	I0304 17:56:57.486923   96206 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:56:57.486962   96206 main.go:141] libmachine: Decoding PEM data...
	I0304 17:56:57.486973   96206 main.go:141] libmachine: Parsing certificate...
	I0304 17:56:57.487006   96206 main.go:141] libmachine: Running pre-create checks...
	I0304 17:56:57.487013   96206 main.go:141] libmachine: (force-systemd-flag-728000) Calling .PreCreateCheck
	I0304 17:56:57.487093   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:56:57.487245   96206 main.go:141] libmachine: (force-systemd-flag-728000) Calling .GetConfigRaw
	I0304 17:56:57.496620   96206 main.go:141] libmachine: Creating machine...
	I0304 17:56:57.496642   96206 main.go:141] libmachine: (force-systemd-flag-728000) Calling .Create
	I0304 17:56:57.496820   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:56:57.497051   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | I0304 17:56:57.496792   96216 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:56:57.497130   96206 main.go:141] libmachine: (force-systemd-flag-728000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:56:57.667187   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | I0304 17:56:57.667122   96216 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-flag-728000/id_rsa...
	I0304 17:56:57.748582   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | I0304 17:56:57.748526   96216 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-flag-728000/force-systemd-flag-728000.rawdisk...
	I0304 17:56:57.748603   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | Writing magic tar header
	I0304 17:56:57.748613   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | Writing SSH key tar header
	I0304 17:56:57.749314   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | I0304 17:56:57.749250   96216 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-flag-728000 ...
	I0304 17:56:58.113069   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:56:58.113088   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-flag-728000/hyperkit.pid
	I0304 17:56:58.113112   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | Using UUID 588bc97d-907e-4085-a1d7-7c4780eab5ff
	I0304 17:56:58.150139   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:56:58.150230   96206 client.go:171] duration metric: took 663.45392ms to LocalClient.Create
	I0304 17:57:00.150571   96206 start.go:128] duration metric: took 2.696633469s to createHost
	I0304 17:57:00.150597   96206 start.go:83] releasing machines lock for "force-systemd-flag-728000", held for 2.696785824s
	W0304 17:57:00.150628   96206 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 17:57:00.151175   96206 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:57:00.151221   96206 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:57:00.160202   96206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64127
	I0304 17:57:00.160555   96206 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:57:00.160902   96206 main.go:141] libmachine: Using API Version  1
	I0304 17:57:00.160916   96206 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:57:00.161163   96206 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:57:00.161514   96206 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:57:00.161538   96206 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:57:00.169407   96206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64129
	I0304 17:57:00.169769   96206 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:57:00.170118   96206 main.go:141] libmachine: Using API Version  1
	I0304 17:57:00.170139   96206 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:57:00.170342   96206 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:57:00.170438   96206 main.go:141] libmachine: (force-systemd-flag-728000) Calling .GetState
	I0304 17:57:00.170540   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:00.170566   96206 main.go:141] libmachine: (force-systemd-flag-728000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-flag-728000/hyperkit.json: no such file or directory
	I0304 17:57:00.170573   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | hyperkit pid from json: 0
	I0304 17:57:00.170643   96206 main.go:141] libmachine: (force-systemd-flag-728000) Calling .DriverName
	I0304 17:57:00.224117   96206 out.go:177] * Deleting "force-systemd-flag-728000" in hyperkit ...
	I0304 17:57:00.245704   96206 main.go:141] libmachine: (force-systemd-flag-728000) Calling .Remove
	I0304 17:57:00.245881   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:00.245894   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:00.245906   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | hyperkit pid from json: 0
	I0304 17:57:00.245924   96206 main.go:141] libmachine: (force-systemd-flag-728000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-flag-728000/hyperkit.json: no such file or directory
	W0304 17:57:00.263067   96206 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:57:00.263078   96206 start.go:728] Will try again in 5 seconds ...
	I0304 17:57:05.265064   96206 start.go:360] acquireMachinesLock for force-systemd-flag-728000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:57:05.265206   96206 start.go:364] duration metric: took 113.403µs to acquireMachinesLock for "force-systemd-flag-728000"
	I0304 17:57:05.265268   96206 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-728000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-728000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disable
Optimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:57:05.265391   96206 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:57:05.321640   96206 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0304 17:57:05.321762   96206 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:57:05.321808   96206 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:57:05.330276   96206 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64143
	I0304 17:57:05.330730   96206 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:57:05.331113   96206 main.go:141] libmachine: Using API Version  1
	I0304 17:57:05.331128   96206 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:57:05.331350   96206 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:57:05.331464   96206 main.go:141] libmachine: (force-systemd-flag-728000) Calling .GetMachineName
	I0304 17:57:05.331545   96206 main.go:141] libmachine: (force-systemd-flag-728000) Calling .DriverName
	I0304 17:57:05.331633   96206 start.go:159] libmachine.API.Create for "force-systemd-flag-728000" (driver="hyperkit")
	I0304 17:57:05.331662   96206 client.go:168] LocalClient.Create starting
	I0304 17:57:05.331690   96206 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:57:05.331740   96206 main.go:141] libmachine: Decoding PEM data...
	I0304 17:57:05.331753   96206 main.go:141] libmachine: Parsing certificate...
	I0304 17:57:05.331792   96206 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:57:05.331828   96206 main.go:141] libmachine: Decoding PEM data...
	I0304 17:57:05.331839   96206 main.go:141] libmachine: Parsing certificate...
	I0304 17:57:05.331853   96206 main.go:141] libmachine: Running pre-create checks...
	I0304 17:57:05.331859   96206 main.go:141] libmachine: (force-systemd-flag-728000) Calling .PreCreateCheck
	I0304 17:57:05.331926   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:05.331953   96206 main.go:141] libmachine: (force-systemd-flag-728000) Calling .GetConfigRaw
	I0304 17:57:05.379471   96206 main.go:141] libmachine: Creating machine...
	I0304 17:57:05.379494   96206 main.go:141] libmachine: (force-systemd-flag-728000) Calling .Create
	I0304 17:57:05.379678   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:05.379860   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | I0304 17:57:05.379650   96240 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:57:05.379931   96206 main.go:141] libmachine: (force-systemd-flag-728000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:57:05.818507   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | I0304 17:57:05.818413   96240 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-flag-728000/id_rsa...
	I0304 17:57:06.018213   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | I0304 17:57:06.018115   96240 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-flag-728000/force-systemd-flag-728000.rawdisk...
	I0304 17:57:06.018231   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | Writing magic tar header
	I0304 17:57:06.018242   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | Writing SSH key tar header
	I0304 17:57:06.019065   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | I0304 17:57:06.018949   96240 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-flag-728000 ...
	I0304 17:57:06.383285   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:06.383305   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-flag-728000/hyperkit.pid
	I0304 17:57:06.383336   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | Using UUID 574d2e52-493d-4d7b-93b2-3a0715094ec1
	I0304 17:57:06.420074   96206 main.go:141] libmachine: (force-systemd-flag-728000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:57:06.420161   96206 client.go:171] duration metric: took 1.08848022s to LocalClient.Create
	I0304 17:57:08.420629   96206 start.go:128] duration metric: took 3.15516433s to createHost
	I0304 17:57:08.420675   96206 start.go:83] releasing machines lock for "force-systemd-flag-728000", held for 3.155397773s
	W0304 17:57:08.420802   96206 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p force-systemd-flag-728000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p force-systemd-flag-728000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:57:08.464083   96206 out.go:177] 
	W0304 17:57:08.485104   96206 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:57:08.485161   96206 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:57:08.485176   96206 out.go:239] * Related issues:
	* Related issues:
	W0304 17:57:08.485270   96206 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:57:08.485305   96206 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:57:08.528184   96206 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-flag-728000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-flag-728000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p force-systemd-flag-728000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (176.763395ms)

                                                
                                                
-- stdout --
	* The control-plane node force-systemd-flag-728000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p force-systemd-flag-728000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-amd64 -p force-systemd-flag-728000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83
docker_test.go:106: *** TestForceSystemdFlag FAILED at 2024-03-04 17:57:08.770705 -0800 PST m=+1227.470702278
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-flag-728000 -n force-systemd-flag-728000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-flag-728000 -n force-systemd-flag-728000: exit status 7 (76.673854ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-flag-728000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-flag-728000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-flag-728000
--- FAIL: TestForceSystemdFlag (12.25s)

                                                
                                    
x
+
TestForceSystemdEnv (17.81s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-env-702000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-env-702000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (17.319812394s)

                                                
                                                
-- stdout --
	* [force-systemd-env-702000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=true
	* Using the hyperkit driver based on user configuration
	* Downloading driver docker-machine-driver-hyperkit:
	* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:
	
	    $ sudo chown root:wheel /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit 
	    $ sudo chmod u+s /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit 
	
	
	* Starting "force-systemd-env-702000" primary control-plane node in "force-systemd-env-702000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "force-systemd-env-702000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:56:47.359256   96163 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:56:47.359956   96163 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:56:47.359965   96163 out.go:304] Setting ErrFile to fd 2...
	I0304 17:56:47.359971   96163 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:56:47.360576   96163 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:56:47.362150   96163 out.go:298] Setting JSON to false
	I0304 17:56:47.384727   96163 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24976,"bootTime":1709578831,"procs":491,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:56:47.384844   96163 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:56:47.407091   96163 out.go:177] * [force-systemd-env-702000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:56:47.449867   96163 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:56:47.449950   96163 notify.go:220] Checking for updates...
	I0304 17:56:47.494997   96163 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:56:47.515809   96163 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:56:47.536993   96163 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:56:47.560035   96163 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:56:47.580765   96163 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true
	I0304 17:56:47.602455   96163 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:56:47.602537   96163 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:56:47.631072   96163 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 17:56:47.652004   96163 start.go:297] selected driver: hyperkit
	I0304 17:56:47.652035   96163 start.go:901] validating driver "hyperkit" against <nil>
	I0304 17:56:47.652060   96163 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:56:47.656542   96163 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:56:50.590811   96163 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/testdata/hyperkit-driver-without-version:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	W0304 17:56:50.604747   96163 install.go:62] docker-machine-driver-hyperkit: exit status 1
	I0304 17:56:50.625459   96163 out.go:177] * Downloading driver docker-machine-driver-hyperkit:
	I0304 17:56:50.646513   96163 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64.sha256 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:56:51.082828   96163 driver.go:46] failed to download arch specific driver: getter: &{Ctx:context.Background Src:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64.sha256 Dst:/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit.download Pwd: Mode:2 Umask:---------- Detectors:[0x13802f80 0x13802f80 0x13802f80 0x13802f80 0x13802f80 0x13802f80 0x13802f80] Decompressors:map[bz2:0xc0004c3070 gz:0xc0004c3078 tar:0xc0004c3020 tar.bz2:0xc0004c3030 tar.gz:0xc0004c3040 tar.xz:0xc0004c3050 tar.zst:0xc0004c3060 tbz2:0xc0004c3030 tgz:0xc0004c3040 txz:0xc0004c3050 tzst:0xc0004c3060 xz:0xc0004c3080 zip:0xc0004c3090 zst:0xc0004c3088] Getters:map[file:0xc00011dcb0 http:0xc000a1d090 https:0xc000a1d0e0] Dir:false ProgressListener:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Erro
r downloading checksum file: bad response code: 404. trying to get the common version
	I0304 17:56:51.082904   96163 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit.sha256 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:56:53.137968   96163 install.go:79] stdout: 
	I0304 17:56:53.161291   96163 out.go:177] * The 'hyperkit' driver requires elevated permissions. The following commands will be executed:
	
	    $ sudo chown root:wheel /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit 
	    $ sudo chmod u+s /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit 
	
	
	I0304 17:56:53.182286   96163 install.go:99] testing: [sudo -n chown root:wheel /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit]
	I0304 17:56:53.197770   96163 install.go:106] running: [sudo chown root:wheel /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit]
	I0304 17:56:53.213191   96163 install.go:99] testing: [sudo -n chmod u+s /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit]
	I0304 17:56:53.227305   96163 install.go:106] running: [sudo chmod u+s /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit]
	I0304 17:56:53.241447   96163 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 17:56:53.241705   96163 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0304 17:56:53.241768   96163 cni.go:84] Creating CNI manager for ""
	I0304 17:56:53.241786   96163 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 17:56:53.241792   96163 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0304 17:56:53.241855   96163 start.go:340] cluster config:
	{Name:force-systemd-env-702000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-702000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluste
r.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:56:53.241944   96163 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:56:53.263352   96163 out.go:177] * Starting "force-systemd-env-702000" primary control-plane node in "force-systemd-env-702000" cluster
	I0304 17:56:53.284003   96163 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:56:53.284045   96163 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:56:53.284065   96163 cache.go:56] Caching tarball of preloaded images
	I0304 17:56:53.284175   96163 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:56:53.284185   96163 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 17:56:53.284276   96163 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/force-systemd-env-702000/config.json ...
	I0304 17:56:53.284294   96163 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/force-systemd-env-702000/config.json: {Name:mka30a82a729a41ff8ad341cac1fa0e71bb33bf3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 17:56:53.284672   96163 start.go:360] acquireMachinesLock for force-systemd-env-702000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:56:53.284737   96163 start.go:364] duration metric: took 50.231µs to acquireMachinesLock for "force-systemd-env-702000"
	I0304 17:56:53.284761   96163 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-702000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-702000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOp
timizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:56:53.284805   96163 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:56:53.327153   96163 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0304 17:56:53.327304   96163 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:56:53.327343   96163 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:56:53.646331   96163 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64109
	I0304 17:56:53.646722   96163 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:56:53.647156   96163 main.go:141] libmachine: Using API Version  1
	I0304 17:56:53.647167   96163 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:56:53.647376   96163 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:56:53.647472   96163 main.go:141] libmachine: (force-systemd-env-702000) Calling .GetMachineName
	I0304 17:56:53.647559   96163 main.go:141] libmachine: (force-systemd-env-702000) Calling .DriverName
	I0304 17:56:53.647650   96163 start.go:159] libmachine.API.Create for "force-systemd-env-702000" (driver="hyperkit")
	I0304 17:56:53.647671   96163 client.go:168] LocalClient.Create starting
	I0304 17:56:53.647703   96163 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:56:53.647752   96163 main.go:141] libmachine: Decoding PEM data...
	I0304 17:56:53.647769   96163 main.go:141] libmachine: Parsing certificate...
	I0304 17:56:53.647837   96163 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:56:53.647883   96163 main.go:141] libmachine: Decoding PEM data...
	I0304 17:56:53.647891   96163 main.go:141] libmachine: Parsing certificate...
	I0304 17:56:53.647914   96163 main.go:141] libmachine: Running pre-create checks...
	I0304 17:56:53.647921   96163 main.go:141] libmachine: (force-systemd-env-702000) Calling .PreCreateCheck
	I0304 17:56:53.648000   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:56:53.648203   96163 main.go:141] libmachine: (force-systemd-env-702000) Calling .GetConfigRaw
	I0304 17:56:53.648650   96163 main.go:141] libmachine: Creating machine...
	I0304 17:56:53.648659   96163 main.go:141] libmachine: (force-systemd-env-702000) Calling .Create
	I0304 17:56:53.648723   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:56:53.648841   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | I0304 17:56:53.648714   96191 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:56:53.648904   96163 main.go:141] libmachine: (force-systemd-env-702000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:56:53.821714   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | I0304 17:56:53.821647   96191 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-env-702000/id_rsa...
	I0304 17:56:54.130579   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | I0304 17:56:54.130479   96191 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-env-702000/force-systemd-env-702000.rawdisk...
	I0304 17:56:54.130592   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | Writing magic tar header
	I0304 17:56:54.130603   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | Writing SSH key tar header
	I0304 17:56:54.131459   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | I0304 17:56:54.131362   96191 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-env-702000 ...
	I0304 17:56:54.494818   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:56:54.494835   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-env-702000/hyperkit.pid
	I0304 17:56:54.494886   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | Using UUID 5995009f-f154-4bb0-8aa4-ff69c7f58a5c
	I0304 17:56:54.540348   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:56:54.540439   96163 client.go:171] duration metric: took 892.748694ms to LocalClient.Create
	I0304 17:56:56.540623   96163 start.go:128] duration metric: took 3.255768292s to createHost
	I0304 17:56:56.540646   96163 start.go:83] releasing machines lock for "force-systemd-env-702000", held for 3.255866133s
	W0304 17:56:56.540682   96163 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 17:56:56.540968   96163 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:56:56.540992   96163 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:56:56.549187   96163 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64120
	I0304 17:56:56.549547   96163 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:56:56.549981   96163 main.go:141] libmachine: Using API Version  1
	I0304 17:56:56.549999   96163 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:56:56.550226   96163 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:56:56.550571   96163 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:56:56.550604   96163 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:56:56.558727   96163 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64122
	I0304 17:56:56.559045   96163 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:56:56.559376   96163 main.go:141] libmachine: Using API Version  1
	I0304 17:56:56.559390   96163 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:56:56.559610   96163 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:56:56.559721   96163 main.go:141] libmachine: (force-systemd-env-702000) Calling .GetState
	I0304 17:56:56.559804   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:56:56.559820   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | hyperkit pid from json: 0
	I0304 17:56:56.559847   96163 main.go:141] libmachine: (force-systemd-env-702000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-env-702000/hyperkit.json: no such file or directory
	I0304 17:56:56.559872   96163 main.go:141] libmachine: (force-systemd-env-702000) Calling .DriverName
	I0304 17:56:56.610067   96163 out.go:177] * Deleting "force-systemd-env-702000" in hyperkit ...
	I0304 17:56:56.630984   96163 main.go:141] libmachine: (force-systemd-env-702000) Calling .Remove
	I0304 17:56:56.631113   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:56:56.631124   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:56:56.631156   96163 main.go:141] libmachine: (force-systemd-env-702000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-env-702000/hyperkit.json: no such file or directory
	I0304 17:56:56.631168   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | hyperkit pid from json: 0
	W0304 17:56:56.647808   96163 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:56:56.647822   96163 start.go:728] Will try again in 5 seconds ...
	I0304 17:57:01.648775   96163 start.go:360] acquireMachinesLock for force-systemd-env-702000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:57:01.648970   96163 start.go:364] duration metric: took 119.469µs to acquireMachinesLock for "force-systemd-env-702000"
	I0304 17:57:01.648996   96163 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-702000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-702000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOp
timizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:57:01.649084   96163 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:57:01.691360   96163 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0304 17:57:01.691542   96163 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:57:01.691601   96163 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:57:01.701208   96163 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64131
	I0304 17:57:01.701589   96163 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:57:01.701932   96163 main.go:141] libmachine: Using API Version  1
	I0304 17:57:01.701942   96163 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:57:01.702137   96163 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:57:01.702258   96163 main.go:141] libmachine: (force-systemd-env-702000) Calling .GetMachineName
	I0304 17:57:01.702344   96163 main.go:141] libmachine: (force-systemd-env-702000) Calling .DriverName
	I0304 17:57:01.702448   96163 start.go:159] libmachine.API.Create for "force-systemd-env-702000" (driver="hyperkit")
	I0304 17:57:01.702466   96163 client.go:168] LocalClient.Create starting
	I0304 17:57:01.702494   96163 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:57:01.702541   96163 main.go:141] libmachine: Decoding PEM data...
	I0304 17:57:01.702555   96163 main.go:141] libmachine: Parsing certificate...
	I0304 17:57:01.702594   96163 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:57:01.702631   96163 main.go:141] libmachine: Decoding PEM data...
	I0304 17:57:01.702646   96163 main.go:141] libmachine: Parsing certificate...
	I0304 17:57:01.702665   96163 main.go:141] libmachine: Running pre-create checks...
	I0304 17:57:01.702670   96163 main.go:141] libmachine: (force-systemd-env-702000) Calling .PreCreateCheck
	I0304 17:57:01.702738   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:01.702770   96163 main.go:141] libmachine: (force-systemd-env-702000) Calling .GetConfigRaw
	I0304 17:57:01.716421   96163 main.go:141] libmachine: Creating machine...
	I0304 17:57:01.716445   96163 main.go:141] libmachine: (force-systemd-env-702000) Calling .Create
	I0304 17:57:01.716731   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:01.716938   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | I0304 17:57:01.716662   96222 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:57:01.717044   96163 main.go:141] libmachine: (force-systemd-env-702000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:57:01.893033   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | I0304 17:57:01.892934   96222 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-env-702000/id_rsa...
	I0304 17:57:01.980696   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | I0304 17:57:01.980554   96222 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-env-702000/force-systemd-env-702000.rawdisk...
	I0304 17:57:01.980723   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | Writing magic tar header
	I0304 17:57:01.980754   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | Writing SSH key tar header
	I0304 17:57:01.981375   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | I0304 17:57:01.981312   96222 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-env-702000 ...
	I0304 17:57:02.343718   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:57:02.343744   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/force-systemd-env-702000/hyperkit.pid
	I0304 17:57:02.343771   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | Using UUID de59a7a8-35de-4b25-a8c4-fabe851727b9
	I0304 17:57:02.442567   96163 main.go:141] libmachine: (force-systemd-env-702000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:57:02.442651   96163 client.go:171] duration metric: took 740.170144ms to LocalClient.Create
	I0304 17:57:04.444820   96163 start.go:128] duration metric: took 2.795692103s to createHost
	I0304 17:57:04.444852   96163 start.go:83] releasing machines lock for "force-systemd-env-702000", held for 2.795842064s
	W0304 17:57:04.444994   96163 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p force-systemd-env-702000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p force-systemd-env-702000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:57:04.489557   96163 out.go:177] 
	W0304 17:57:04.512644   96163 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:57:04.512696   96163 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:57:04.512716   96163 out.go:239] * Related issues:
	* Related issues:
	W0304 17:57:04.512750   96163 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:57:04.512797   96163 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:57:04.555481   96163 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-env-702000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-env-702000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p force-systemd-env-702000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (141.810803ms)

                                                
                                                
-- stdout --
	* The control-plane node force-systemd-env-702000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p force-systemd-env-702000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-amd64 -p force-systemd-env-702000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83
docker_test.go:166: *** TestForceSystemdEnv FAILED at 2024-03-04 17:57:04.763275 -0800 PST m=+1223.463316850
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-702000 -n force-systemd-env-702000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-702000 -n force-systemd-env-702000: exit status 7 (73.791291ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-env-702000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-env-702000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-env-702000
--- FAIL: TestForceSystemdEnv (17.81s)

                                                
                                    
x
+
TestErrorSpam/setup (11.14s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -p nospam-720000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 --driver=hyperkit 
error_spam_test.go:81: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p nospam-720000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 --driver=hyperkit : exit status 60 (11.143410381s)

                                                
                                                
-- stdout --
	* [nospam-720000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "nospam-720000" primary control-plane node in "nospam-720000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
	* Deleting "nospam-720000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p nospam-720000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
error_spam_test.go:83: "out/minikube-darwin-amd64 start -p nospam-720000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 --driver=hyperkit " failed: exit status 60
error_spam_test.go:96: unexpected stderr: "! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "* Failed to start hyperkit VM. Running \"minikube delete -p nospam-720000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "* Suggestion: "
error_spam_test.go:96: unexpected stderr: "    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing."
error_spam_test.go:96: unexpected stderr: "    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver."
error_spam_test.go:96: unexpected stderr: "* Related issues:"
error_spam_test.go:96: unexpected stderr: "  - https://github.com/kubernetes/minikube/issues/6028"
error_spam_test.go:96: unexpected stderr: "  - https://github.com/kubernetes/minikube/issues/5594"
error_spam_test.go:110: minikube stdout:
* [nospam-720000] minikube v1.32.0 on Darwin 14.3.1
- MINIKUBE_LOCATION=17909
- KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the hyperkit driver based on user configuration
* Starting "nospam-720000" primary control-plane node in "nospam-720000" cluster
* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
* Deleting "nospam-720000" in hyperkit ...
* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...

                                                
                                                

                                                
                                                
error_spam_test.go:111: minikube stderr:
! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Failed to start hyperkit VM. Running "minikube delete -p nospam-720000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
* Related issues:
- https://github.com/kubernetes/minikube/issues/6028
- https://github.com/kubernetes/minikube/issues/5594
error_spam_test.go:121: missing kubeadm init sub-step "Generating certificates and keys ..."
error_spam_test.go:121: missing kubeadm init sub-step "Booting up control plane ..."
error_spam_test.go:121: missing kubeadm init sub-step "Configuring RBAC rules ..."
--- FAIL: TestErrorSpam/setup (11.14s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (11.67s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-160000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit 
functional_test.go:2230: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-160000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit : exit status 60 (11.595873594s)

                                                
                                                
-- stdout --
	* [functional-160000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "functional-160000" primary control-plane node in "functional-160000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	* Deleting "functional-160000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Local proxy ignored: not passing HTTP_PROXY=localhost:63252 to docker env.
	! Local proxy ignored: not passing HTTP_PROXY=localhost:63252 to docker env.
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! Local proxy ignored: not passing HTTP_PROXY=localhost:63252 to docker env.
	* Failed to start hyperkit VM. Running "minikube delete -p functional-160000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
functional_test.go:2232: failed minikube start. args "out/minikube-darwin-amd64 start -p functional-160000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit ": exit status 60
functional_test.go:2237: start stdout=* [functional-160000] minikube v1.32.0 on Darwin 14.3.1
- MINIKUBE_LOCATION=17909
- KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the hyperkit driver based on user configuration
* Starting "functional-160000" primary control-plane node in "functional-160000" cluster
* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
* Deleting "functional-160000" in hyperkit ...
* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

                                                
                                                

                                                
                                                
, want: *Found network options:*
functional_test.go:2242: start stderr=! Local proxy ignored: not passing HTTP_PROXY=localhost:63252 to docker env.
! Local proxy ignored: not passing HTTP_PROXY=localhost:63252 to docker env.
! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
! Local proxy ignored: not passing HTTP_PROXY=localhost:63252 to docker env.
* Failed to start hyperkit VM. Running "minikube delete -p functional-160000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
* Related issues:
- https://github.com/kubernetes/minikube/issues/6028
- https://github.com/kubernetes/minikube/issues/5594
, want: *You appear to be using a proxy*
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (76.322289ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/StartWithProxy (11.67s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (5.88s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-160000 --alsologtostderr -v=8
functional_test.go:655: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-160000 --alsologtostderr -v=8: exit status 60 (5.806301174s)

                                                
                                                
-- stdout --
	* [functional-160000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "functional-160000" primary control-plane node in "functional-160000" cluster
	* Restarting existing hyperkit VM for "functional-160000" ...
	* Restarting existing hyperkit VM for "functional-160000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:45:19.140397   94223 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:45:19.140658   94223 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:45:19.140663   94223 out.go:304] Setting ErrFile to fd 2...
	I0304 17:45:19.140666   94223 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:45:19.140851   94223 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:45:19.142396   94223 out.go:298] Setting JSON to false
	I0304 17:45:19.166268   94223 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24288,"bootTime":1709578831,"procs":499,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:45:19.166374   94223 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:45:19.187783   94223 out.go:177] * [functional-160000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:45:19.251273   94223 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:45:19.230295   94223 notify.go:220] Checking for updates...
	I0304 17:45:19.293260   94223 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:45:19.314358   94223 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:45:19.335207   94223 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:45:19.356274   94223 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:45:19.377436   94223 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:45:19.399119   94223 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:45:19.399301   94223 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:45:19.399968   94223 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:45:19.400042   94223 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:45:19.408988   94223 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63267
	I0304 17:45:19.409376   94223 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:45:19.409823   94223 main.go:141] libmachine: Using API Version  1
	I0304 17:45:19.409847   94223 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:45:19.410060   94223 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:45:19.410178   94223 main.go:141] libmachine: (functional-160000) Calling .DriverName
	I0304 17:45:19.438148   94223 out.go:177] * Using the hyperkit driver based on existing profile
	I0304 17:45:19.480332   94223 start.go:297] selected driver: hyperkit
	I0304 17:45:19.480357   94223 start.go:901] validating driver "hyperkit" against &{Name:functional-160000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-160000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:45:19.480544   94223 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:45:19.480765   94223 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:45:19.480964   94223 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:45:19.489927   94223 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:45:19.493698   94223 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:45:19.493719   94223 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0304 17:45:19.496406   94223 cni.go:84] Creating CNI manager for ""
	I0304 17:45:19.496431   94223 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 17:45:19.496504   94223 start.go:340] cluster config:
	{Name:functional-160000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-160000 Namespace:default APISe
rverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disa
bleMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:45:19.496601   94223 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:45:19.538293   94223 out.go:177] * Starting "functional-160000" primary control-plane node in "functional-160000" cluster
	I0304 17:45:19.559343   94223 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:45:19.559432   94223 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:45:19.559532   94223 cache.go:56] Caching tarball of preloaded images
	I0304 17:45:19.559819   94223 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:45:19.559855   94223 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 17:45:19.560045   94223 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/functional-160000/config.json ...
	I0304 17:45:19.560924   94223 start.go:360] acquireMachinesLock for functional-160000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:45:19.561030   94223 start.go:364] duration metric: took 79.037µs to acquireMachinesLock for "functional-160000"
	I0304 17:45:19.561075   94223 start.go:96] Skipping create...Using existing machine configuration
	I0304 17:45:19.561102   94223 fix.go:54] fixHost starting: 
	I0304 17:45:19.561510   94223 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:45:19.561538   94223 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:45:19.570288   94223 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63269
	I0304 17:45:19.570657   94223 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:45:19.571040   94223 main.go:141] libmachine: Using API Version  1
	I0304 17:45:19.571058   94223 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:45:19.571306   94223 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:45:19.571431   94223 main.go:141] libmachine: (functional-160000) Calling .DriverName
	I0304 17:45:19.571534   94223 main.go:141] libmachine: (functional-160000) Calling .GetState
	I0304 17:45:19.571616   94223 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:45:19.571634   94223 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
	I0304 17:45:19.571644   94223 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
	I0304 17:45:19.571690   94223 fix.go:112] recreateIfNeeded on functional-160000: state=Stopped err=<nil>
	I0304 17:45:19.571730   94223 main.go:141] libmachine: (functional-160000) Calling .DriverName
	W0304 17:45:19.571815   94223 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 17:45:19.593282   94223 out.go:177] * Restarting existing hyperkit VM for "functional-160000" ...
	I0304 17:45:19.635309   94223 main.go:141] libmachine: (functional-160000) Calling .Start
	I0304 17:45:19.635508   94223 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:45:19.635547   94223 main.go:141] libmachine: (functional-160000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.pid
	I0304 17:45:19.635610   94223 main.go:141] libmachine: (functional-160000) DBG | Using UUID b2d2d55d-c548-450d-bbf4-d0bbdc04ff2c
	I0304 17:45:19.637316   94223 main.go:141] libmachine: (functional-160000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:45:19.637437   94223 fix.go:56] duration metric: took 76.341972ms for fixHost
	I0304 17:45:19.637447   94223 start.go:83] releasing machines lock for "functional-160000", held for 76.405483ms
	W0304 17:45:19.637462   94223 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0304 17:45:19.637525   94223 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:45:19.637531   94223 start.go:728] Will try again in 5 seconds ...
	I0304 17:45:24.637970   94223 start.go:360] acquireMachinesLock for functional-160000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:45:24.638129   94223 start.go:364] duration metric: took 123.916µs to acquireMachinesLock for "functional-160000"
	I0304 17:45:24.638170   94223 start.go:96] Skipping create...Using existing machine configuration
	I0304 17:45:24.638180   94223 fix.go:54] fixHost starting: 
	I0304 17:45:24.638605   94223 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:45:24.638643   94223 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:45:24.647726   94223 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63271
	I0304 17:45:24.648061   94223 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:45:24.648440   94223 main.go:141] libmachine: Using API Version  1
	I0304 17:45:24.648455   94223 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:45:24.648658   94223 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:45:24.648766   94223 main.go:141] libmachine: (functional-160000) Calling .DriverName
	I0304 17:45:24.648845   94223 main.go:141] libmachine: (functional-160000) Calling .GetState
	I0304 17:45:24.648930   94223 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:45:24.648966   94223 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
	I0304 17:45:24.648983   94223 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
	I0304 17:45:24.648999   94223 fix.go:112] recreateIfNeeded on functional-160000: state=Stopped err=<nil>
	I0304 17:45:24.649018   94223 main.go:141] libmachine: (functional-160000) Calling .DriverName
	W0304 17:45:24.649111   94223 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 17:45:24.670380   94223 out.go:177] * Restarting existing hyperkit VM for "functional-160000" ...
	I0304 17:45:24.714464   94223 main.go:141] libmachine: (functional-160000) Calling .Start
	I0304 17:45:24.714771   94223 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:45:24.714936   94223 main.go:141] libmachine: (functional-160000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.pid
	I0304 17:45:24.715021   94223 main.go:141] libmachine: (functional-160000) DBG | Using UUID b2d2d55d-c548-450d-bbf4-d0bbdc04ff2c
	I0304 17:45:24.717113   94223 main.go:141] libmachine: (functional-160000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:45:24.717195   94223 fix.go:56] duration metric: took 79.015569ms for fixHost
	I0304 17:45:24.717204   94223 start.go:83] releasing machines lock for "functional-160000", held for 79.06022ms
	W0304 17:45:24.717265   94223 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-160000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p functional-160000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:45:24.759286   94223 out.go:177] 
	W0304 17:45:24.780367   94223 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:45:24.780452   94223 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:45:24.780469   94223 out.go:239] * Related issues:
	* Related issues:
	W0304 17:45:24.780539   94223 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:45:24.780590   94223 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:45:24.823501   94223 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:657: failed to soft start minikube. args "out/minikube-darwin-amd64 start -p functional-160000 --alsologtostderr -v=8": exit status 60
functional_test.go:659: soft start took 5.80747556s for "functional-160000" cluster.
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (76.220551ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/SoftStart (5.88s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
functional_test.go:677: (dbg) Non-zero exit: kubectl config current-context: exit status 1 (36.840354ms)

                                                
                                                
** stderr ** 
	error: current-context is not set

                                                
                                                
** /stderr **
functional_test.go:679: failed to get current-context. args "kubectl config current-context" : exit status 1
functional_test.go:683: expected current-context = "functional-160000", but got *""*
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (75.187776ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/KubeContext (0.11s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-160000 get po -A
functional_test.go:692: (dbg) Non-zero exit: kubectl --context functional-160000 get po -A: exit status 1 (36.35114ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-160000

                                                
                                                
** /stderr **
functional_test.go:694: failed to get kubectl pods: args "kubectl --context functional-160000 get po -A" : exit status 1
functional_test.go:698: expected stderr to be empty but got *"Error in configuration: context was not found for specified context: functional-160000\n"*: args "kubectl --context functional-160000 get po -A"
functional_test.go:701: expected stdout to include *kube-system* but got *""*. args: "kubectl --context functional-160000 get po -A"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (75.344789ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh sudo crictl images
functional_test.go:1120: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh sudo crictl images: exit status 83 (139.641453ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1122: failed to get images by "out/minikube-darwin-amd64 -p functional-160000 ssh sudo crictl images" ssh exit status 83
functional_test.go:1126: expected sha for pause:3.3 "0184c1613d929" to be in the output but got *
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --*
--- FAIL: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.14s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (0.52s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh sudo docker rmi registry.k8s.io/pause:latest
functional_test.go:1143: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh sudo docker rmi registry.k8s.io/pause:latest: exit status 83 (140.346409ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1146: failed to manually delete image "out/minikube-darwin-amd64 -p functional-160000 ssh sudo docker rmi registry.k8s.io/pause:latest" : exit status 83
functional_test.go:1149: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 83 (139.182924ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1154: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 cache reload
functional_test.go:1159: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 83 (139.366786ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1161: expected "out/minikube-darwin-amd64 -p functional-160000 ssh sudo crictl inspecti registry.k8s.io/pause:latest" to run successfully but got error: exit status 83
--- FAIL: TestFunctional/serial/CacheCmd/cache/cache_reload (0.52s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.56s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 kubectl -- --context functional-160000 get pods
functional_test.go:712: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 kubectl -- --context functional-160000 get pods: exit status 1 (489.721506ms)

                                                
                                                
** stderr ** 
	Error in configuration: 
	* context was not found for specified context: functional-160000
	* no server found for cluster "functional-160000"

                                                
                                                
** /stderr **
functional_test.go:715: failed to get pods. args "out/minikube-darwin-amd64 -p functional-160000 kubectl -- --context functional-160000 get pods": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (74.452454ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/MinikubeKubectlCmd (0.56s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.73s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-160000 get pods
functional_test.go:737: (dbg) Non-zero exit: out/kubectl --context functional-160000 get pods: exit status 1 (649.907885ms)

                                                
                                                
** stderr ** 
	Error in configuration: 
	* context was not found for specified context: functional-160000
	* no server found for cluster "functional-160000"

                                                
                                                
** /stderr **
functional_test.go:740: failed to run kubectl directly. args "out/kubectl --context functional-160000 get pods": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (74.502339ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.73s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (5.94s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-160000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:753: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-160000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: exit status 60 (5.868579953s)

                                                
                                                
-- stdout --
	* [functional-160000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "functional-160000" primary control-plane node in "functional-160000" cluster
	* Restarting existing hyperkit VM for "functional-160000" ...
	* Restarting existing hyperkit VM for "functional-160000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p functional-160000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
functional_test.go:755: failed to restart minikube. args "out/minikube-darwin-amd64 start -p functional-160000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all": exit status 60
functional_test.go:757: restart took 5.868907874s for "functional-160000" cluster.
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (75.112665ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/ExtraConfig (5.94s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-160000 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:806: (dbg) Non-zero exit: kubectl --context functional-160000 get po -l tier=control-plane -n kube-system -o=json: exit status 1 (36.511863ms)

                                                
                                                
** stderr ** 
	error: context "functional-160000" does not exist

                                                
                                                
** /stderr **
functional_test.go:808: failed to get components. args "kubectl --context functional-160000 get po -l tier=control-plane -n kube-system -o=json": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (74.98292ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (0.32s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 logs
functional_test.go:1232: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 logs: exit status 83 (317.616299ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| delete  | -p download-only-626000                                                                     | download-only-626000 | jenkins | v1.32.0 | 04 Mar 24 17:38 PST | 04 Mar 24 17:38 PST |
	| start   | --download-only -p                                                                          | binary-mirror-221000 | jenkins | v1.32.0 | 04 Mar 24 17:38 PST |                     |
	|         | binary-mirror-221000                                                                        |                      |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |
	|         | --binary-mirror                                                                             |                      |         |         |                     |                     |
	|         | http://127.0.0.1:62827                                                                      |                      |         |         |                     |                     |
	|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
	| delete  | -p binary-mirror-221000                                                                     | binary-mirror-221000 | jenkins | v1.32.0 | 04 Mar 24 17:38 PST | 04 Mar 24 17:38 PST |
	| addons  | enable dashboard -p                                                                         | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:38 PST |                     |
	|         | addons-374000                                                                               |                      |         |         |                     |                     |
	| addons  | disable dashboard -p                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:38 PST |                     |
	|         | addons-374000                                                                               |                      |         |         |                     |                     |
	| start   | -p addons-374000 --wait=true                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:38 PST | 04 Mar 24 17:42 PST |
	|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |
	|         | --addons=registry                                                                           |                      |         |         |                     |                     |
	|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |
	|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |
	|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |
	|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |
	|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin                                                               |                      |         |         |                     |                     |
	|         | --addons=yakd --driver=hyperkit                                                             |                      |         |         |                     |                     |
	|         |  --addons=ingress                                                                           |                      |         |         |                     |                     |
	|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |
	|         | --addons=helm-tiller                                                                        |                      |         |         |                     |                     |
	| ip      | addons-374000 ip                                                                            | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:42 PST | 04 Mar 24 17:42 PST |
	| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:42 PST | 04 Mar 24 17:42 PST |
	|         | registry --alsologtostderr                                                                  |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| addons  | disable nvidia-device-plugin                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:42 PST | 04 Mar 24 17:42 PST |
	|         | -p addons-374000                                                                            |                      |         |         |                     |                     |
	| ssh     | addons-374000 ssh cat                                                                       | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
	|         | /opt/local-path-provisioner/pvc-1f4f5c07-5fb5-451b-9005-c81ae1cd9500_default_test-pvc/file1 |                      |         |         |                     |                     |
	| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
	|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | addons-374000 addons                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
	|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | addons-374000 addons                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
	|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | disable cloud-spanner -p                                                                    | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
	|         | addons-374000                                                                               |                      |         |         |                     |                     |
	| addons  | enable headlamp                                                                             | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
	|         | -p addons-374000                                                                            |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | addons-374000 addons                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
	|         | disable metrics-server                                                                      |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p                                                                 | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
	|         | addons-374000                                                                               |                      |         |         |                     |                     |
	| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
	|         | helm-tiller --alsologtostderr                                                               |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| ssh     | addons-374000 ssh curl -s                                                                   | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
	|         | http://127.0.0.1/ -H 'Host:                                                                 |                      |         |         |                     |                     |
	|         | nginx.example.com'                                                                          |                      |         |         |                     |                     |
	| ip      | addons-374000 ip                                                                            | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
	| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
	|         | ingress-dns --alsologtostderr                                                               |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
	|         | ingress --alsologtostderr -v=1                                                              |                      |         |         |                     |                     |
	| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
	|         | gcp-auth --alsologtostderr                                                                  |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| stop    | -p addons-374000                                                                            | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
	| addons  | enable dashboard -p                                                                         | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
	|         | addons-374000                                                                               |                      |         |         |                     |                     |
	| addons  | disable dashboard -p                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
	|         | addons-374000                                                                               |                      |         |         |                     |                     |
	| addons  | disable gvisor -p                                                                           | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
	|         | addons-374000                                                                               |                      |         |         |                     |                     |
	| delete  | -p addons-374000                                                                            | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
	| start   | -p nospam-720000 -n=1 --memory=2250 --wait=false                                            | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
	|         | --log_dir=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                    |                      |         |         |                     |                     |
	|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
	| start   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
	|         | start --dry-run                                                                             |                      |         |         |                     |                     |
	| start   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
	|         | start --dry-run                                                                             |                      |         |         |                     |                     |
	| start   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
	|         | start --dry-run                                                                             |                      |         |         |                     |                     |
	| pause   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
	|         | pause                                                                                       |                      |         |         |                     |                     |
	| pause   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
	|         | pause                                                                                       |                      |         |         |                     |                     |
	| pause   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
	|         | pause                                                                                       |                      |         |         |                     |                     |
	| unpause | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
	|         | unpause                                                                                     |                      |         |         |                     |                     |
	| unpause | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
	|         | unpause                                                                                     |                      |         |         |                     |                     |
	| unpause | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
	|         | unpause                                                                                     |                      |         |         |                     |                     |
	| stop    | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
	|         | stop                                                                                        |                      |         |         |                     |                     |
	| stop    | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
	|         | stop                                                                                        |                      |         |         |                     |                     |
	| stop    | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
	|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
	|         | stop                                                                                        |                      |         |         |                     |                     |
	| delete  | -p nospam-720000                                                                            | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
	| start   | -p functional-160000                                                                        | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
	|         | --memory=4000                                                                               |                      |         |         |                     |                     |
	|         | --apiserver-port=8441                                                                       |                      |         |         |                     |                     |
	|         | --wait=all --driver=hyperkit                                                                |                      |         |         |                     |                     |
	| start   | -p functional-160000                                                                        | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
	|         | --alsologtostderr -v=8                                                                      |                      |         |         |                     |                     |
	| cache   | functional-160000 cache add                                                                 | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
	|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
	| cache   | functional-160000 cache add                                                                 | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
	|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
	| cache   | functional-160000 cache add                                                                 | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| cache   | functional-160000 cache add                                                                 | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
	|         | minikube-local-cache-test:functional-160000                                                 |                      |         |         |                     |                     |
	| cache   | functional-160000 cache delete                                                              | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
	|         | minikube-local-cache-test:functional-160000                                                 |                      |         |         |                     |                     |
	| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
	|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
	| cache   | list                                                                                        | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
	| ssh     | functional-160000 ssh sudo                                                                  | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
	|         | crictl images                                                                               |                      |         |         |                     |                     |
	| ssh     | functional-160000                                                                           | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
	|         | ssh sudo docker rmi                                                                         |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| ssh     | functional-160000 ssh                                                                       | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
	|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| cache   | functional-160000 cache reload                                                              | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
	| ssh     | functional-160000 ssh                                                                       | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
	|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
	|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
	| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| kubectl | functional-160000 kubectl --                                                                | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
	|         | --context functional-160000                                                                 |                      |         |         |                     |                     |
	|         | get pods                                                                                    |                      |         |         |                     |                     |
	| start   | -p functional-160000                                                                        | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
	|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision                    |                      |         |         |                     |                     |
	|         | --wait=all                                                                                  |                      |         |         |                     |                     |
	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/04 17:45:30
	Running on machine: MacOS-Agent-2
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0304 17:45:30.713844   94321 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:45:30.714600   94321 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:45:30.714623   94321 out.go:304] Setting ErrFile to fd 2...
	I0304 17:45:30.714628   94321 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:45:30.715113   94321 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:45:30.716530   94321 out.go:298] Setting JSON to false
	I0304 17:45:30.739012   94321 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24299,"bootTime":1709578831,"procs":493,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:45:30.739100   94321 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:45:30.761653   94321 out.go:177] * [functional-160000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:45:30.803398   94321 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:45:30.803494   94321 notify.go:220] Checking for updates...
	I0304 17:45:30.848510   94321 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:45:30.871230   94321 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:45:30.892547   94321 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:45:30.913665   94321 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:45:30.934597   94321 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:45:30.956416   94321 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:45:30.956582   94321 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:45:30.957262   94321 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:45:30.957343   94321 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:45:30.966274   94321 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63321
	I0304 17:45:30.966645   94321 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:45:30.967091   94321 main.go:141] libmachine: Using API Version  1
	I0304 17:45:30.967107   94321 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:45:30.967317   94321 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:45:30.967428   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
	I0304 17:45:30.996340   94321 out.go:177] * Using the hyperkit driver based on existing profile
	I0304 17:45:31.038569   94321 start.go:297] selected driver: hyperkit
	I0304 17:45:31.038584   94321 start.go:901] validating driver "hyperkit" against &{Name:functional-160000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-160000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:45:31.038757   94321 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:45:31.038952   94321 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:45:31.039129   94321 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:45:31.048333   94321 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:45:31.052322   94321 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:45:31.052338   94321 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0304 17:45:31.055132   94321 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 17:45:31.055201   94321 cni.go:84] Creating CNI manager for ""
	I0304 17:45:31.055216   94321 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 17:45:31.055296   94321 start.go:340] cluster config:
	{Name:functional-160000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-160000 Namespace:default APISe
rverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:45:31.055398   94321 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:45:31.097535   94321 out.go:177] * Starting "functional-160000" primary control-plane node in "functional-160000" cluster
	I0304 17:45:31.118711   94321 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:45:31.118799   94321 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:45:31.118820   94321 cache.go:56] Caching tarball of preloaded images
	I0304 17:45:31.118953   94321 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:45:31.118963   94321 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 17:45:31.119062   94321 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/functional-160000/config.json ...
	I0304 17:45:31.119808   94321 start.go:360] acquireMachinesLock for functional-160000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:45:31.119886   94321 start.go:364] duration metric: took 67.005µs to acquireMachinesLock for "functional-160000"
	I0304 17:45:31.119903   94321 start.go:96] Skipping create...Using existing machine configuration
	I0304 17:45:31.119911   94321 fix.go:54] fixHost starting: 
	I0304 17:45:31.120137   94321 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:45:31.120156   94321 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:45:31.128301   94321 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63323
	I0304 17:45:31.128690   94321 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:45:31.129097   94321 main.go:141] libmachine: Using API Version  1
	I0304 17:45:31.129119   94321 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:45:31.129317   94321 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:45:31.129430   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
	I0304 17:45:31.129528   94321 main.go:141] libmachine: (functional-160000) Calling .GetState
	I0304 17:45:31.129613   94321 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:45:31.129628   94321 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
	I0304 17:45:31.129656   94321 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
	I0304 17:45:31.129681   94321 fix.go:112] recreateIfNeeded on functional-160000: state=Stopped err=<nil>
	I0304 17:45:31.129702   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
	W0304 17:45:31.129797   94321 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 17:45:31.171479   94321 out.go:177] * Restarting existing hyperkit VM for "functional-160000" ...
	I0304 17:45:31.192581   94321 main.go:141] libmachine: (functional-160000) Calling .Start
	I0304 17:45:31.192844   94321 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:45:31.192963   94321 main.go:141] libmachine: (functional-160000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.pid
	I0304 17:45:31.192995   94321 main.go:141] libmachine: (functional-160000) DBG | Using UUID b2d2d55d-c548-450d-bbf4-d0bbdc04ff2c
	I0304 17:45:31.233428   94321 main.go:141] libmachine: (functional-160000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:45:31.233539   94321 fix.go:56] duration metric: took 113.626963ms for fixHost
	I0304 17:45:31.233546   94321 start.go:83] releasing machines lock for "functional-160000", held for 113.65469ms
	W0304 17:45:31.233560   94321 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0304 17:45:31.233615   94321 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:45:31.233623   94321 start.go:728] Will try again in 5 seconds ...
	I0304 17:45:36.234158   94321 start.go:360] acquireMachinesLock for functional-160000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:45:36.234296   94321 start.go:364] duration metric: took 121.245µs to acquireMachinesLock for "functional-160000"
	I0304 17:45:36.234338   94321 start.go:96] Skipping create...Using existing machine configuration
	I0304 17:45:36.234341   94321 fix.go:54] fixHost starting: 
	I0304 17:45:36.234672   94321 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:45:36.234701   94321 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:45:36.243355   94321 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63325
	I0304 17:45:36.243713   94321 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:45:36.244070   94321 main.go:141] libmachine: Using API Version  1
	I0304 17:45:36.244085   94321 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:45:36.244290   94321 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:45:36.244384   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
	I0304 17:45:36.244486   94321 main.go:141] libmachine: (functional-160000) Calling .GetState
	I0304 17:45:36.244567   94321 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:45:36.244586   94321 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
	I0304 17:45:36.244590   94321 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
	I0304 17:45:36.244647   94321 fix.go:112] recreateIfNeeded on functional-160000: state=Stopped err=<nil>
	I0304 17:45:36.244667   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
	W0304 17:45:36.244758   94321 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 17:45:36.266334   94321 out.go:177] * Restarting existing hyperkit VM for "functional-160000" ...
	I0304 17:45:36.309119   94321 main.go:141] libmachine: (functional-160000) Calling .Start
	I0304 17:45:36.309390   94321 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:45:36.309443   94321 main.go:141] libmachine: (functional-160000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.pid
	I0304 17:45:36.309521   94321 main.go:141] libmachine: (functional-160000) DBG | Using UUID b2d2d55d-c548-450d-bbf4-d0bbdc04ff2c
	I0304 17:45:36.311714   94321 main.go:141] libmachine: (functional-160000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:45:36.311805   94321 fix.go:56] duration metric: took 77.4619ms for fixHost
	I0304 17:45:36.311811   94321 start.go:83] releasing machines lock for "functional-160000", held for 77.507616ms
	W0304 17:45:36.311874   94321 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-160000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:45:36.354059   94321 out.go:177] 
	W0304 17:45:36.374998   94321 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:45:36.375066   94321 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:45:36.375075   94321 out.go:239] * Related issues:
	W0304 17:45:36.375099   94321 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:45:36.375362   94321 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:45:36.438010   94321 out.go:177] 
	
	
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1234: out/minikube-darwin-amd64 -p functional-160000 logs failed: exit status 83
functional_test.go:1224: expected minikube logs to include word: -"Linux"- but got 
***
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| delete  | -p download-only-626000                                                                     | download-only-626000 | jenkins | v1.32.0 | 04 Mar 24 17:38 PST | 04 Mar 24 17:38 PST |
| start   | --download-only -p                                                                          | binary-mirror-221000 | jenkins | v1.32.0 | 04 Mar 24 17:38 PST |                     |
|         | binary-mirror-221000                                                                        |                      |         |         |                     |                     |
|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |
|         | --binary-mirror                                                                             |                      |         |         |                     |                     |
|         | http://127.0.0.1:62827                                                                      |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| delete  | -p binary-mirror-221000                                                                     | binary-mirror-221000 | jenkins | v1.32.0 | 04 Mar 24 17:38 PST | 04 Mar 24 17:38 PST |
| addons  | enable dashboard -p                                                                         | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:38 PST |                     |
|         | addons-374000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:38 PST |                     |
|         | addons-374000                                                                               |                      |         |         |                     |                     |
| start   | -p addons-374000 --wait=true                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:38 PST | 04 Mar 24 17:42 PST |
|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |
|         | --addons=registry                                                                           |                      |         |         |                     |                     |
|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |
|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |
|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |
|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |
|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |
|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |
|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |
|         | --addons=nvidia-device-plugin                                                               |                      |         |         |                     |                     |
|         | --addons=yakd --driver=hyperkit                                                             |                      |         |         |                     |                     |
|         |  --addons=ingress                                                                           |                      |         |         |                     |                     |
|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |
|         | --addons=helm-tiller                                                                        |                      |         |         |                     |                     |
| ip      | addons-374000 ip                                                                            | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:42 PST | 04 Mar 24 17:42 PST |
| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:42 PST | 04 Mar 24 17:42 PST |
|         | registry --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | disable nvidia-device-plugin                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:42 PST | 04 Mar 24 17:42 PST |
|         | -p addons-374000                                                                            |                      |         |         |                     |                     |
| ssh     | addons-374000 ssh cat                                                                       | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | /opt/local-path-provisioner/pvc-1f4f5c07-5fb5-451b-9005-c81ae1cd9500_default_test-pvc/file1 |                      |         |         |                     |                     |
| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | addons-374000 addons                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | addons-374000 addons                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable cloud-spanner -p                                                                    | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | addons-374000                                                                               |                      |         |         |                     |                     |
| addons  | enable headlamp                                                                             | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | -p addons-374000                                                                            |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | addons-374000 addons                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | disable metrics-server                                                                      |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable inspektor-gadget -p                                                                 | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | addons-374000                                                                               |                      |         |         |                     |                     |
| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | helm-tiller --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| ssh     | addons-374000 ssh curl -s                                                                   | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | http://127.0.0.1/ -H 'Host:                                                                 |                      |         |         |                     |                     |
|         | nginx.example.com'                                                                          |                      |         |         |                     |                     |
| ip      | addons-374000 ip                                                                            | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | ingress-dns --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | ingress --alsologtostderr -v=1                                                              |                      |         |         |                     |                     |
| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | gcp-auth --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| stop    | -p addons-374000                                                                            | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
| addons  | enable dashboard -p                                                                         | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | addons-374000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | addons-374000                                                                               |                      |         |         |                     |                     |
| addons  | disable gvisor -p                                                                           | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | addons-374000                                                                               |                      |         |         |                     |                     |
| delete  | -p addons-374000                                                                            | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
| start   | -p nospam-720000 -n=1 --memory=2250 --wait=false                                            | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | --log_dir=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                    |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| start   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| pause   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| unpause | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| stop    | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| delete  | -p nospam-720000                                                                            | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
| start   | -p functional-160000                                                                        | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | --memory=4000                                                                               |                      |         |         |                     |                     |
|         | --apiserver-port=8441                                                                       |                      |         |         |                     |                     |
|         | --wait=all --driver=hyperkit                                                                |                      |         |         |                     |                     |
| start   | -p functional-160000                                                                        | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | --alsologtostderr -v=8                                                                      |                      |         |         |                     |                     |
| cache   | functional-160000 cache add                                                                 | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | functional-160000 cache add                                                                 | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | functional-160000 cache add                                                                 | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-160000 cache add                                                                 | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | minikube-local-cache-test:functional-160000                                                 |                      |         |         |                     |                     |
| cache   | functional-160000 cache delete                                                              | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | minikube-local-cache-test:functional-160000                                                 |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | list                                                                                        | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
| ssh     | functional-160000 ssh sudo                                                                  | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | crictl images                                                                               |                      |         |         |                     |                     |
| ssh     | functional-160000                                                                           | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | ssh sudo docker rmi                                                                         |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| ssh     | functional-160000 ssh                                                                       | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-160000 cache reload                                                              | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
| ssh     | functional-160000 ssh                                                                       | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| kubectl | functional-160000 kubectl --                                                                | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | --context functional-160000                                                                 |                      |         |         |                     |                     |
|         | get pods                                                                                    |                      |         |         |                     |                     |
| start   | -p functional-160000                                                                        | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision                    |                      |         |         |                     |                     |
|         | --wait=all                                                                                  |                      |         |         |                     |                     |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

                                                
                                                

                                                
                                                
==> Last Start <==
Log file created at: 2024/03/04 17:45:30
Running on machine: MacOS-Agent-2
Binary: Built with gc go1.22.0 for darwin/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0304 17:45:30.713844   94321 out.go:291] Setting OutFile to fd 1 ...
I0304 17:45:30.714600   94321 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:45:30.714623   94321 out.go:304] Setting ErrFile to fd 2...
I0304 17:45:30.714628   94321 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:45:30.715113   94321 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
I0304 17:45:30.716530   94321 out.go:298] Setting JSON to false
I0304 17:45:30.739012   94321 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24299,"bootTime":1709578831,"procs":493,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
W0304 17:45:30.739100   94321 start.go:137] gopshost.Virtualization returned error: not implemented yet
I0304 17:45:30.761653   94321 out.go:177] * [functional-160000] minikube v1.32.0 on Darwin 14.3.1
I0304 17:45:30.803398   94321 out.go:177]   - MINIKUBE_LOCATION=17909
I0304 17:45:30.803494   94321 notify.go:220] Checking for updates...
I0304 17:45:30.848510   94321 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
I0304 17:45:30.871230   94321 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
I0304 17:45:30.892547   94321 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0304 17:45:30.913665   94321 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
I0304 17:45:30.934597   94321 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
I0304 17:45:30.956416   94321 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:45:30.956582   94321 driver.go:392] Setting default libvirt URI to qemu:///system
I0304 17:45:30.957262   94321 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:45:30.957343   94321 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0304 17:45:30.966274   94321 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63321
I0304 17:45:30.966645   94321 main.go:141] libmachine: () Calling .GetVersion
I0304 17:45:30.967091   94321 main.go:141] libmachine: Using API Version  1
I0304 17:45:30.967107   94321 main.go:141] libmachine: () Calling .SetConfigRaw
I0304 17:45:30.967317   94321 main.go:141] libmachine: () Calling .GetMachineName
I0304 17:45:30.967428   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
I0304 17:45:30.996340   94321 out.go:177] * Using the hyperkit driver based on existing profile
I0304 17:45:31.038569   94321 start.go:297] selected driver: hyperkit
I0304 17:45:31.038584   94321 start.go:901] validating driver "hyperkit" against &{Name:functional-160000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:functional-160000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0304 17:45:31.038757   94321 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0304 17:45:31.038952   94321 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0304 17:45:31.039129   94321 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I0304 17:45:31.048333   94321 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
I0304 17:45:31.052322   94321 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:45:31.052338   94321 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I0304 17:45:31.055132   94321 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0304 17:45:31.055201   94321 cni.go:84] Creating CNI manager for ""
I0304 17:45:31.055216   94321 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0304 17:45:31.055296   94321 start.go:340] cluster config:
{Name:functional-160000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-160000 Namespace:default APISer
verHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPor
t:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0304 17:45:31.055398   94321 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0304 17:45:31.097535   94321 out.go:177] * Starting "functional-160000" primary control-plane node in "functional-160000" cluster
I0304 17:45:31.118711   94321 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
I0304 17:45:31.118799   94321 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
I0304 17:45:31.118820   94321 cache.go:56] Caching tarball of preloaded images
I0304 17:45:31.118953   94321 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0304 17:45:31.118963   94321 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
I0304 17:45:31.119062   94321 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/functional-160000/config.json ...
I0304 17:45:31.119808   94321 start.go:360] acquireMachinesLock for functional-160000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0304 17:45:31.119886   94321 start.go:364] duration metric: took 67.005µs to acquireMachinesLock for "functional-160000"
I0304 17:45:31.119903   94321 start.go:96] Skipping create...Using existing machine configuration
I0304 17:45:31.119911   94321 fix.go:54] fixHost starting: 
I0304 17:45:31.120137   94321 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:45:31.120156   94321 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0304 17:45:31.128301   94321 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63323
I0304 17:45:31.128690   94321 main.go:141] libmachine: () Calling .GetVersion
I0304 17:45:31.129097   94321 main.go:141] libmachine: Using API Version  1
I0304 17:45:31.129119   94321 main.go:141] libmachine: () Calling .SetConfigRaw
I0304 17:45:31.129317   94321 main.go:141] libmachine: () Calling .GetMachineName
I0304 17:45:31.129430   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
I0304 17:45:31.129528   94321 main.go:141] libmachine: (functional-160000) Calling .GetState
I0304 17:45:31.129613   94321 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:45:31.129628   94321 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
I0304 17:45:31.129656   94321 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
I0304 17:45:31.129681   94321 fix.go:112] recreateIfNeeded on functional-160000: state=Stopped err=<nil>
I0304 17:45:31.129702   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
W0304 17:45:31.129797   94321 fix.go:138] unexpected machine state, will restart: <nil>
I0304 17:45:31.171479   94321 out.go:177] * Restarting existing hyperkit VM for "functional-160000" ...
I0304 17:45:31.192581   94321 main.go:141] libmachine: (functional-160000) Calling .Start
I0304 17:45:31.192844   94321 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:45:31.192963   94321 main.go:141] libmachine: (functional-160000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.pid
I0304 17:45:31.192995   94321 main.go:141] libmachine: (functional-160000) DBG | Using UUID b2d2d55d-c548-450d-bbf4-d0bbdc04ff2c
I0304 17:45:31.233428   94321 main.go:141] libmachine: (functional-160000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0304 17:45:31.233539   94321 fix.go:56] duration metric: took 113.626963ms for fixHost
I0304 17:45:31.233546   94321 start.go:83] releasing machines lock for "functional-160000", held for 113.65469ms
W0304 17:45:31.233560   94321 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
W0304 17:45:31.233615   94321 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0304 17:45:31.233623   94321 start.go:728] Will try again in 5 seconds ...
I0304 17:45:36.234158   94321 start.go:360] acquireMachinesLock for functional-160000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0304 17:45:36.234296   94321 start.go:364] duration metric: took 121.245µs to acquireMachinesLock for "functional-160000"
I0304 17:45:36.234338   94321 start.go:96] Skipping create...Using existing machine configuration
I0304 17:45:36.234341   94321 fix.go:54] fixHost starting: 
I0304 17:45:36.234672   94321 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:45:36.234701   94321 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0304 17:45:36.243355   94321 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63325
I0304 17:45:36.243713   94321 main.go:141] libmachine: () Calling .GetVersion
I0304 17:45:36.244070   94321 main.go:141] libmachine: Using API Version  1
I0304 17:45:36.244085   94321 main.go:141] libmachine: () Calling .SetConfigRaw
I0304 17:45:36.244290   94321 main.go:141] libmachine: () Calling .GetMachineName
I0304 17:45:36.244384   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
I0304 17:45:36.244486   94321 main.go:141] libmachine: (functional-160000) Calling .GetState
I0304 17:45:36.244567   94321 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:45:36.244586   94321 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
I0304 17:45:36.244590   94321 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
I0304 17:45:36.244647   94321 fix.go:112] recreateIfNeeded on functional-160000: state=Stopped err=<nil>
I0304 17:45:36.244667   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
W0304 17:45:36.244758   94321 fix.go:138] unexpected machine state, will restart: <nil>
I0304 17:45:36.266334   94321 out.go:177] * Restarting existing hyperkit VM for "functional-160000" ...
I0304 17:45:36.309119   94321 main.go:141] libmachine: (functional-160000) Calling .Start
I0304 17:45:36.309390   94321 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:45:36.309443   94321 main.go:141] libmachine: (functional-160000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.pid
I0304 17:45:36.309521   94321 main.go:141] libmachine: (functional-160000) DBG | Using UUID b2d2d55d-c548-450d-bbf4-d0bbdc04ff2c
I0304 17:45:36.311714   94321 main.go:141] libmachine: (functional-160000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0304 17:45:36.311805   94321 fix.go:56] duration metric: took 77.4619ms for fixHost
I0304 17:45:36.311811   94321 start.go:83] releasing machines lock for "functional-160000", held for 77.507616ms
W0304 17:45:36.311874   94321 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-160000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0304 17:45:36.354059   94321 out.go:177] 
W0304 17:45:36.374998   94321 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
W0304 17:45:36.375066   94321 out.go:239] * Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
W0304 17:45:36.375075   94321 out.go:239] * Related issues:
W0304 17:45:36.375099   94321 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
W0304 17:45:36.375362   94321 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
I0304 17:45:36.438010   94321 out.go:177] 

                                                
                                                

                                                
                                                
* The control-plane node functional-160000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-160000"
***
--- FAIL: TestFunctional/serial/LogsCmd (0.32s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (0.28s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 logs --file /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalserialLogsFileCmd2491401696/001/logs.txt
functional_test.go:1224: expected minikube logs to include word: -"Linux"- but got 
***
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| delete  | -p download-only-626000                                                                     | download-only-626000 | jenkins | v1.32.0 | 04 Mar 24 17:38 PST | 04 Mar 24 17:38 PST |
| start   | --download-only -p                                                                          | binary-mirror-221000 | jenkins | v1.32.0 | 04 Mar 24 17:38 PST |                     |
|         | binary-mirror-221000                                                                        |                      |         |         |                     |                     |
|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |
|         | --binary-mirror                                                                             |                      |         |         |                     |                     |
|         | http://127.0.0.1:62827                                                                      |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| delete  | -p binary-mirror-221000                                                                     | binary-mirror-221000 | jenkins | v1.32.0 | 04 Mar 24 17:38 PST | 04 Mar 24 17:38 PST |
| addons  | enable dashboard -p                                                                         | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:38 PST |                     |
|         | addons-374000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:38 PST |                     |
|         | addons-374000                                                                               |                      |         |         |                     |                     |
| start   | -p addons-374000 --wait=true                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:38 PST | 04 Mar 24 17:42 PST |
|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |
|         | --addons=registry                                                                           |                      |         |         |                     |                     |
|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |
|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |
|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |
|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |
|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |
|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |
|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |
|         | --addons=nvidia-device-plugin                                                               |                      |         |         |                     |                     |
|         | --addons=yakd --driver=hyperkit                                                             |                      |         |         |                     |                     |
|         |  --addons=ingress                                                                           |                      |         |         |                     |                     |
|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |
|         | --addons=helm-tiller                                                                        |                      |         |         |                     |                     |
| ip      | addons-374000 ip                                                                            | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:42 PST | 04 Mar 24 17:42 PST |
| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:42 PST | 04 Mar 24 17:42 PST |
|         | registry --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | disable nvidia-device-plugin                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:42 PST | 04 Mar 24 17:42 PST |
|         | -p addons-374000                                                                            |                      |         |         |                     |                     |
| ssh     | addons-374000 ssh cat                                                                       | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | /opt/local-path-provisioner/pvc-1f4f5c07-5fb5-451b-9005-c81ae1cd9500_default_test-pvc/file1 |                      |         |         |                     |                     |
| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | addons-374000 addons                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | addons-374000 addons                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable cloud-spanner -p                                                                    | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | addons-374000                                                                               |                      |         |         |                     |                     |
| addons  | enable headlamp                                                                             | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | -p addons-374000                                                                            |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | addons-374000 addons                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | disable metrics-server                                                                      |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable inspektor-gadget -p                                                                 | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | addons-374000                                                                               |                      |         |         |                     |                     |
| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:43 PST | 04 Mar 24 17:43 PST |
|         | helm-tiller --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| ssh     | addons-374000 ssh curl -s                                                                   | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | http://127.0.0.1/ -H 'Host:                                                                 |                      |         |         |                     |                     |
|         | nginx.example.com'                                                                          |                      |         |         |                     |                     |
| ip      | addons-374000 ip                                                                            | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | ingress-dns --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | ingress --alsologtostderr -v=1                                                              |                      |         |         |                     |                     |
| addons  | addons-374000 addons disable                                                                | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | gcp-auth --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| stop    | -p addons-374000                                                                            | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
| addons  | enable dashboard -p                                                                         | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | addons-374000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | addons-374000                                                                               |                      |         |         |                     |                     |
| addons  | disable gvisor -p                                                                           | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | addons-374000                                                                               |                      |         |         |                     |                     |
| delete  | -p addons-374000                                                                            | addons-374000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
| start   | -p nospam-720000 -n=1 --memory=2250 --wait=false                                            | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | --log_dir=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                    |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| start   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| pause   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| unpause | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST |                     |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| stop    | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:44 PST | 04 Mar 24 17:44 PST |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-720000 --log_dir                                                                     | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| delete  | -p nospam-720000                                                                            | nospam-720000        | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
| start   | -p functional-160000                                                                        | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | --memory=4000                                                                               |                      |         |         |                     |                     |
|         | --apiserver-port=8441                                                                       |                      |         |         |                     |                     |
|         | --wait=all --driver=hyperkit                                                                |                      |         |         |                     |                     |
| start   | -p functional-160000                                                                        | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | --alsologtostderr -v=8                                                                      |                      |         |         |                     |                     |
| cache   | functional-160000 cache add                                                                 | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | functional-160000 cache add                                                                 | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | functional-160000 cache add                                                                 | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-160000 cache add                                                                 | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | minikube-local-cache-test:functional-160000                                                 |                      |         |         |                     |                     |
| cache   | functional-160000 cache delete                                                              | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | minikube-local-cache-test:functional-160000                                                 |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | list                                                                                        | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
| ssh     | functional-160000 ssh sudo                                                                  | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | crictl images                                                                               |                      |         |         |                     |                     |
| ssh     | functional-160000                                                                           | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | ssh sudo docker rmi                                                                         |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| ssh     | functional-160000 ssh                                                                       | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-160000 cache reload                                                              | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
| ssh     | functional-160000 ssh                                                                       | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:45 PST | 04 Mar 24 17:45 PST |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| kubectl | functional-160000 kubectl --                                                                | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | --context functional-160000                                                                 |                      |         |         |                     |                     |
|         | get pods                                                                                    |                      |         |         |                     |                     |
| start   | -p functional-160000                                                                        | functional-160000    | jenkins | v1.32.0 | 04 Mar 24 17:45 PST |                     |
|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision                    |                      |         |         |                     |                     |
|         | --wait=all                                                                                  |                      |         |         |                     |                     |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

                                                
                                                

                                                
                                                
==> Last Start <==
Log file created at: 2024/03/04 17:45:30
Running on machine: MacOS-Agent-2
Binary: Built with gc go1.22.0 for darwin/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0304 17:45:30.713844   94321 out.go:291] Setting OutFile to fd 1 ...
I0304 17:45:30.714600   94321 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:45:30.714623   94321 out.go:304] Setting ErrFile to fd 2...
I0304 17:45:30.714628   94321 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:45:30.715113   94321 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
I0304 17:45:30.716530   94321 out.go:298] Setting JSON to false
I0304 17:45:30.739012   94321 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24299,"bootTime":1709578831,"procs":493,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
W0304 17:45:30.739100   94321 start.go:137] gopshost.Virtualization returned error: not implemented yet
I0304 17:45:30.761653   94321 out.go:177] * [functional-160000] minikube v1.32.0 on Darwin 14.3.1
I0304 17:45:30.803398   94321 out.go:177]   - MINIKUBE_LOCATION=17909
I0304 17:45:30.803494   94321 notify.go:220] Checking for updates...
I0304 17:45:30.848510   94321 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
I0304 17:45:30.871230   94321 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
I0304 17:45:30.892547   94321 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0304 17:45:30.913665   94321 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
I0304 17:45:30.934597   94321 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
I0304 17:45:30.956416   94321 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:45:30.956582   94321 driver.go:392] Setting default libvirt URI to qemu:///system
I0304 17:45:30.957262   94321 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:45:30.957343   94321 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0304 17:45:30.966274   94321 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63321
I0304 17:45:30.966645   94321 main.go:141] libmachine: () Calling .GetVersion
I0304 17:45:30.967091   94321 main.go:141] libmachine: Using API Version  1
I0304 17:45:30.967107   94321 main.go:141] libmachine: () Calling .SetConfigRaw
I0304 17:45:30.967317   94321 main.go:141] libmachine: () Calling .GetMachineName
I0304 17:45:30.967428   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
I0304 17:45:30.996340   94321 out.go:177] * Using the hyperkit driver based on existing profile
I0304 17:45:31.038569   94321 start.go:297] selected driver: hyperkit
I0304 17:45:31.038584   94321 start.go:901] validating driver "hyperkit" against &{Name:functional-160000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:functional-160000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0304 17:45:31.038757   94321 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0304 17:45:31.038952   94321 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0304 17:45:31.039129   94321 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I0304 17:45:31.048333   94321 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
I0304 17:45:31.052322   94321 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:45:31.052338   94321 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I0304 17:45:31.055132   94321 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0304 17:45:31.055201   94321 cni.go:84] Creating CNI manager for ""
I0304 17:45:31.055216   94321 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0304 17:45:31.055296   94321 start.go:340] cluster config:
{Name:functional-160000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-160000 Namespace:default APISer
verHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPor
t:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0304 17:45:31.055398   94321 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0304 17:45:31.097535   94321 out.go:177] * Starting "functional-160000" primary control-plane node in "functional-160000" cluster
I0304 17:45:31.118711   94321 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
I0304 17:45:31.118799   94321 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
I0304 17:45:31.118820   94321 cache.go:56] Caching tarball of preloaded images
I0304 17:45:31.118953   94321 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0304 17:45:31.118963   94321 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
I0304 17:45:31.119062   94321 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/functional-160000/config.json ...
I0304 17:45:31.119808   94321 start.go:360] acquireMachinesLock for functional-160000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0304 17:45:31.119886   94321 start.go:364] duration metric: took 67.005µs to acquireMachinesLock for "functional-160000"
I0304 17:45:31.119903   94321 start.go:96] Skipping create...Using existing machine configuration
I0304 17:45:31.119911   94321 fix.go:54] fixHost starting: 
I0304 17:45:31.120137   94321 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:45:31.120156   94321 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0304 17:45:31.128301   94321 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63323
I0304 17:45:31.128690   94321 main.go:141] libmachine: () Calling .GetVersion
I0304 17:45:31.129097   94321 main.go:141] libmachine: Using API Version  1
I0304 17:45:31.129119   94321 main.go:141] libmachine: () Calling .SetConfigRaw
I0304 17:45:31.129317   94321 main.go:141] libmachine: () Calling .GetMachineName
I0304 17:45:31.129430   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
I0304 17:45:31.129528   94321 main.go:141] libmachine: (functional-160000) Calling .GetState
I0304 17:45:31.129613   94321 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:45:31.129628   94321 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
I0304 17:45:31.129656   94321 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
I0304 17:45:31.129681   94321 fix.go:112] recreateIfNeeded on functional-160000: state=Stopped err=<nil>
I0304 17:45:31.129702   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
W0304 17:45:31.129797   94321 fix.go:138] unexpected machine state, will restart: <nil>
I0304 17:45:31.171479   94321 out.go:177] * Restarting existing hyperkit VM for "functional-160000" ...
I0304 17:45:31.192581   94321 main.go:141] libmachine: (functional-160000) Calling .Start
I0304 17:45:31.192844   94321 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:45:31.192963   94321 main.go:141] libmachine: (functional-160000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.pid
I0304 17:45:31.192995   94321 main.go:141] libmachine: (functional-160000) DBG | Using UUID b2d2d55d-c548-450d-bbf4-d0bbdc04ff2c
I0304 17:45:31.233428   94321 main.go:141] libmachine: (functional-160000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0304 17:45:31.233539   94321 fix.go:56] duration metric: took 113.626963ms for fixHost
I0304 17:45:31.233546   94321 start.go:83] releasing machines lock for "functional-160000", held for 113.65469ms
W0304 17:45:31.233560   94321 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
W0304 17:45:31.233615   94321 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0304 17:45:31.233623   94321 start.go:728] Will try again in 5 seconds ...
I0304 17:45:36.234158   94321 start.go:360] acquireMachinesLock for functional-160000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0304 17:45:36.234296   94321 start.go:364] duration metric: took 121.245µs to acquireMachinesLock for "functional-160000"
I0304 17:45:36.234338   94321 start.go:96] Skipping create...Using existing machine configuration
I0304 17:45:36.234341   94321 fix.go:54] fixHost starting: 
I0304 17:45:36.234672   94321 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:45:36.234701   94321 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0304 17:45:36.243355   94321 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63325
I0304 17:45:36.243713   94321 main.go:141] libmachine: () Calling .GetVersion
I0304 17:45:36.244070   94321 main.go:141] libmachine: Using API Version  1
I0304 17:45:36.244085   94321 main.go:141] libmachine: () Calling .SetConfigRaw
I0304 17:45:36.244290   94321 main.go:141] libmachine: () Calling .GetMachineName
I0304 17:45:36.244384   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
I0304 17:45:36.244486   94321 main.go:141] libmachine: (functional-160000) Calling .GetState
I0304 17:45:36.244567   94321 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:45:36.244586   94321 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
I0304 17:45:36.244590   94321 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
I0304 17:45:36.244647   94321 fix.go:112] recreateIfNeeded on functional-160000: state=Stopped err=<nil>
I0304 17:45:36.244667   94321 main.go:141] libmachine: (functional-160000) Calling .DriverName
W0304 17:45:36.244758   94321 fix.go:138] unexpected machine state, will restart: <nil>
I0304 17:45:36.266334   94321 out.go:177] * Restarting existing hyperkit VM for "functional-160000" ...
I0304 17:45:36.309119   94321 main.go:141] libmachine: (functional-160000) Calling .Start
I0304 17:45:36.309390   94321 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:45:36.309443   94321 main.go:141] libmachine: (functional-160000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.pid
I0304 17:45:36.309521   94321 main.go:141] libmachine: (functional-160000) DBG | Using UUID b2d2d55d-c548-450d-bbf4-d0bbdc04ff2c
I0304 17:45:36.311714   94321 main.go:141] libmachine: (functional-160000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0304 17:45:36.311805   94321 fix.go:56] duration metric: took 77.4619ms for fixHost
I0304 17:45:36.311811   94321 start.go:83] releasing machines lock for "functional-160000", held for 77.507616ms
W0304 17:45:36.311874   94321 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-160000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0304 17:45:36.354059   94321 out.go:177] 
W0304 17:45:36.374998   94321 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
W0304 17:45:36.375066   94321 out.go:239] * Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
W0304 17:45:36.375075   94321 out.go:239] * Related issues:
W0304 17:45:36.375099   94321 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
W0304 17:45:36.375362   94321 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
I0304 17:45:36.438010   94321 out.go:177] 

                                                
                                                

                                                
                                                
***
--- FAIL: TestFunctional/serial/LogsFileCmd (0.28s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-160000 apply -f testdata/invalidsvc.yaml
functional_test.go:2317: (dbg) Non-zero exit: kubectl --context functional-160000 apply -f testdata/invalidsvc.yaml: exit status 1 (36.802937ms)

                                                
                                                
** stderr ** 
	error: context "functional-160000" does not exist

                                                
                                                
** /stderr **
functional_test.go:2319: kubectl --context functional-160000 apply -f testdata/invalidsvc.yaml failed: exit status 1
--- FAIL: TestFunctional/serial/InvalidService (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (0.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-160000 --alsologtostderr -v=1]
functional_test.go:914: output didn't produce a URL
functional_test.go:906: (dbg) stopping [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-160000 --alsologtostderr -v=1] ...
functional_test.go:906: (dbg) [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-160000 --alsologtostderr -v=1] stdout:
functional_test.go:906: (dbg) [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-160000 --alsologtostderr -v=1] stderr:
I0304 17:46:26.163276   94774 out.go:291] Setting OutFile to fd 1 ...
I0304 17:46:26.164125   94774 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:46:26.164132   94774 out.go:304] Setting ErrFile to fd 2...
I0304 17:46:26.164136   94774 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:46:26.164316   94774 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
I0304 17:46:26.164640   94774 mustload.go:65] Loading cluster: functional-160000
I0304 17:46:26.164940   94774 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:46:26.165267   94774 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:46:26.165314   94774 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0304 17:46:26.173004   94774 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63554
I0304 17:46:26.173400   94774 main.go:141] libmachine: () Calling .GetVersion
I0304 17:46:26.173809   94774 main.go:141] libmachine: Using API Version  1
I0304 17:46:26.173840   94774 main.go:141] libmachine: () Calling .SetConfigRaw
I0304 17:46:26.174090   94774 main.go:141] libmachine: () Calling .GetMachineName
I0304 17:46:26.174194   94774 main.go:141] libmachine: (functional-160000) Calling .GetState
I0304 17:46:26.174289   94774 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:46:26.174306   94774 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
I0304 17:46:26.174321   94774 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
I0304 17:46:26.195690   94774 out.go:177] * The control-plane node functional-160000 host is not running: state=Stopped
I0304 17:46:26.216603   94774 out.go:177]   To start a cluster, run: "minikube start -p functional-160000"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (76.315752ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/DashboardCmd (0.33s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (0.3s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 status
functional_test.go:850: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 status: exit status 7 (75.199848ms)

                                                
                                                
-- stdout --
	functional-160000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
functional_test.go:852: failed to run minikube status. args "out/minikube-darwin-amd64 -p functional-160000 status" : exit status 7
functional_test.go:856: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:856: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}: exit status 7 (75.584471ms)

                                                
                                                
-- stdout --
	host:Stopped,kublet:Stopped,apiserver:Stopped,kubeconfig:Stopped

                                                
                                                
-- /stdout --
functional_test.go:858: failed to run minikube status with custom format: args "out/minikube-darwin-amd64 -p functional-160000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}": exit status 7
functional_test.go:868: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 status -o json
functional_test.go:868: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 status -o json: exit status 7 (75.067074ms)

                                                
                                                
-- stdout --
	{"Name":"functional-160000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
functional_test.go:870: failed to run minikube status with json output. args "out/minikube-darwin-amd64 -p functional-160000 status -o json" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (75.261512ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/StatusCmd (0.30s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1625: (dbg) Run:  kubectl --context functional-160000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8
functional_test.go:1625: (dbg) Non-zero exit: kubectl --context functional-160000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8: exit status 1 (37.036742ms)

                                                
                                                
** stderr ** 
	error: context "functional-160000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1629: failed to create hello-node deployment with this command "kubectl --context functional-160000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8": exit status 1.
functional_test.go:1594: service test failed - dumping debug information
functional_test.go:1595: -----------------------service failure post-mortem--------------------------------
functional_test.go:1598: (dbg) Run:  kubectl --context functional-160000 describe po hello-node-connect
functional_test.go:1598: (dbg) Non-zero exit: kubectl --context functional-160000 describe po hello-node-connect: exit status 1 (36.898828ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-160000

                                                
                                                
** /stderr **
functional_test.go:1600: "kubectl --context functional-160000 describe po hello-node-connect" failed: exit status 1
functional_test.go:1602: hello-node pod describe:
functional_test.go:1604: (dbg) Run:  kubectl --context functional-160000 logs -l app=hello-node-connect
functional_test.go:1604: (dbg) Non-zero exit: kubectl --context functional-160000 logs -l app=hello-node-connect: exit status 1 (36.331315ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-160000

                                                
                                                
** /stderr **
functional_test.go:1606: "kubectl --context functional-160000 logs -l app=hello-node-connect" failed: exit status 1
functional_test.go:1608: hello-node logs:
functional_test.go:1610: (dbg) Run:  kubectl --context functional-160000 describe svc hello-node-connect
functional_test.go:1610: (dbg) Non-zero exit: kubectl --context functional-160000 describe svc hello-node-connect: exit status 1 (36.464076ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-160000

                                                
                                                
** /stderr **
functional_test.go:1612: "kubectl --context functional-160000 describe svc hello-node-connect" failed: exit status 1
functional_test.go:1614: hello-node svc describe:
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (75.591807ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/ServiceCmdConnect (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (0.08s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:45: failed waiting for storage-provisioner: client config: context "functional-160000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (75.28007ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/PersistentVolumeClaim (0.08s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1721: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "echo hello"
functional_test.go:1721: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "echo hello": exit status 83 (137.876486ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1726: failed to run an ssh command. args "out/minikube-darwin-amd64 -p functional-160000 ssh \"echo hello\"" : exit status 83
functional_test.go:1730: expected minikube ssh command output to be -"hello"- but got *"* The control-plane node functional-160000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-160000\"\n"*. args "out/minikube-darwin-amd64 -p functional-160000 ssh \"echo hello\""
functional_test.go:1738: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "cat /etc/hostname"
functional_test.go:1738: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "cat /etc/hostname": exit status 83 (157.054564ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1744: failed to run an ssh command. args "out/minikube-darwin-amd64 -p functional-160000 ssh \"cat /etc/hostname\"" : exit status 83
functional_test.go:1748: expected minikube ssh command output to be -"functional-160000"- but got *"* The control-plane node functional-160000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-160000\"\n"*. args "out/minikube-darwin-amd64 -p functional-160000 ssh \"cat /etc/hostname\""
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (74.926117ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/SSHCmd (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (0.96s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 cp testdata/cp-test.txt /home/docker/cp-test.txt: exit status 83 (154.993685ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-160000 cp testdata/cp-test.txt /home/docker/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh -n functional-160000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh -n functional-160000 "sudo cat /home/docker/cp-test.txt": exit status 83 (153.370559ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-160000 ssh -n functional-160000 \"sudo cat /home/docker/cp-test.txt\"" : exit status 83
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
  strings.Join({
+ 	"* ",
  	"T",
- 	"est file for checking file cp process",
+ 	"he control-plane node functional-160000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-160000\"\n",
  }, "")
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 cp functional-160000:/home/docker/cp-test.txt /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelCpCmd4210350192/001/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 cp functional-160000:/home/docker/cp-test.txt /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelCpCmd4210350192/001/cp-test.txt: exit status 83 (159.293735ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-160000 cp functional-160000:/home/docker/cp-test.txt /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelCpCmd4210350192/001/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh -n functional-160000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh -n functional-160000 "sudo cat /home/docker/cp-test.txt": exit status 83 (174.796879ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-160000 ssh -n functional-160000 \"sudo cat /home/docker/cp-test.txt\"" : exit status 83
helpers_test.go:528: failed to read test file 'testdata/cp-test.txt' : open /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelCpCmd4210350192/001/cp-test.txt: no such file or directory
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
  string(
- 	"* The control-plane node functional-160000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-160000\"\n",
+ 	"",
  )
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt: exit status 83 (137.714241ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-160000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh -n functional-160000 "sudo cat /tmp/does/not/exist/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh -n functional-160000 "sudo cat /tmp/does/not/exist/cp-test.txt": exit status 83 (158.004159ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-160000 ssh -n functional-160000 \"sudo cat /tmp/does/not/exist/cp-test.txt\"" : exit status 83
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
  strings.Join({
+ 	"* ",
  	"T",
- 	"est file for checking file cp process",
+ 	"he control-plane node functional-160000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-160000\"\n",
  }, "")
--- FAIL: TestFunctional/parallel/CpCmd (0.96s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1789: (dbg) Run:  kubectl --context functional-160000 replace --force -f testdata/mysql.yaml
functional_test.go:1789: (dbg) Non-zero exit: kubectl --context functional-160000 replace --force -f testdata/mysql.yaml: exit status 1 (63.441071ms)

                                                
                                                
** stderr ** 
	error: context "functional-160000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1791: failed to kubectl replace mysql: args "kubectl --context functional-160000 replace --force -f testdata/mysql.yaml" failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (125.336822ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/MySQL (0.19s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/93377/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /etc/test/nested/copy/93377/hosts"
functional_test.go:1927: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /etc/test/nested/copy/93377/hosts": exit status 83 (189.360678ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1929: out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /etc/test/nested/copy/93377/hosts" failed: exit status 83
functional_test.go:1932: file sync test content: * The control-plane node functional-160000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-160000"
functional_test.go:1942: /etc/sync.test content mismatch (-want +got):
  strings.Join({
+ 	"* ",
  	"T",
- 	"est file for checking file sync process",
+ 	"he control-plane node functional-160000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-160000\"\n",
  }, "")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (141.799048ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/FileSync (0.33s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (1.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/93377.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /etc/ssl/certs/93377.pem"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /etc/ssl/certs/93377.pem": exit status 83 (167.518109ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/etc/ssl/certs/93377.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-160000 ssh \"sudo cat /etc/ssl/certs/93377.pem\"": exit status 83
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /etc/ssl/certs/93377.pem mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-160000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-160000"
  	"""
  )
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/93377.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /usr/share/ca-certificates/93377.pem"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /usr/share/ca-certificates/93377.pem": exit status 83 (210.766615ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/usr/share/ca-certificates/93377.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-160000 ssh \"sudo cat /usr/share/ca-certificates/93377.pem\"": exit status 83
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /usr/share/ca-certificates/93377.pem mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-160000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-160000"
  	"""
  )
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /etc/ssl/certs/51391683.0": exit status 83 (217.383766ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/etc/ssl/certs/51391683.0" inside minikube. args "out/minikube-darwin-amd64 -p functional-160000 ssh \"sudo cat /etc/ssl/certs/51391683.0\"": exit status 83
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /etc/ssl/certs/51391683.0 mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-160000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-160000"
  	"""
  )
functional_test.go:1995: Checking for existence of /etc/ssl/certs/933772.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /etc/ssl/certs/933772.pem"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /etc/ssl/certs/933772.pem": exit status 83 (247.279886ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/etc/ssl/certs/933772.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-160000 ssh \"sudo cat /etc/ssl/certs/933772.pem\"": exit status 83
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /etc/ssl/certs/933772.pem mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-160000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-160000"
  	"""
  )
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/933772.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /usr/share/ca-certificates/933772.pem"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /usr/share/ca-certificates/933772.pem": exit status 83 (197.543944ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/usr/share/ca-certificates/933772.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-160000 ssh \"sudo cat /usr/share/ca-certificates/933772.pem\"": exit status 83
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /usr/share/ca-certificates/933772.pem mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-160000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-160000"
  	"""
  )
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0": exit status 83 (152.054233ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/etc/ssl/certs/3ec20f2e.0" inside minikube. args "out/minikube-darwin-amd64 -p functional-160000 ssh \"sudo cat /etc/ssl/certs/3ec20f2e.0\"": exit status 83
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /etc/ssl/certs/3ec20f2e.0 mismatch (-want +got):
  (
  	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-160000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-160000"
  	"""
  )
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (84.801751ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/CertSync (1.28s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-160000 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
functional_test.go:218: (dbg) Non-zero exit: kubectl --context functional-160000 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'": exit status 1 (45.588348ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-160000

                                                
                                                
** /stderr **
functional_test.go:220: failed to 'kubectl get nodes' with args "kubectl --context functional-160000 get nodes --output=go-template \"--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'\"": exit status 1
functional_test.go:226: expected to have label "minikube.k8s.io/commit" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-160000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/version" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-160000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/updated_at" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-160000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/name" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-160000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/primary" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-160000

                                                
                                                
** /stderr **
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-160000 -n functional-160000: exit status 7 (77.769231ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-160000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/NodeLabels (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "sudo systemctl is-active crio": exit status 83 (243.54585ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:2026: output of 
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --: exit status 83
functional_test.go:2029: For runtime "docker": expected "crio" to be inactive but got "* The control-plane node functional-160000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-160000\"\n" 
--- FAIL: TestFunctional/parallel/NonActiveRuntimeDisabled (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 version -o=json --components
functional_test.go:2266: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 version -o=json --components: exit status 83 (182.140246ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:2268: error version: exit status 83
functional_test.go:2273: expected to see "buildctl" in the minikube version --components but got:
* The control-plane node functional-160000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-160000"
functional_test.go:2273: expected to see "commit" in the minikube version --components but got:
* The control-plane node functional-160000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-160000"
functional_test.go:2273: expected to see "containerd" in the minikube version --components but got:
* The control-plane node functional-160000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-160000"
functional_test.go:2273: expected to see "crictl" in the minikube version --components but got:
* The control-plane node functional-160000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-160000"
functional_test.go:2273: expected to see "crio" in the minikube version --components but got:
* The control-plane node functional-160000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-160000"
functional_test.go:2273: expected to see "ctr" in the minikube version --components but got:
* The control-plane node functional-160000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-160000"
functional_test.go:2273: expected to see "docker" in the minikube version --components but got:
* The control-plane node functional-160000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-160000"
functional_test.go:2273: expected to see "minikubeVersion" in the minikube version --components but got:
* The control-plane node functional-160000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-160000"
functional_test.go:2273: expected to see "podman" in the minikube version --components but got:
* The control-plane node functional-160000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-160000"
functional_test.go:2273: expected to see "crun" in the minikube version --components but got:
* The control-plane node functional-160000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-160000"
--- FAIL: TestFunctional/parallel/Version/components (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-160000 image ls --format short --alsologtostderr:

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-160000 image ls --format short --alsologtostderr:
I0304 17:46:27.211873   94795 out.go:291] Setting OutFile to fd 1 ...
I0304 17:46:27.212066   94795 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:46:27.212071   94795 out.go:304] Setting ErrFile to fd 2...
I0304 17:46:27.212075   94795 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:46:27.212280   94795 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
I0304 17:46:27.212889   94795 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:46:27.212988   94795 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:46:27.213323   94795 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:46:27.213370   94795 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0304 17:46:27.221021   94795 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63567
I0304 17:46:27.221629   94795 main.go:141] libmachine: () Calling .GetVersion
I0304 17:46:27.222052   94795 main.go:141] libmachine: Using API Version  1
I0304 17:46:27.222063   94795 main.go:141] libmachine: () Calling .SetConfigRaw
I0304 17:46:27.222292   94795 main.go:141] libmachine: () Calling .GetMachineName
I0304 17:46:27.222411   94795 main.go:141] libmachine: (functional-160000) Calling .GetState
I0304 17:46:27.222494   94795 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:46:27.222509   94795 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
I0304 17:46:27.222520   94795 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
I0304 17:46:27.222556   94795 main.go:141] libmachine: Making call to close driver server
I0304 17:46:27.222561   94795 main.go:141] libmachine: (functional-160000) Calling .Close
I0304 17:46:27.222641   94795 main.go:141] libmachine: Successfully made call to close driver server
I0304 17:46:27.222644   94795 main.go:141] libmachine: (functional-160000) DBG | Closing plugin on server side
I0304 17:46:27.222651   94795 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListShort (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-160000 image ls --format table --alsologtostderr:
|-------|-----|----------|------|
| Image | Tag | Image ID | Size |
|-------|-----|----------|------|
|-------|-----|----------|------|
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-160000 image ls --format table --alsologtostderr:
I0304 17:46:27.851401   94813 out.go:291] Setting OutFile to fd 1 ...
I0304 17:46:27.851691   94813 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:46:27.851697   94813 out.go:304] Setting ErrFile to fd 2...
I0304 17:46:27.851701   94813 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:46:27.851874   94813 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
I0304 17:46:27.852493   94813 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:46:27.852584   94813 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:46:27.853012   94813 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:46:27.853055   94813 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0304 17:46:27.860729   94813 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63579
I0304 17:46:27.861153   94813 main.go:141] libmachine: () Calling .GetVersion
I0304 17:46:27.861586   94813 main.go:141] libmachine: Using API Version  1
I0304 17:46:27.861621   94813 main.go:141] libmachine: () Calling .SetConfigRaw
I0304 17:46:27.861866   94813 main.go:141] libmachine: () Calling .GetMachineName
I0304 17:46:27.861979   94813 main.go:141] libmachine: (functional-160000) Calling .GetState
I0304 17:46:27.862077   94813 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:46:27.862092   94813 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
I0304 17:46:27.862102   94813 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
I0304 17:46:27.862277   94813 main.go:141] libmachine: Making call to close driver server
I0304 17:46:27.862298   94813 main.go:141] libmachine: (functional-160000) Calling .Close
I0304 17:46:27.862388   94813 main.go:141] libmachine: Successfully made call to close driver server
I0304 17:46:27.862396   94813 main.go:141] libmachine: (functional-160000) DBG | Closing plugin on server side
I0304 17:46:27.862403   94813 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected | registry.k8s.io/pause to be listed with minikube but the image is not there
E0304 17:47:26.232927   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
E0304 17:47:26.241208   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
E0304 17:47:26.252238   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
E0304 17:47:26.273693   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
E0304 17:47:26.315446   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
E0304 17:47:26.395707   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
E0304 17:47:26.555961   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
E0304 17:47:26.876200   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListTable (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-160000 image ls --format json --alsologtostderr:
[]
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-160000 image ls --format json --alsologtostderr:
I0304 17:46:27.750176   94810 out.go:291] Setting OutFile to fd 1 ...
I0304 17:46:27.750878   94810 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:46:27.750888   94810 out.go:304] Setting ErrFile to fd 2...
I0304 17:46:27.750894   94810 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:46:27.751408   94810 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
I0304 17:46:27.752030   94810 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:46:27.752120   94810 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:46:27.752450   94810 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:46:27.752513   94810 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0304 17:46:27.760267   94810 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63577
I0304 17:46:27.760678   94810 main.go:141] libmachine: () Calling .GetVersion
I0304 17:46:27.761107   94810 main.go:141] libmachine: Using API Version  1
I0304 17:46:27.761116   94810 main.go:141] libmachine: () Calling .SetConfigRaw
I0304 17:46:27.761316   94810 main.go:141] libmachine: () Calling .GetMachineName
I0304 17:46:27.761421   94810 main.go:141] libmachine: (functional-160000) Calling .GetState
I0304 17:46:27.761515   94810 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:46:27.761529   94810 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
I0304 17:46:27.761560   94810 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
I0304 17:46:27.761649   94810 main.go:141] libmachine: Making call to close driver server
I0304 17:46:27.761661   94810 main.go:141] libmachine: (functional-160000) Calling .Close
I0304 17:46:27.761745   94810 main.go:141] libmachine: (functional-160000) DBG | Closing plugin on server side
I0304 17:46:27.761746   94810 main.go:141] libmachine: Successfully made call to close driver server
I0304 17:46:27.761759   94810 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected ["registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListJson (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-160000 image ls --format yaml --alsologtostderr:
[]

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-160000 image ls --format yaml --alsologtostderr:
I0304 17:46:27.312043   94798 out.go:291] Setting OutFile to fd 1 ...
I0304 17:46:27.312311   94798 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:46:27.312317   94798 out.go:304] Setting ErrFile to fd 2...
I0304 17:46:27.312320   94798 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:46:27.312495   94798 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
I0304 17:46:27.313075   94798 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:46:27.313163   94798 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:46:27.313502   94798 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:46:27.313562   94798 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0304 17:46:27.321289   94798 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63569
I0304 17:46:27.321702   94798 main.go:141] libmachine: () Calling .GetVersion
I0304 17:46:27.322121   94798 main.go:141] libmachine: Using API Version  1
I0304 17:46:27.322132   94798 main.go:141] libmachine: () Calling .SetConfigRaw
I0304 17:46:27.322322   94798 main.go:141] libmachine: () Calling .GetMachineName
I0304 17:46:27.322404   94798 main.go:141] libmachine: (functional-160000) Calling .GetState
I0304 17:46:27.322525   94798 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:46:27.322560   94798 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
I0304 17:46:27.322574   94798 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
I0304 17:46:27.322591   94798 main.go:141] libmachine: Making call to close driver server
I0304 17:46:27.322596   94798 main.go:141] libmachine: (functional-160000) Calling .Close
I0304 17:46:27.322686   94798 main.go:141] libmachine: Successfully made call to close driver server
I0304 17:46:27.322696   94798 main.go:141] libmachine: Making call to close connection to plugin binary
I0304 17:46:27.322700   94798 main.go:141] libmachine: (functional-160000) DBG | Closing plugin on server side
functional_test.go:274: expected - registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListYaml (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh pgrep buildkitd: exit status 83 (138.80271ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:314: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image build -t localhost/my-image:functional-160000 testdata/build --alsologtostderr
functional_test.go:322: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-160000 image build -t localhost/my-image:functional-160000 testdata/build --alsologtostderr:
I0304 17:46:27.549259   94804 out.go:291] Setting OutFile to fd 1 ...
I0304 17:46:27.550150   94804 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:46:27.550156   94804 out.go:304] Setting ErrFile to fd 2...
I0304 17:46:27.550160   94804 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:46:27.550951   94804 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
I0304 17:46:27.551790   94804 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:46:27.552405   94804 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:46:27.552755   94804 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:46:27.552797   94804 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0304 17:46:27.560466   94804 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63573
I0304 17:46:27.560888   94804 main.go:141] libmachine: () Calling .GetVersion
I0304 17:46:27.561289   94804 main.go:141] libmachine: Using API Version  1
I0304 17:46:27.561302   94804 main.go:141] libmachine: () Calling .SetConfigRaw
I0304 17:46:27.561496   94804 main.go:141] libmachine: () Calling .GetMachineName
I0304 17:46:27.561615   94804 main.go:141] libmachine: (functional-160000) Calling .GetState
I0304 17:46:27.561699   94804 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:46:27.561717   94804 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
I0304 17:46:27.561724   94804 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
I0304 17:46:27.561774   94804 build_images.go:123] succeeded building to: 
I0304 17:46:27.561783   94804 build_images.go:124] failed building to: 
I0304 17:46:27.561809   94804 main.go:141] libmachine: Making call to close driver server
I0304 17:46:27.561817   94804 main.go:141] libmachine: (functional-160000) Calling .Close
I0304 17:46:27.561908   94804 main.go:141] libmachine: Successfully made call to close driver server
I0304 17:46:27.561918   94804 main.go:141] libmachine: (functional-160000) DBG | Closing plugin on server side
I0304 17:46:27.561919   94804 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image ls
functional_test.go:442: expected "localhost/my-image:functional-160000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageBuild (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv/bash (0.17s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv/bash
functional_test.go:495: (dbg) Run:  /bin/bash -c "eval $(out/minikube-darwin-amd64 -p functional-160000 docker-env) && out/minikube-darwin-amd64 status -p functional-160000"
functional_test.go:495: (dbg) Non-zero exit: /bin/bash -c "eval $(out/minikube-darwin-amd64 -p functional-160000 docker-env) && out/minikube-darwin-amd64 status -p functional-160000": exit status 1 (171.812684ms)
functional_test.go:501: failed to do status after eval-ing docker-env. error: exit status 1
--- FAIL: TestFunctional/parallel/DockerEnv/bash (0.17s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 update-context --alsologtostderr -v=2: exit status 83 (141.811686ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:46:26.785865   94786 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:46:26.786712   94786 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:46:26.786719   94786 out.go:304] Setting ErrFile to fd 2...
	I0304 17:46:26.786723   94786 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:46:26.787428   94786 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:46:26.788039   94786 mustload.go:65] Loading cluster: functional-160000
	I0304 17:46:26.788296   94786 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:46:26.788618   94786 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:46:26.788664   94786 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:46:26.796575   94786 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63561
	I0304 17:46:26.796979   94786 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:46:26.797409   94786 main.go:141] libmachine: Using API Version  1
	I0304 17:46:26.797427   94786 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:46:26.797667   94786 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:46:26.797774   94786 main.go:141] libmachine: (functional-160000) Calling .GetState
	I0304 17:46:26.797865   94786 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:46:26.797885   94786 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
	I0304 17:46:26.797893   94786 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
	I0304 17:46:26.819094   94786 out.go:177] * The control-plane node functional-160000 host is not running: state=Stopped
	I0304 17:46:26.840312   94786 out.go:177]   To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-160000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2122: update-context: got="* The control-plane node functional-160000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-160000\"\n", want=*"No changes"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_changes (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 update-context --alsologtostderr -v=2: exit status 83 (140.375502ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:46:27.071492   94792 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:46:27.071778   94792 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:46:27.071784   94792 out.go:304] Setting ErrFile to fd 2...
	I0304 17:46:27.071788   94792 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:46:27.071970   94792 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:46:27.072277   94792 mustload.go:65] Loading cluster: functional-160000
	I0304 17:46:27.072562   94792 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:46:27.072898   94792 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:46:27.072944   94792 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:46:27.080583   94792 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63565
	I0304 17:46:27.081031   94792 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:46:27.081441   94792 main.go:141] libmachine: Using API Version  1
	I0304 17:46:27.081450   94792 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:46:27.081739   94792 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:46:27.081856   94792 main.go:141] libmachine: (functional-160000) Calling .GetState
	I0304 17:46:27.081940   94792 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:46:27.081969   94792 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
	I0304 17:46:27.081982   94792 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
	I0304 17:46:27.103739   94792 out.go:177] * The control-plane node functional-160000 host is not running: state=Stopped
	I0304 17:46:27.125797   94792 out.go:177]   To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-160000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2122: update-context: got="* The control-plane node functional-160000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-160000\"\n", want=*"context has been updated"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 update-context --alsologtostderr -v=2: exit status 83 (141.651257ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:46:26.928959   94789 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:46:26.929225   94789 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:46:26.929231   94789 out.go:304] Setting ErrFile to fd 2...
	I0304 17:46:26.929235   94789 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:46:26.929404   94789 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:46:26.929705   94789 mustload.go:65] Loading cluster: functional-160000
	I0304 17:46:26.929990   94789 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:46:26.930324   94789 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:46:26.930366   94789 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:46:26.937948   94789 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63563
	I0304 17:46:26.938365   94789 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:46:26.938792   94789 main.go:141] libmachine: Using API Version  1
	I0304 17:46:26.938805   94789 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:46:26.939049   94789 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:46:26.939166   94789 main.go:141] libmachine: (functional-160000) Calling .GetState
	I0304 17:46:26.939252   94789 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:46:26.939266   94789 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
	I0304 17:46:26.939278   94789 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
	I0304 17:46:26.961262   94789 out.go:177] * The control-plane node functional-160000 host is not running: state=Stopped
	I0304 17:46:26.983060   94789 out.go:177]   To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-160000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2122: update-context: got="* The control-plane node functional-160000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-160000\"\n", want=*"context has been updated"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (0.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1435: (dbg) Run:  kubectl --context functional-160000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8
functional_test.go:1435: (dbg) Non-zero exit: kubectl --context functional-160000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8: exit status 1 (54.463243ms)

                                                
                                                
** stderr ** 
	error: context "functional-160000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1439: failed to create hello-node deployment with this command "kubectl --context functional-160000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8": exit status 1.
--- FAIL: TestFunctional/parallel/ServiceCmd/DeployApp (0.05s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (2.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image load --daemon gcr.io/google-containers/addon-resizer:functional-160000 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-darwin-amd64 -p functional-160000 image load --daemon gcr.io/google-containers/addon-resizer:functional-160000 --alsologtostderr: (2.164859711s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-160000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (2.26s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1455: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 service list
functional_test.go:1455: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 service list: exit status 83 (194.60825ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1457: failed to do service list. args "out/minikube-darwin-amd64 -p functional-160000 service list" : exit status 83
functional_test.go:1460: expected 'service list' to contain *hello-node* but got -"* The control-plane node functional-160000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-160000\"\n"-
--- FAIL: TestFunctional/parallel/ServiceCmd/List (0.19s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.15s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1485: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 service list -o json
functional_test.go:1485: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 service list -o json: exit status 83 (150.388258ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1487: failed to list services with json format. args "out/minikube-darwin-amd64 -p functional-160000 service list -o json": exit status 83
--- FAIL: TestFunctional/parallel/ServiceCmd/JSONOutput (0.15s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1505: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 service --namespace=default --https --url hello-node
functional_test.go:1505: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 service --namespace=default --https --url hello-node: exit status 83 (159.231434ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1507: failed to get service url. args "out/minikube-darwin-amd64 -p functional-160000 service --namespace=default --https --url hello-node" : exit status 83
--- FAIL: TestFunctional/parallel/ServiceCmd/HTTPS (0.16s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.17s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1536: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 service hello-node --url --format={{.IP}}
functional_test.go:1536: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 service hello-node --url --format={{.IP}}: exit status 83 (172.176231ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1538: failed to get service url with custom format. args "out/minikube-darwin-amd64 -p functional-160000 service hello-node --url --format={{.IP}}": exit status 83
functional_test.go:1544: "* The control-plane node functional-160000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-160000\"" is not a valid IP
--- FAIL: TestFunctional/parallel/ServiceCmd/Format (0.17s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1555: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 service hello-node --url
functional_test.go:1555: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 service hello-node --url: exit status 83 (192.131562ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test.go:1557: failed to get service url. args: "out/minikube-darwin-amd64 -p functional-160000 service hello-node --url": exit status 83
functional_test.go:1561: found endpoint for hello-node: * The control-plane node functional-160000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-160000"
functional_test.go:1565: failed to parse "* The control-plane node functional-160000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-160000\"": parse "* The control-plane node functional-160000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-160000\"": net/url: invalid control character in URL
--- FAIL: TestFunctional/parallel/ServiceCmd/URL (0.19s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.32s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-160000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-160000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:190: tunnel command failed with unexpected error: exit code 83. stderr: I0304 17:45:42.567645   94525 out.go:291] Setting OutFile to fd 1 ...
I0304 17:45:42.568465   94525 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:45:42.568473   94525 out.go:304] Setting ErrFile to fd 2...
I0304 17:45:42.568479   94525 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:45:42.568727   94525 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
I0304 17:45:42.569104   94525 mustload.go:65] Loading cluster: functional-160000
I0304 17:45:42.569379   94525 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:45:42.569762   94525 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0304 17:45:42.569807   94525 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0304 17:45:42.578068   94525 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63414
I0304 17:45:42.578507   94525 main.go:141] libmachine: () Calling .GetVersion
I0304 17:45:42.579004   94525 main.go:141] libmachine: Using API Version  1
I0304 17:45:42.579022   94525 main.go:141] libmachine: () Calling .SetConfigRaw
I0304 17:45:42.579220   94525 main.go:141] libmachine: () Calling .GetMachineName
I0304 17:45:42.579337   94525 main.go:141] libmachine: (functional-160000) Calling .GetState
I0304 17:45:42.579434   94525 main.go:141] libmachine: (functional-160000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0304 17:45:42.579454   94525 main.go:141] libmachine: (functional-160000) DBG | hyperkit pid from json: 0
I0304 17:45:42.579552   94525 main.go:141] libmachine: (functional-160000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/functional-160000/hyperkit.json: no such file or directory
I0304 17:45:42.601030   94525 out.go:177] * The control-plane node functional-160000 host is not running: state=Stopped
I0304 17:45:42.662704   94525 out.go:177]   To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
stdout: * The control-plane node functional-160000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-160000"
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-amd64 -p functional-160000 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: read stdout failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-160000 tunnel --alsologtostderr] stdout:
functional_test_tunnel_test.go:194: read stderr failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-160000 tunnel --alsologtostderr] stderr:
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-amd64 -p functional-160000 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 94529: os: process already finished
helpers_test.go:502: unable to terminate pid 94524: os: process already finished
functional_test_tunnel_test.go:194: read stdout failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-160000 tunnel --alsologtostderr] stdout:
functional_test_tunnel_test.go:194: read stderr failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-160000 tunnel --alsologtostderr] stderr:
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.32s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:208: failed to get Kubernetes client for "functional-160000": client config: context "functional-160000" does not exist
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (104.41s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:288: failed to hit nginx at "http://": Temporary Error: Get "http:": http: no Host in request URL
functional_test_tunnel_test.go:290: (dbg) Run:  kubectl --context functional-160000 get svc nginx-svc
functional_test_tunnel_test.go:290: (dbg) Non-zero exit: kubectl --context functional-160000 get svc nginx-svc: exit status 1 (38.157512ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-160000

                                                
                                                
** /stderr **
functional_test_tunnel_test.go:292: kubectl --context functional-160000 get svc nginx-svc failed: exit status 1
functional_test_tunnel_test.go:294: failed to kubectl get svc nginx-svc:
functional_test_tunnel_test.go:301: expected body to contain "Welcome to nginx!", but got *""*
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (104.41s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.86s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image load --daemon gcr.io/google-containers/addon-resizer:functional-160000 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-darwin-amd64 -p functional-160000 image load --daemon gcr.io/google-containers/addon-resizer:functional-160000 --alsologtostderr: (1.762367936s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-160000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.86s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (3.56s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (1.722060202s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-160000
functional_test.go:244: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image load --daemon gcr.io/google-containers/addon-resizer:functional-160000 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-darwin-amd64 -p functional-160000 image load --daemon gcr.io/google-containers/addon-resizer:functional-160000 --alsologtostderr: (1.688357753s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-160000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (3.56s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image save gcr.io/google-containers/addon-resizer:functional-160000 /Users/jenkins/workspace/addon-resizer-save.tar --alsologtostderr
functional_test.go:385: expected "/Users/jenkins/workspace/addon-resizer-save.tar" to exist after `image save`, but doesn't exist
--- FAIL: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image load /Users/jenkins/workspace/addon-resizer-save.tar --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-160000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (15.06s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:319: (dbg) Run:  dig +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A
E0304 17:47:27.516720   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
E0304 17:47:28.797396   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
E0304 17:47:31.359612   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
E0304 17:47:36.480570   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
functional_test_tunnel_test.go:319: (dbg) Non-zero exit: dig +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A: exit status 9 (15.031610342s)

                                                
                                                
-- stdout --
	
	; <<>> DiG 9.10.6 <<>> +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A
	; (1 server found)
	;; global options: +cmd
	;; connection timed out; no servers could be reached

                                                
                                                
-- /stdout --
functional_test_tunnel_test.go:322: failed to resolve DNS name: exit status 9
functional_test_tunnel_test.go:329: expected body to contain "ANSWER: 1", but got *"\n; <<>> DiG 9.10.6 <<>> +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A\n; (1 server found)\n;; global options: +cmd\n;; connection timed out; no servers could be reached\n"*
functional_test_tunnel_test.go:332: (dbg) Run:  scutil --dns
functional_test_tunnel_test.go:336: debug for DNS configuration:
DNS configuration

                                                
                                                
resolver #1
nameserver[0] : 8.8.8.8
flags    : Request A records
reach    : 0x00000002 (Reachable)

                                                
                                                
resolver #2
domain   : local
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300000

                                                
                                                
resolver #3
domain   : 254.169.in-addr.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300200

                                                
                                                
resolver #4
domain   : 8.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300400

                                                
                                                
resolver #5
domain   : 9.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300600

                                                
                                                
resolver #6
domain   : a.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300800

                                                
                                                
resolver #7
domain   : b.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 301000

                                                
                                                
resolver #8
domain   : cluster.local
nameserver[0] : 10.96.0.10
flags    : Request A records
reach    : 0x00000002 (Reachable)
order    : 1

                                                
                                                
DNS configuration (for scoped queries)

                                                
                                                
resolver #1
nameserver[0] : 8.8.8.8
if_index : 4 (en0)
flags    : Scoped, Request A records
reach    : 0x00000002 (Reachable)
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (15.06s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (38.99s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
E0304 17:48:07.203558   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
functional_test_tunnel_test.go:419: failed to hit nginx with DNS forwarded "http://nginx-svc.default.svc.cluster.local.": Temporary Error: Get "http://nginx-svc.default.svc.cluster.local.": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
functional_test_tunnel_test.go:426: expected body to contain "Welcome to nginx!", but got *""*
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (38.99s)

                                                
                                    
x
+
TestMutliControlPlane/serial/StartCluster (11.21s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run:  out/minikube-darwin-amd64 start -p ha-514000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=hyperkit 
ha_test.go:101: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ha-514000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=hyperkit : exit status 60 (11.135240792s)

                                                
                                                
-- stdout --
	* [ha-514000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "ha-514000" primary control-plane node in "ha-514000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "ha-514000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:48:32.020153   94916 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:48:32.020824   94916 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:48:32.020832   94916 out.go:304] Setting ErrFile to fd 2...
	I0304 17:48:32.020837   94916 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:48:32.021587   94916 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:48:32.023220   94916 out.go:298] Setting JSON to false
	I0304 17:48:32.045709   94916 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24481,"bootTime":1709578831,"procs":490,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:48:32.045798   94916 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:48:32.067523   94916 out.go:177] * [ha-514000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:48:32.110171   94916 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:48:32.110224   94916 notify.go:220] Checking for updates...
	I0304 17:48:32.152059   94916 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:48:32.193829   94916 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:48:32.216005   94916 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:48:32.237297   94916 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:48:32.258065   94916 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:48:32.279512   94916 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:48:32.309400   94916 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 17:48:32.351183   94916 start.go:297] selected driver: hyperkit
	I0304 17:48:32.351212   94916 start.go:901] validating driver "hyperkit" against <nil>
	I0304 17:48:32.351248   94916 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:48:32.355661   94916 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:48:32.355776   94916 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:48:32.363818   94916 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:48:32.367904   94916 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:48:32.367927   94916 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0304 17:48:32.367962   94916 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 17:48:32.368175   94916 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 17:48:32.368234   94916 cni.go:84] Creating CNI manager for ""
	I0304 17:48:32.368242   94916 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I0304 17:48:32.368254   94916 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0304 17:48:32.368328   94916 start.go:340] cluster config:
	{Name:ha-514000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-514000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docke
r CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0
GPUs: AutoPauseInterval:1m0s}
	I0304 17:48:32.368413   94916 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:48:32.389234   94916 out.go:177] * Starting "ha-514000" primary control-plane node in "ha-514000" cluster
	I0304 17:48:32.409817   94916 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:48:32.409877   94916 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:48:32.409904   94916 cache.go:56] Caching tarball of preloaded images
	I0304 17:48:32.410052   94916 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:48:32.410066   94916 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 17:48:32.410472   94916 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/ha-514000/config.json ...
	I0304 17:48:32.410504   94916 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/ha-514000/config.json: {Name:mkcc81fdd56f4b1e84b6f091802fe215dd4a102d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 17:48:32.411039   94916 start.go:360] acquireMachinesLock for ha-514000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:48:32.411145   94916 start.go:364] duration metric: took 81.261µs to acquireMachinesLock for "ha-514000"
	I0304 17:48:32.411182   94916 start.go:93] Provisioning new machine with config: &{Name:ha-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-514000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:48:32.411254   94916 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:48:32.432091   94916 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 17:48:32.432426   94916 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:48:32.432508   94916 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:48:32.442359   94916 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63586
	I0304 17:48:32.442698   94916 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:48:32.443115   94916 main.go:141] libmachine: Using API Version  1
	I0304 17:48:32.443139   94916 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:48:32.443399   94916 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:48:32.443501   94916 main.go:141] libmachine: (ha-514000) Calling .GetMachineName
	I0304 17:48:32.443582   94916 main.go:141] libmachine: (ha-514000) Calling .DriverName
	I0304 17:48:32.443703   94916 start.go:159] libmachine.API.Create for "ha-514000" (driver="hyperkit")
	I0304 17:48:32.443730   94916 client.go:168] LocalClient.Create starting
	I0304 17:48:32.443772   94916 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:48:32.443826   94916 main.go:141] libmachine: Decoding PEM data...
	I0304 17:48:32.443843   94916 main.go:141] libmachine: Parsing certificate...
	I0304 17:48:32.443898   94916 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:48:32.443934   94916 main.go:141] libmachine: Decoding PEM data...
	I0304 17:48:32.443947   94916 main.go:141] libmachine: Parsing certificate...
	I0304 17:48:32.443963   94916 main.go:141] libmachine: Running pre-create checks...
	I0304 17:48:32.443972   94916 main.go:141] libmachine: (ha-514000) Calling .PreCreateCheck
	I0304 17:48:32.444064   94916 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:48:32.444266   94916 main.go:141] libmachine: (ha-514000) Calling .GetConfigRaw
	I0304 17:48:32.453631   94916 main.go:141] libmachine: Creating machine...
	I0304 17:48:32.453648   94916 main.go:141] libmachine: (ha-514000) Calling .Create
	I0304 17:48:32.453833   94916 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:48:32.454087   94916 main.go:141] libmachine: (ha-514000) DBG | I0304 17:48:32.453815   94924 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:48:32.454174   94916 main.go:141] libmachine: (ha-514000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:48:32.629070   94916 main.go:141] libmachine: (ha-514000) DBG | I0304 17:48:32.628970   94924 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/id_rsa...
	I0304 17:48:32.697268   94916 main.go:141] libmachine: (ha-514000) DBG | I0304 17:48:32.697219   94924 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/ha-514000.rawdisk...
	I0304 17:48:32.697288   94916 main.go:141] libmachine: (ha-514000) DBG | Writing magic tar header
	I0304 17:48:32.697297   94916 main.go:141] libmachine: (ha-514000) DBG | Writing SSH key tar header
	I0304 17:48:32.698211   94916 main.go:141] libmachine: (ha-514000) DBG | I0304 17:48:32.698104   94924 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000 ...
	I0304 17:48:33.059390   94916 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:48:33.059406   94916 main.go:141] libmachine: (ha-514000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.pid
	I0304 17:48:33.059456   94916 main.go:141] libmachine: (ha-514000) DBG | Using UUID 7a398b6d-083e-42e1-887d-83a90af53d2d
	I0304 17:48:33.096960   94916 main.go:141] libmachine: (ha-514000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:48:33.097056   94916 client.go:171] duration metric: took 653.308149ms to LocalClient.Create
	I0304 17:48:35.097445   94916 start.go:128] duration metric: took 2.686145051s to createHost
	I0304 17:48:35.097493   94916 start.go:83] releasing machines lock for "ha-514000", held for 2.686307382s
	W0304 17:48:35.097517   94916 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 17:48:35.097926   94916 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:48:35.097963   94916 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:48:35.106721   94916 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63588
	I0304 17:48:35.107352   94916 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:48:35.107781   94916 main.go:141] libmachine: Using API Version  1
	I0304 17:48:35.107797   94916 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:48:35.108035   94916 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:48:35.108382   94916 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:48:35.108411   94916 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:48:35.116590   94916 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63590
	I0304 17:48:35.116986   94916 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:48:35.117339   94916 main.go:141] libmachine: Using API Version  1
	I0304 17:48:35.117357   94916 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:48:35.117553   94916 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:48:35.117651   94916 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:48:35.117733   94916 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:48:35.117767   94916 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:48:35.117779   94916 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:48:35.117812   94916 main.go:141] libmachine: (ha-514000) Calling .DriverName
	I0304 17:48:35.143843   94916 out.go:177] * Deleting "ha-514000" in hyperkit ...
	I0304 17:48:35.165254   94916 main.go:141] libmachine: (ha-514000) Calling .Remove
	I0304 17:48:35.165567   94916 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:48:35.165592   94916 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:48:35.165638   94916 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:48:35.165657   94916 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	W0304 17:48:35.183269   94916 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:48:35.183282   94916 start.go:728] Will try again in 5 seconds ...
	I0304 17:48:40.184736   94916 start.go:360] acquireMachinesLock for ha-514000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:48:40.184920   94916 start.go:364] duration metric: took 146.026µs to acquireMachinesLock for "ha-514000"
	I0304 17:48:40.184953   94916 start.go:93] Provisioning new machine with config: &{Name:ha-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-514000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:48:40.185081   94916 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:48:40.230357   94916 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 17:48:40.230530   94916 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:48:40.230570   94916 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:48:40.239830   94916 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63592
	I0304 17:48:40.240210   94916 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:48:40.240549   94916 main.go:141] libmachine: Using API Version  1
	I0304 17:48:40.240560   94916 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:48:40.240757   94916 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:48:40.240865   94916 main.go:141] libmachine: (ha-514000) Calling .GetMachineName
	I0304 17:48:40.240959   94916 main.go:141] libmachine: (ha-514000) Calling .DriverName
	I0304 17:48:40.241072   94916 start.go:159] libmachine.API.Create for "ha-514000" (driver="hyperkit")
	I0304 17:48:40.241088   94916 client.go:168] LocalClient.Create starting
	I0304 17:48:40.241117   94916 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:48:40.241166   94916 main.go:141] libmachine: Decoding PEM data...
	I0304 17:48:40.241175   94916 main.go:141] libmachine: Parsing certificate...
	I0304 17:48:40.241211   94916 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:48:40.241246   94916 main.go:141] libmachine: Decoding PEM data...
	I0304 17:48:40.241262   94916 main.go:141] libmachine: Parsing certificate...
	I0304 17:48:40.241276   94916 main.go:141] libmachine: Running pre-create checks...
	I0304 17:48:40.241281   94916 main.go:141] libmachine: (ha-514000) Calling .PreCreateCheck
	I0304 17:48:40.241362   94916 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:48:40.241408   94916 main.go:141] libmachine: (ha-514000) Calling .GetConfigRaw
	I0304 17:48:40.241861   94916 main.go:141] libmachine: Creating machine...
	I0304 17:48:40.241870   94916 main.go:141] libmachine: (ha-514000) Calling .Create
	I0304 17:48:40.241931   94916 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:48:40.242057   94916 main.go:141] libmachine: (ha-514000) DBG | I0304 17:48:40.241930   94929 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:48:40.242115   94916 main.go:141] libmachine: (ha-514000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:48:40.418512   94916 main.go:141] libmachine: (ha-514000) DBG | I0304 17:48:40.418418   94929 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/id_rsa...
	I0304 17:48:40.542451   94916 main.go:141] libmachine: (ha-514000) DBG | I0304 17:48:40.542365   94929 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/ha-514000.rawdisk...
	I0304 17:48:40.542469   94916 main.go:141] libmachine: (ha-514000) DBG | Writing magic tar header
	I0304 17:48:40.542477   94916 main.go:141] libmachine: (ha-514000) DBG | Writing SSH key tar header
	I0304 17:48:40.543316   94916 main.go:141] libmachine: (ha-514000) DBG | I0304 17:48:40.543222   94929 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000 ...
	I0304 17:48:40.903814   94916 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:48:40.903845   94916 main.go:141] libmachine: (ha-514000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.pid
	I0304 17:48:40.903878   94916 main.go:141] libmachine: (ha-514000) DBG | Using UUID 6bbbf2a5-0e86-4f90-8ea0-83fd5d57a89f
	I0304 17:48:40.940854   94916 main.go:141] libmachine: (ha-514000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:48:40.940929   94916 client.go:171] duration metric: took 699.826019ms to LocalClient.Create
	I0304 17:48:42.943146   94916 start.go:128] duration metric: took 2.757998769s to createHost
	I0304 17:48:42.943172   94916 start.go:83] releasing machines lock for "ha-514000", held for 2.758206596s
	W0304 17:48:42.943278   94916 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p ha-514000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p ha-514000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:48:42.965985   94916 out.go:177] 
	W0304 17:48:42.988634   94916 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:48:42.988711   94916 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:48:42.988729   94916 out.go:239] * Related issues:
	* Related issues:
	W0304 17:48:42.988775   94916 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:48:42.988840   94916 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:48:43.031568   94916 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:103: failed to fresh-start ha (multi-control plane) cluster. args "out/minikube-darwin-amd64 start -p ha-514000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (75.291115ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/StartCluster (11.21s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DeployApp (120.48s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:128: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml: exit status 1 (102.505826ms)

                                                
                                                
** stderr ** 
	error: cluster "ha-514000" does not exist

                                                
                                                
** /stderr **
ha_test.go:130: failed to create busybox deployment to ha (multi-control plane) cluster
ha_test.go:133: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- rollout status deployment/busybox
ha_test.go:133: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- rollout status deployment/busybox: exit status 1 (102.039617ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:135: failed to deploy busybox to ha (multi-control plane) cluster
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.482685ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.366397ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (106.58756ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
E0304 17:48:48.164979   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.412786ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.725708ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.461916ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.798764ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.564671ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.130122ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.794148ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
E0304 17:50:10.086345   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.891373ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:159: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:163: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:163: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (102.063016ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:165: failed get Pod names
ha_test.go:171: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- exec  -- nslookup kubernetes.io
ha_test.go:171: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- exec  -- nslookup kubernetes.io: exit status 1 (102.970854ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:173: Pod  could not resolve 'kubernetes.io': exit status 1
ha_test.go:181: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- exec  -- nslookup kubernetes.default
ha_test.go:181: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- exec  -- nslookup kubernetes.default: exit status 1 (101.008794ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:183: Pod  could not resolve 'kubernetes.default': exit status 1
ha_test.go:189: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- exec  -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (101.947111ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:191: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (74.679739ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DeployApp (120.48s)

                                                
                                    
x
+
TestMutliControlPlane/serial/PingHostFromPods (0.18s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:199: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-514000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (100.680063ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-514000"

                                                
                                                
** /stderr **
ha_test.go:201: failed to get Pod names: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (75.238125ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/PingHostFromPods (0.18s)

                                                
                                    
x
+
TestMutliControlPlane/serial/AddWorkerNode (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 node add -p ha-514000 -v=7 --alsologtostderr
ha_test.go:228: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p ha-514000 -v=7 --alsologtostderr: exit status 83 (140.767039ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-514000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-514000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:50:43.896318   95066 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:50:43.897260   95066 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:43.897267   95066 out.go:304] Setting ErrFile to fd 2...
	I0304 17:50:43.897271   95066 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:43.897461   95066 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:50:43.897780   95066 mustload.go:65] Loading cluster: ha-514000
	I0304 17:50:43.898049   95066 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:50:43.898386   95066 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:50:43.898436   95066 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:50:43.906129   95066 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63603
	I0304 17:50:43.906551   95066 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:50:43.906960   95066 main.go:141] libmachine: Using API Version  1
	I0304 17:50:43.906976   95066 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:50:43.907177   95066 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:50:43.907307   95066 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:50:43.907396   95066 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:50:43.907414   95066 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:50:43.907447   95066 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:50:43.929142   95066 out.go:177] * The control-plane node ha-514000 host is not running: state=Stopped
	I0304 17:50:43.950475   95066 out.go:177]   To start a cluster, run: "minikube start -p ha-514000"

                                                
                                                
** /stderr **
ha_test.go:230: failed to add worker node to current ha (multi-control plane) cluster. args "out/minikube-darwin-amd64 node add -p ha-514000 -v=7 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (74.986899ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/AddWorkerNode (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/NodeLabels (0.11s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run:  kubectl --context ha-514000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
ha_test.go:255: (dbg) Non-zero exit: kubectl --context ha-514000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (37.148003ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: ha-514000

                                                
                                                
** /stderr **
ha_test.go:257: failed to 'kubectl get nodes' with args "kubectl --context ha-514000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1
ha_test.go:264: failed to decode json from label list: args "kubectl --context ha-514000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (74.647048ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/NodeLabels (0.11s)

                                                
                                    
x
+
TestMutliControlPlane/serial/HAppyAfterClusterStart (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:304: expected profile "ha-514000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-514000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-514000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServe
rPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-514000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4\",\"Containe
rRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\"
:false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
ha_test.go:307: expected profile "ha-514000" in json of 'profile list' to have "HAppy" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-514000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-514000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-514000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4
\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000000
0},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (76.853893ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/HAppyAfterClusterStart (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/CopyFile (0.15s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/CopyFile
ha_test.go:326: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 status --output json -v=7 --alsologtostderr
ha_test.go:326: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 status --output json -v=7 --alsologtostderr: exit status 7 (74.371139ms)

                                                
                                                
-- stdout --
	{"Name":"ha-514000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:50:44.448247   95085 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:50:44.448436   95085 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:44.448441   95085 out.go:304] Setting ErrFile to fd 2...
	I0304 17:50:44.448444   95085 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:44.448643   95085 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:50:44.448820   95085 out.go:298] Setting JSON to true
	I0304 17:50:44.448843   95085 mustload.go:65] Loading cluster: ha-514000
	I0304 17:50:44.448882   95085 notify.go:220] Checking for updates...
	I0304 17:50:44.449115   95085 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:50:44.449130   95085 status.go:255] checking status of ha-514000 ...
	I0304 17:50:44.449481   95085 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:50:44.449530   95085 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:50:44.457887   95085 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63618
	I0304 17:50:44.458263   95085 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:50:44.458671   95085 main.go:141] libmachine: Using API Version  1
	I0304 17:50:44.458680   95085 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:50:44.458883   95085 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:50:44.458989   95085 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:50:44.459072   95085 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:50:44.459097   95085 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:50:44.459108   95085 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:50:44.459160   95085 status.go:330] ha-514000 host status = "Stopped" (err=<nil>)
	I0304 17:50:44.459174   95085 status.go:343] host is not running, skipping remaining checks
	I0304 17:50:44.459180   95085 status.go:257] ha-514000 status: &{Name:ha-514000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:333: failed to decode json from status: args "out/minikube-darwin-amd64 -p ha-514000 status --output json -v=7 --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (75.419461ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/CopyFile (0.15s)

                                                
                                    
x
+
TestMutliControlPlane/serial/StopSecondaryNode (0.33s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/StopSecondaryNode
ha_test.go:363: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 node stop m02 -v=7 --alsologtostderr
ha_test.go:363: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 node stop m02 -v=7 --alsologtostderr: exit status 85 (180.203015ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:50:44.599957   95093 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:50:44.600445   95093 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:44.600450   95093 out.go:304] Setting ErrFile to fd 2...
	I0304 17:50:44.600454   95093 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:44.600630   95093 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:50:44.600979   95093 mustload.go:65] Loading cluster: ha-514000
	I0304 17:50:44.601247   95093 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:50:44.623584   95093 out.go:177] 
	W0304 17:50:44.644383   95093 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	W0304 17:50:44.644408   95093 out.go:239] * 
	* 
	W0304 17:50:44.671197   95093 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_8ce24bb09be8aab84076d51946735f62cbf80299_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_8ce24bb09be8aab84076d51946735f62cbf80299_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I0304 17:50:44.693563   95093 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:365: secondary control-plane node stop returned an error. args "out/minikube-darwin-amd64 -p ha-514000 node stop m02 -v=7 --alsologtostderr": exit status 85
ha_test.go:369: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr
ha_test.go:369: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr: exit status 7 (75.866837ms)

                                                
                                                
-- stdout --
	ha-514000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:50:44.779860   95095 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:50:44.780150   95095 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:44.780156   95095 out.go:304] Setting ErrFile to fd 2...
	I0304 17:50:44.780160   95095 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:44.780352   95095 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:50:44.780548   95095 out.go:298] Setting JSON to false
	I0304 17:50:44.780575   95095 mustload.go:65] Loading cluster: ha-514000
	I0304 17:50:44.780615   95095 notify.go:220] Checking for updates...
	I0304 17:50:44.781817   95095 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:50:44.781951   95095 status.go:255] checking status of ha-514000 ...
	I0304 17:50:44.782331   95095 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:50:44.782376   95095 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:50:44.790588   95095 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63624
	I0304 17:50:44.790907   95095 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:50:44.791317   95095 main.go:141] libmachine: Using API Version  1
	I0304 17:50:44.791327   95095 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:50:44.791521   95095 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:50:44.791651   95095 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:50:44.791746   95095 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:50:44.791761   95095 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:50:44.791784   95095 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:50:44.791824   95095 status.go:330] ha-514000 host status = "Stopped" (err=<nil>)
	I0304 17:50:44.791833   95095 status.go:343] host is not running, skipping remaining checks
	I0304 17:50:44.791839   95095 status.go:257] ha-514000 status: &{Name:ha-514000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:375: status says not all three control-plane nodes are present: args "out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr": ha-514000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:378: status says not three hosts are running: args "out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr": ha-514000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:381: status says not three kubelets are running: args "out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr": ha-514000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:384: status says not two apiservers are running: args "out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr": ha-514000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (75.206943ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/StopSecondaryNode (0.33s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:390: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:413: expected profile "ha-514000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-514000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-514000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACoun
t\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-514000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.2
8.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000
0000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (75.138674ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/RestartSecondaryNode (45.53s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/RestartSecondaryNode
ha_test.go:420: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 node start m02 -v=7 --alsologtostderr
ha_test.go:420: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 node start m02 -v=7 --alsologtostderr: exit status 85 (159.256547ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:50:45.153485   95109 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:50:45.154315   95109 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:45.154321   95109 out.go:304] Setting ErrFile to fd 2...
	I0304 17:50:45.154324   95109 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:45.154500   95109 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:50:45.154841   95109 mustload.go:65] Loading cluster: ha-514000
	I0304 17:50:45.155100   95109 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:50:45.175950   95109 out.go:177] 
	W0304 17:50:45.196944   95109 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	W0304 17:50:45.196989   95109 out.go:239] * 
	* 
	W0304 17:50:45.205404   95109 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I0304 17:50:45.226910   95109 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:422: I0304 17:50:45.153485   95109 out.go:291] Setting OutFile to fd 1 ...
I0304 17:50:45.154315   95109 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:50:45.154321   95109 out.go:304] Setting ErrFile to fd 2...
I0304 17:50:45.154324   95109 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:50:45.154500   95109 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
I0304 17:50:45.154841   95109 mustload.go:65] Loading cluster: ha-514000
I0304 17:50:45.155100   95109 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:50:45.175950   95109 out.go:177] 
W0304 17:50:45.196944   95109 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
W0304 17:50:45.196989   95109 out.go:239] * 
* 
W0304 17:50:45.205404   95109 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I0304 17:50:45.226910   95109 out.go:177] 
ha_test.go:423: secondary control-plane node start returned an error. args "out/minikube-darwin-amd64 -p ha-514000 node start m02 -v=7 --alsologtostderr": exit status 85
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr: exit status 7 (74.957611ms)

                                                
                                                
-- stdout --
	ha-514000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:50:45.312371   95111 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:50:45.313071   95111 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:45.313080   95111 out.go:304] Setting ErrFile to fd 2...
	I0304 17:50:45.313086   95111 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:45.313608   95111 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:50:45.313807   95111 out.go:298] Setting JSON to false
	I0304 17:50:45.313830   95111 mustload.go:65] Loading cluster: ha-514000
	I0304 17:50:45.313863   95111 notify.go:220] Checking for updates...
	I0304 17:50:45.314082   95111 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:50:45.314100   95111 status.go:255] checking status of ha-514000 ...
	I0304 17:50:45.314477   95111 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:50:45.314511   95111 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:50:45.322547   95111 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63636
	I0304 17:50:45.322858   95111 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:50:45.323281   95111 main.go:141] libmachine: Using API Version  1
	I0304 17:50:45.323292   95111 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:50:45.323500   95111 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:50:45.323634   95111 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:50:45.323725   95111 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:50:45.323754   95111 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:50:45.323774   95111 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:50:45.323804   95111 status.go:330] ha-514000 host status = "Stopped" (err=<nil>)
	I0304 17:50:45.323816   95111 status.go:343] host is not running, skipping remaining checks
	I0304 17:50:45.323823   95111 status.go:257] ha-514000 status: &{Name:ha-514000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr: exit status 7 (76.05063ms)

                                                
                                                
-- stdout --
	ha-514000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:50:45.977795   95116 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:50:45.977983   95116 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:45.977989   95116 out.go:304] Setting ErrFile to fd 2...
	I0304 17:50:45.977993   95116 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:45.978179   95116 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:50:45.978352   95116 out.go:298] Setting JSON to false
	I0304 17:50:45.978374   95116 mustload.go:65] Loading cluster: ha-514000
	I0304 17:50:45.978411   95116 notify.go:220] Checking for updates...
	I0304 17:50:45.978687   95116 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:50:45.978703   95116 status.go:255] checking status of ha-514000 ...
	I0304 17:50:45.979068   95116 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:50:45.979116   95116 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:50:45.987439   95116 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63639
	I0304 17:50:45.987755   95116 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:50:45.988167   95116 main.go:141] libmachine: Using API Version  1
	I0304 17:50:45.988177   95116 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:50:45.988442   95116 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:50:45.988584   95116 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:50:45.988671   95116 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:50:45.988685   95116 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:50:45.988696   95116 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:50:45.988721   95116 status.go:330] ha-514000 host status = "Stopped" (err=<nil>)
	I0304 17:50:45.988733   95116 status.go:343] host is not running, skipping remaining checks
	I0304 17:50:45.988740   95116 status.go:257] ha-514000 status: &{Name:ha-514000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr: exit status 7 (75.773659ms)

                                                
                                                
-- stdout --
	ha-514000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:50:47.164208   95119 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:50:47.164378   95119 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:47.164384   95119 out.go:304] Setting ErrFile to fd 2...
	I0304 17:50:47.164387   95119 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:47.164579   95119 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:50:47.164749   95119 out.go:298] Setting JSON to false
	I0304 17:50:47.164771   95119 mustload.go:65] Loading cluster: ha-514000
	I0304 17:50:47.164833   95119 notify.go:220] Checking for updates...
	I0304 17:50:47.165030   95119 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:50:47.165045   95119 status.go:255] checking status of ha-514000 ...
	I0304 17:50:47.165400   95119 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:50:47.165468   95119 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:50:47.173894   95119 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63642
	I0304 17:50:47.174214   95119 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:50:47.174631   95119 main.go:141] libmachine: Using API Version  1
	I0304 17:50:47.174639   95119 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:50:47.174890   95119 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:50:47.175021   95119 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:50:47.175104   95119 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:50:47.175132   95119 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:50:47.175138   95119 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:50:47.175150   95119 status.go:330] ha-514000 host status = "Stopped" (err=<nil>)
	I0304 17:50:47.175159   95119 status.go:343] host is not running, skipping remaining checks
	I0304 17:50:47.175165   95119 status.go:257] ha-514000 status: &{Name:ha-514000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr: exit status 7 (75.359192ms)

                                                
                                                
-- stdout --
	ha-514000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:50:48.546104   95122 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:50:48.546291   95122 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:48.546297   95122 out.go:304] Setting ErrFile to fd 2...
	I0304 17:50:48.546300   95122 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:48.546487   95122 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:50:48.546657   95122 out.go:298] Setting JSON to false
	I0304 17:50:48.546678   95122 mustload.go:65] Loading cluster: ha-514000
	I0304 17:50:48.546719   95122 notify.go:220] Checking for updates...
	I0304 17:50:48.546987   95122 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:50:48.547003   95122 status.go:255] checking status of ha-514000 ...
	I0304 17:50:48.547374   95122 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:50:48.547408   95122 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:50:48.555657   95122 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63645
	I0304 17:50:48.555981   95122 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:50:48.556388   95122 main.go:141] libmachine: Using API Version  1
	I0304 17:50:48.556415   95122 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:50:48.556667   95122 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:50:48.556785   95122 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:50:48.556874   95122 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:50:48.556897   95122 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:50:48.556910   95122 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:50:48.556916   95122 status.go:330] ha-514000 host status = "Stopped" (err=<nil>)
	I0304 17:50:48.556924   95122 status.go:343] host is not running, skipping remaining checks
	I0304 17:50:48.556931   95122 status.go:257] ha-514000 status: &{Name:ha-514000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr: exit status 7 (75.650737ms)

                                                
                                                
-- stdout --
	ha-514000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:50:51.214522   95125 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:50:51.214785   95125 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:51.214791   95125 out.go:304] Setting ErrFile to fd 2...
	I0304 17:50:51.214795   95125 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:51.214968   95125 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:50:51.215775   95125 out.go:298] Setting JSON to false
	I0304 17:50:51.215812   95125 mustload.go:65] Loading cluster: ha-514000
	I0304 17:50:51.216056   95125 notify.go:220] Checking for updates...
	I0304 17:50:51.216289   95125 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:50:51.216314   95125 status.go:255] checking status of ha-514000 ...
	I0304 17:50:51.216634   95125 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:50:51.216677   95125 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:50:51.224841   95125 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63648
	I0304 17:50:51.225152   95125 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:50:51.225576   95125 main.go:141] libmachine: Using API Version  1
	I0304 17:50:51.225587   95125 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:50:51.225812   95125 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:50:51.225914   95125 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:50:51.226003   95125 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:50:51.226048   95125 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:50:51.226076   95125 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:50:51.226094   95125 status.go:330] ha-514000 host status = "Stopped" (err=<nil>)
	I0304 17:50:51.226106   95125 status.go:343] host is not running, skipping remaining checks
	I0304 17:50:51.226112   95125 status.go:257] ha-514000 status: &{Name:ha-514000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr: exit status 7 (77.41241ms)

                                                
                                                
-- stdout --
	ha-514000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:50:57.390473   95143 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:50:57.390679   95143 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:57.390685   95143 out.go:304] Setting ErrFile to fd 2...
	I0304 17:50:57.390689   95143 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:50:57.390887   95143 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:50:57.391087   95143 out.go:298] Setting JSON to false
	I0304 17:50:57.391113   95143 mustload.go:65] Loading cluster: ha-514000
	I0304 17:50:57.391156   95143 notify.go:220] Checking for updates...
	I0304 17:50:57.392343   95143 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:50:57.392364   95143 status.go:255] checking status of ha-514000 ...
	I0304 17:50:57.392740   95143 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:50:57.392775   95143 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:50:57.401119   95143 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63651
	I0304 17:50:57.401489   95143 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:50:57.401938   95143 main.go:141] libmachine: Using API Version  1
	I0304 17:50:57.401950   95143 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:50:57.402143   95143 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:50:57.402243   95143 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:50:57.402319   95143 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:50:57.402391   95143 status.go:330] ha-514000 host status = "Stopped" (err=<nil>)
	I0304 17:50:57.402384   95143 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:50:57.402402   95143 status.go:343] host is not running, skipping remaining checks
	I0304 17:50:57.402414   95143 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:50:57.402410   95143 status.go:257] ha-514000 status: &{Name:ha-514000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr: exit status 7 (76.132155ms)

                                                
                                                
-- stdout --
	ha-514000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:51:01.810680   95146 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:51:01.810944   95146 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:01.810949   95146 out.go:304] Setting ErrFile to fd 2...
	I0304 17:51:01.810953   95146 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:01.811125   95146 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:51:01.811308   95146 out.go:298] Setting JSON to false
	I0304 17:51:01.811334   95146 mustload.go:65] Loading cluster: ha-514000
	I0304 17:51:01.811381   95146 notify.go:220] Checking for updates...
	I0304 17:51:01.811647   95146 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:51:01.811672   95146 status.go:255] checking status of ha-514000 ...
	I0304 17:51:01.812058   95146 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:01.812129   95146 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:51:01.820600   95146 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63654
	I0304 17:51:01.820938   95146 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:51:01.821411   95146 main.go:141] libmachine: Using API Version  1
	I0304 17:51:01.821422   95146 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:51:01.821682   95146 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:51:01.821803   95146 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:51:01.821899   95146 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:01.821922   95146 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:51:01.821934   95146 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:51:01.821941   95146 status.go:330] ha-514000 host status = "Stopped" (err=<nil>)
	I0304 17:51:01.821951   95146 status.go:343] host is not running, skipping remaining checks
	I0304 17:51:01.821957   95146 status.go:257] ha-514000 status: &{Name:ha-514000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr: exit status 7 (75.576476ms)

                                                
                                                
-- stdout --
	ha-514000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:51:18.494268   95156 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:51:18.494470   95156 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:18.494476   95156 out.go:304] Setting ErrFile to fd 2...
	I0304 17:51:18.494479   95156 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:18.494679   95156 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:51:18.494871   95156 out.go:298] Setting JSON to false
	I0304 17:51:18.494893   95156 mustload.go:65] Loading cluster: ha-514000
	I0304 17:51:18.494934   95156 notify.go:220] Checking for updates...
	I0304 17:51:18.495153   95156 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:51:18.495171   95156 status.go:255] checking status of ha-514000 ...
	I0304 17:51:18.495514   95156 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:18.495571   95156 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:51:18.503935   95156 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63657
	I0304 17:51:18.504273   95156 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:51:18.504692   95156 main.go:141] libmachine: Using API Version  1
	I0304 17:51:18.504705   95156 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:51:18.504953   95156 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:51:18.505076   95156 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:51:18.505178   95156 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:18.505200   95156 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:51:18.505208   95156 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:51:18.505253   95156 status.go:330] ha-514000 host status = "Stopped" (err=<nil>)
	I0304 17:51:18.505265   95156 status.go:343] host is not running, skipping remaining checks
	I0304 17:51:18.505272   95156 status.go:257] ha-514000 status: &{Name:ha-514000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr: exit status 7 (75.948814ms)

                                                
                                                
-- stdout --
	ha-514000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:51:30.532545   95164 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:51:30.533317   95164 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:30.533347   95164 out.go:304] Setting ErrFile to fd 2...
	I0304 17:51:30.533361   95164 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:30.533777   95164 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:51:30.533993   95164 out.go:298] Setting JSON to false
	I0304 17:51:30.534015   95164 mustload.go:65] Loading cluster: ha-514000
	I0304 17:51:30.534053   95164 notify.go:220] Checking for updates...
	I0304 17:51:30.534294   95164 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:51:30.534311   95164 status.go:255] checking status of ha-514000 ...
	I0304 17:51:30.534658   95164 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:30.534704   95164 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:51:30.543579   95164 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63660
	I0304 17:51:30.543963   95164 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:51:30.544429   95164 main.go:141] libmachine: Using API Version  1
	I0304 17:51:30.544442   95164 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:51:30.544628   95164 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:51:30.544731   95164 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:51:30.544812   95164 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:30.544822   95164 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:51:30.544834   95164 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:51:30.544882   95164 status.go:330] ha-514000 host status = "Stopped" (err=<nil>)
	I0304 17:51:30.544895   95164 status.go:343] host is not running, skipping remaining checks
	I0304 17:51:30.544901   95164 status.go:257] ha-514000 status: &{Name:ha-514000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:432: failed to run minikube status. args "out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (75.005671ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/RestartSecondaryNode (45.53s)

                                                
                                    
x
+
TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:304: expected profile "ha-514000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-514000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-514000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServe
rPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-514000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4\",\"Containe
rRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\"
:false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
ha_test.go:307: expected profile "ha-514000" in json of 'profile list' to have "HAppy" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-514000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-514000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-514000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4
\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000000
0},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (74.502672ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/RestartClusterKeepsNodes (9.72s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:456: (dbg) Run:  out/minikube-darwin-amd64 node list -p ha-514000 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Run:  out/minikube-darwin-amd64 stop -p ha-514000 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Done: out/minikube-darwin-amd64 stop -p ha-514000 -v=7 --alsologtostderr: (3.675181922s)
ha_test.go:467: (dbg) Run:  out/minikube-darwin-amd64 start -p ha-514000 --wait=true -v=7 --alsologtostderr
ha_test.go:467: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ha-514000 --wait=true -v=7 --alsologtostderr: exit status 60 (5.841634739s)

                                                
                                                
-- stdout --
	* [ha-514000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "ha-514000" primary control-plane node in "ha-514000" cluster
	* Restarting existing hyperkit VM for "ha-514000" ...
	* Restarting existing hyperkit VM for "ha-514000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:51:34.644936   95203 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:51:34.645204   95203 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:34.645209   95203 out.go:304] Setting ErrFile to fd 2...
	I0304 17:51:34.645213   95203 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:34.645389   95203 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:51:34.646781   95203 out.go:298] Setting JSON to false
	I0304 17:51:34.670843   95203 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24663,"bootTime":1709578831,"procs":494,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:51:34.670938   95203 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:51:34.692084   95203 out.go:177] * [ha-514000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:51:34.734008   95203 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:51:34.734083   95203 notify.go:220] Checking for updates...
	I0304 17:51:34.755868   95203 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:51:34.797846   95203 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:51:34.818781   95203 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:51:34.860728   95203 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:51:34.881981   95203 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:51:34.903307   95203 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:51:34.903481   95203 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:51:34.904130   95203 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:34.904209   95203 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:51:34.913140   95203 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63683
	I0304 17:51:34.913512   95203 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:51:34.913956   95203 main.go:141] libmachine: Using API Version  1
	I0304 17:51:34.913972   95203 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:51:34.914244   95203 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:51:34.914345   95203 main.go:141] libmachine: (ha-514000) Calling .DriverName
	I0304 17:51:34.942699   95203 out.go:177] * Using the hyperkit driver based on existing profile
	I0304 17:51:34.984549   95203 start.go:297] selected driver: hyperkit
	I0304 17:51:34.984577   95203 start.go:901] validating driver "hyperkit" against &{Name:ha-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-514000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:51:34.984779   95203 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:51:34.984991   95203 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:51:34.985217   95203 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:51:34.994329   95203 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:51:34.998265   95203 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:34.998288   95203 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0304 17:51:35.000982   95203 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 17:51:35.001048   95203 cni.go:84] Creating CNI manager for ""
	I0304 17:51:35.001057   95203 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0304 17:51:35.001132   95203 start.go:340] cluster config:
	{Name:ha-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-514000 Namespace:default APIServerHAVIP: APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:51:35.001213   95203 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:51:35.022714   95203 out.go:177] * Starting "ha-514000" primary control-plane node in "ha-514000" cluster
	I0304 17:51:35.043932   95203 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:51:35.044005   95203 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:51:35.044034   95203 cache.go:56] Caching tarball of preloaded images
	I0304 17:51:35.044215   95203 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:51:35.044234   95203 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 17:51:35.044388   95203 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/ha-514000/config.json ...
	I0304 17:51:35.045205   95203 start.go:360] acquireMachinesLock for ha-514000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:51:35.045326   95203 start.go:364] duration metric: took 97.683µs to acquireMachinesLock for "ha-514000"
	I0304 17:51:35.045361   95203 start.go:96] Skipping create...Using existing machine configuration
	I0304 17:51:35.045380   95203 fix.go:54] fixHost starting: 
	I0304 17:51:35.045789   95203 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:35.045827   95203 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:51:35.054471   95203 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63685
	I0304 17:51:35.054839   95203 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:51:35.055157   95203 main.go:141] libmachine: Using API Version  1
	I0304 17:51:35.055173   95203 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:51:35.055395   95203 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:51:35.055514   95203 main.go:141] libmachine: (ha-514000) Calling .DriverName
	I0304 17:51:35.055611   95203 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:51:35.055700   95203 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:35.055719   95203 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:51:35.055729   95203 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:51:35.055778   95203 fix.go:112] recreateIfNeeded on ha-514000: state=Stopped err=<nil>
	I0304 17:51:35.055834   95203 main.go:141] libmachine: (ha-514000) Calling .DriverName
	W0304 17:51:35.055928   95203 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 17:51:35.076746   95203 out.go:177] * Restarting existing hyperkit VM for "ha-514000" ...
	I0304 17:51:35.118818   95203 main.go:141] libmachine: (ha-514000) Calling .Start
	I0304 17:51:35.119108   95203 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:35.119176   95203 main.go:141] libmachine: (ha-514000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.pid
	I0304 17:51:35.119271   95203 main.go:141] libmachine: (ha-514000) DBG | Using UUID 6bbbf2a5-0e86-4f90-8ea0-83fd5d57a89f
	I0304 17:51:35.157221   95203 main.go:141] libmachine: (ha-514000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:51:35.157335   95203 fix.go:56] duration metric: took 111.957776ms for fixHost
	I0304 17:51:35.157345   95203 start.go:83] releasing machines lock for "ha-514000", held for 112.006559ms
	W0304 17:51:35.157359   95203 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0304 17:51:35.157421   95203 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:51:35.157428   95203 start.go:728] Will try again in 5 seconds ...
	I0304 17:51:40.158308   95203 start.go:360] acquireMachinesLock for ha-514000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:51:40.158471   95203 start.go:364] duration metric: took 133.872µs to acquireMachinesLock for "ha-514000"
	I0304 17:51:40.158497   95203 start.go:96] Skipping create...Using existing machine configuration
	I0304 17:51:40.158503   95203 fix.go:54] fixHost starting: 
	I0304 17:51:40.158809   95203 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:40.158838   95203 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:51:40.167266   95203 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63687
	I0304 17:51:40.167612   95203 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:51:40.167979   95203 main.go:141] libmachine: Using API Version  1
	I0304 17:51:40.167995   95203 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:51:40.168247   95203 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:51:40.168372   95203 main.go:141] libmachine: (ha-514000) Calling .DriverName
	I0304 17:51:40.168463   95203 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:51:40.168560   95203 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:40.168571   95203 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:51:40.168581   95203 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:51:40.168604   95203 fix.go:112] recreateIfNeeded on ha-514000: state=Stopped err=<nil>
	I0304 17:51:40.168614   95203 main.go:141] libmachine: (ha-514000) Calling .DriverName
	W0304 17:51:40.168700   95203 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 17:51:40.210934   95203 out.go:177] * Restarting existing hyperkit VM for "ha-514000" ...
	I0304 17:51:40.233867   95203 main.go:141] libmachine: (ha-514000) Calling .Start
	I0304 17:51:40.234114   95203 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:40.234195   95203 main.go:141] libmachine: (ha-514000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.pid
	I0304 17:51:40.234303   95203 main.go:141] libmachine: (ha-514000) DBG | Using UUID 6bbbf2a5-0e86-4f90-8ea0-83fd5d57a89f
	I0304 17:51:40.236674   95203 main.go:141] libmachine: (ha-514000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:51:40.236750   95203 fix.go:56] duration metric: took 78.244792ms for fixHost
	I0304 17:51:40.236762   95203 start.go:83] releasing machines lock for "ha-514000", held for 78.279899ms
	W0304 17:51:40.236836   95203 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p ha-514000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p ha-514000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:51:40.278955   95203 out.go:177] 
	W0304 17:51:40.299827   95203 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:51:40.299928   95203 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:51:40.299962   95203 out.go:239] * Related issues:
	* Related issues:
	W0304 17:51:40.300043   95203 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:51:40.300147   95203 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:51:40.341985   95203 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:469: failed to run minikube start. args "out/minikube-darwin-amd64 node list -p ha-514000 -v=7 --alsologtostderr" : exit status 60
ha_test.go:472: (dbg) Run:  out/minikube-darwin-amd64 node list -p ha-514000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (75.369177ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/RestartClusterKeepsNodes (9.72s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DeleteSecondaryNode (0.29s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DeleteSecondaryNode
ha_test.go:487: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 node delete m03 -v=7 --alsologtostderr
ha_test.go:487: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 node delete m03 -v=7 --alsologtostderr: exit status 83 (140.839783ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-514000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-514000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:51:40.629972   95230 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:51:40.630881   95230 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:40.630888   95230 out.go:304] Setting ErrFile to fd 2...
	I0304 17:51:40.630892   95230 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:40.631078   95230 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:51:40.631393   95230 mustload.go:65] Loading cluster: ha-514000
	I0304 17:51:40.631652   95230 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:51:40.631988   95230 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:40.632032   95230 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:51:40.639697   95230 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63692
	I0304 17:51:40.640078   95230 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:51:40.640501   95230 main.go:141] libmachine: Using API Version  1
	I0304 17:51:40.640511   95230 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:51:40.640746   95230 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:51:40.640868   95230 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:51:40.640968   95230 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:40.640985   95230 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:51:40.641017   95230 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:51:40.662386   95230 out.go:177] * The control-plane node ha-514000 host is not running: state=Stopped
	I0304 17:51:40.683430   95230 out.go:177]   To start a cluster, run: "minikube start -p ha-514000"

                                                
                                                
** /stderr **
ha_test.go:489: node delete returned an error. args "out/minikube-darwin-amd64 -p ha-514000 node delete m03 -v=7 --alsologtostderr": exit status 83
ha_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr
ha_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr: exit status 7 (75.694878ms)

                                                
                                                
-- stdout --
	ha-514000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:51:40.772061   95233 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:51:40.772325   95233 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:40.772331   95233 out.go:304] Setting ErrFile to fd 2...
	I0304 17:51:40.772334   95233 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:40.772510   95233 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:51:40.772688   95233 out.go:298] Setting JSON to false
	I0304 17:51:40.772709   95233 mustload.go:65] Loading cluster: ha-514000
	I0304 17:51:40.772747   95233 notify.go:220] Checking for updates...
	I0304 17:51:40.772978   95233 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:51:40.772995   95233 status.go:255] checking status of ha-514000 ...
	I0304 17:51:40.773363   95233 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:40.773423   95233 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:51:40.781783   95233 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63695
	I0304 17:51:40.782136   95233 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:51:40.782588   95233 main.go:141] libmachine: Using API Version  1
	I0304 17:51:40.782604   95233 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:51:40.782787   95233 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:51:40.782881   95233 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:51:40.782967   95233 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:40.783010   95233 status.go:330] ha-514000 host status = "Stopped" (err=<nil>)
	I0304 17:51:40.783019   95233 status.go:343] host is not running, skipping remaining checks
	I0304 17:51:40.783017   95233 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:51:40.783033   95233 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:51:40.783026   95233 status.go:257] ha-514000 status: &{Name:ha-514000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:495: failed to run minikube status. args "out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (74.798011ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DeleteSecondaryNode (0.29s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:390: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:413: expected profile "ha-514000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-514000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-514000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACoun
t\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-514000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.2
8.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000
0000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (75.32399ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/StopCluster (2.29s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/StopCluster
ha_test.go:531: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 stop -v=7 --alsologtostderr
ha_test.go:531: (dbg) Done: out/minikube-darwin-amd64 -p ha-514000 stop -v=7 --alsologtostderr: (2.136815922s)
ha_test.go:537: (dbg) Run:  out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr
ha_test.go:537: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr: exit status 7 (75.978031ms)

                                                
                                                
-- stdout --
	ha-514000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:51:43.282220   95260 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:51:43.282491   95260 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:43.282497   95260 out.go:304] Setting ErrFile to fd 2...
	I0304 17:51:43.282500   95260 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:43.282676   95260 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:51:43.282853   95260 out.go:298] Setting JSON to false
	I0304 17:51:43.282875   95260 mustload.go:65] Loading cluster: ha-514000
	I0304 17:51:43.282912   95260 notify.go:220] Checking for updates...
	I0304 17:51:43.283130   95260 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:51:43.283147   95260 status.go:255] checking status of ha-514000 ...
	I0304 17:51:43.283502   95260 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:43.283560   95260 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:51:43.291874   95260 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63714
	I0304 17:51:43.292210   95260 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:51:43.292697   95260 main.go:141] libmachine: Using API Version  1
	I0304 17:51:43.292713   95260 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:51:43.292909   95260 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:51:43.293016   95260 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:51:43.293092   95260 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:43.293112   95260 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:51:43.293121   95260 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:51:43.293150   95260 status.go:330] ha-514000 host status = "Stopped" (err=<nil>)
	I0304 17:51:43.293162   95260 status.go:343] host is not running, skipping remaining checks
	I0304 17:51:43.293168   95260 status.go:257] ha-514000 status: &{Name:ha-514000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:543: status says not two control-plane nodes are present: args "out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr": ha-514000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:549: status says not three kubelets are stopped: args "out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr": ha-514000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:552: status says not two apiservers are stopped: args "out/minikube-darwin-amd64 -p ha-514000 status -v=7 --alsologtostderr": ha-514000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (74.801641ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/StopCluster (2.29s)

                                                
                                    
x
+
TestMutliControlPlane/serial/RestartCluster (5.88s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/RestartCluster
ha_test.go:560: (dbg) Run:  out/minikube-darwin-amd64 start -p ha-514000 --wait=true -v=7 --alsologtostderr --driver=hyperkit 
ha_test.go:560: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ha-514000 --wait=true -v=7 --alsologtostderr --driver=hyperkit : exit status 60 (5.80388345s)

                                                
                                                
-- stdout --
	* [ha-514000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "ha-514000" primary control-plane node in "ha-514000" cluster
	* Restarting existing hyperkit VM for "ha-514000" ...
	* Restarting existing hyperkit VM for "ha-514000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:51:43.430746   95266 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:51:43.430903   95266 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:43.430913   95266 out.go:304] Setting ErrFile to fd 2...
	I0304 17:51:43.430917   95266 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:43.431100   95266 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:51:43.432488   95266 out.go:298] Setting JSON to false
	I0304 17:51:43.455965   95266 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24672,"bootTime":1709578831,"procs":497,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:51:43.456049   95266 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:51:43.477971   95266 out.go:177] * [ha-514000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:51:43.520571   95266 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:51:43.520606   95266 notify.go:220] Checking for updates...
	I0304 17:51:43.563589   95266 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:51:43.584567   95266 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:51:43.605747   95266 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:51:43.626716   95266 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:51:43.647701   95266 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:51:43.671155   95266 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:51:43.671684   95266 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:43.671753   95266 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:51:43.680324   95266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63720
	I0304 17:51:43.680733   95266 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:51:43.681198   95266 main.go:141] libmachine: Using API Version  1
	I0304 17:51:43.681209   95266 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:51:43.681423   95266 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:51:43.681530   95266 main.go:141] libmachine: (ha-514000) Calling .DriverName
	I0304 17:51:43.681708   95266 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:51:43.681942   95266 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:43.681965   95266 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:51:43.689709   95266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63722
	I0304 17:51:43.690024   95266 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:51:43.690388   95266 main.go:141] libmachine: Using API Version  1
	I0304 17:51:43.690402   95266 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:51:43.690614   95266 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:51:43.690721   95266 main.go:141] libmachine: (ha-514000) Calling .DriverName
	I0304 17:51:43.719799   95266 out.go:177] * Using the hyperkit driver based on existing profile
	I0304 17:51:43.761640   95266 start.go:297] selected driver: hyperkit
	I0304 17:51:43.761664   95266 start.go:901] validating driver "hyperkit" against &{Name:ha-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-514000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:51:43.761853   95266 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:51:43.762064   95266 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:51:43.762220   95266 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:51:43.771514   95266 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:51:43.775326   95266 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:43.775348   95266 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0304 17:51:43.777975   95266 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 17:51:43.778038   95266 cni.go:84] Creating CNI manager for ""
	I0304 17:51:43.778047   95266 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0304 17:51:43.778129   95266 start.go:340] cluster config:
	{Name:ha-514000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-514000 Namespace:default APIServerHAVIP: APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:51:43.778230   95266 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:51:43.821485   95266 out.go:177] * Starting "ha-514000" primary control-plane node in "ha-514000" cluster
	I0304 17:51:43.842900   95266 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:51:43.842970   95266 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:51:43.842995   95266 cache.go:56] Caching tarball of preloaded images
	I0304 17:51:43.843155   95266 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:51:43.843172   95266 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 17:51:43.843306   95266 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/ha-514000/config.json ...
	I0304 17:51:43.844177   95266 start.go:360] acquireMachinesLock for ha-514000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:51:43.844272   95266 start.go:364] duration metric: took 70.151µs to acquireMachinesLock for "ha-514000"
	I0304 17:51:43.844305   95266 start.go:96] Skipping create...Using existing machine configuration
	I0304 17:51:43.844320   95266 fix.go:54] fixHost starting: 
	I0304 17:51:43.844748   95266 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:43.844790   95266 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:51:43.853388   95266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63724
	I0304 17:51:43.853765   95266 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:51:43.854097   95266 main.go:141] libmachine: Using API Version  1
	I0304 17:51:43.854106   95266 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:51:43.854320   95266 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:51:43.854433   95266 main.go:141] libmachine: (ha-514000) Calling .DriverName
	I0304 17:51:43.854523   95266 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:51:43.854601   95266 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:43.854620   95266 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:51:43.854635   95266 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:51:43.854669   95266 fix.go:112] recreateIfNeeded on ha-514000: state=Stopped err=<nil>
	I0304 17:51:43.854695   95266 main.go:141] libmachine: (ha-514000) Calling .DriverName
	W0304 17:51:43.854766   95266 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 17:51:43.897534   95266 out.go:177] * Restarting existing hyperkit VM for "ha-514000" ...
	I0304 17:51:43.918810   95266 main.go:141] libmachine: (ha-514000) Calling .Start
	I0304 17:51:43.919097   95266 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:43.919203   95266 main.go:141] libmachine: (ha-514000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.pid
	I0304 17:51:43.919260   95266 main.go:141] libmachine: (ha-514000) DBG | Using UUID 6bbbf2a5-0e86-4f90-8ea0-83fd5d57a89f
	I0304 17:51:43.921667   95266 main.go:141] libmachine: (ha-514000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:51:43.921767   95266 fix.go:56] duration metric: took 77.449825ms for fixHost
	I0304 17:51:43.921776   95266 start.go:83] releasing machines lock for "ha-514000", held for 77.493365ms
	W0304 17:51:43.921791   95266 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0304 17:51:43.921859   95266 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:51:43.921866   95266 start.go:728] Will try again in 5 seconds ...
	I0304 17:51:48.922272   95266 start.go:360] acquireMachinesLock for ha-514000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:51:48.922466   95266 start.go:364] duration metric: took 161.815µs to acquireMachinesLock for "ha-514000"
	I0304 17:51:48.922494   95266 start.go:96] Skipping create...Using existing machine configuration
	I0304 17:51:48.922501   95266 fix.go:54] fixHost starting: 
	I0304 17:51:48.922849   95266 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:48.922882   95266 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:51:48.931736   95266 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63726
	I0304 17:51:48.932113   95266 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:51:48.932472   95266 main.go:141] libmachine: Using API Version  1
	I0304 17:51:48.932486   95266 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:51:48.932701   95266 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:51:48.932815   95266 main.go:141] libmachine: (ha-514000) Calling .DriverName
	I0304 17:51:48.932902   95266 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:51:48.932985   95266 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:48.933034   95266 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:51:48.933042   95266 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:51:48.933057   95266 fix.go:112] recreateIfNeeded on ha-514000: state=Stopped err=<nil>
	I0304 17:51:48.933076   95266 main.go:141] libmachine: (ha-514000) Calling .DriverName
	W0304 17:51:48.933162   95266 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 17:51:48.976704   95266 out.go:177] * Restarting existing hyperkit VM for "ha-514000" ...
	I0304 17:51:49.003518   95266 main.go:141] libmachine: (ha-514000) Calling .Start
	I0304 17:51:49.003798   95266 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:49.003847   95266 main.go:141] libmachine: (ha-514000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.pid
	I0304 17:51:49.003921   95266 main.go:141] libmachine: (ha-514000) DBG | Using UUID 6bbbf2a5-0e86-4f90-8ea0-83fd5d57a89f
	I0304 17:51:49.006167   95266 main.go:141] libmachine: (ha-514000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:51:49.006276   95266 fix.go:56] duration metric: took 83.773469ms for fixHost
	I0304 17:51:49.006286   95266 start.go:83] releasing machines lock for "ha-514000", held for 83.808947ms
	W0304 17:51:49.006345   95266 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p ha-514000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p ha-514000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:51:49.048172   95266 out.go:177] 
	W0304 17:51:49.069269   95266 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:51:49.069325   95266 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:51:49.069348   95266 out.go:239] * Related issues:
	* Related issues:
	W0304 17:51:49.069377   95266 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:51:49.069406   95266 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:51:49.090117   95266 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:562: failed to start cluster. args "out/minikube-darwin-amd64 start -p ha-514000 --wait=true -v=7 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (75.341311ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/RestartCluster (5.88s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DegradedAfterClusterRestart (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:390: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:413: expected profile "ha-514000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-514000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-514000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACoun
t\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-514000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.2
8.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000
0000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (75.260397ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DegradedAfterClusterRestart (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/AddSecondaryNode (0.24s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/AddSecondaryNode
ha_test.go:605: (dbg) Run:  out/minikube-darwin-amd64 node add -p ha-514000 --control-plane -v=7 --alsologtostderr
ha_test.go:605: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p ha-514000 --control-plane -v=7 --alsologtostderr: exit status 83 (159.649315ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-514000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-514000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:51:49.535961   95294 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:51:49.536226   95294 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:49.536232   95294 out.go:304] Setting ErrFile to fd 2...
	I0304 17:51:49.536235   95294 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:51:49.536407   95294 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:51:49.536741   95294 mustload.go:65] Loading cluster: ha-514000
	I0304 17:51:49.537001   95294 config.go:182] Loaded profile config "ha-514000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:51:49.537341   95294 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:51:49.537384   95294 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:51:49.545038   95294 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63737
	I0304 17:51:49.545421   95294 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:51:49.545852   95294 main.go:141] libmachine: Using API Version  1
	I0304 17:51:49.545868   95294 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:51:49.546142   95294 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:51:49.546260   95294 main.go:141] libmachine: (ha-514000) Calling .GetState
	I0304 17:51:49.546353   95294 main.go:141] libmachine: (ha-514000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:51:49.546383   95294 main.go:141] libmachine: (ha-514000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/ha-514000/hyperkit.json: no such file or directory
	I0304 17:51:49.546392   95294 main.go:141] libmachine: (ha-514000) DBG | hyperkit pid from json: 0
	I0304 17:51:49.567893   95294 out.go:177] * The control-plane node ha-514000 host is not running: state=Stopped
	I0304 17:51:49.609820   95294 out.go:177]   To start a cluster, run: "minikube start -p ha-514000"

                                                
                                                
** /stderr **
ha_test.go:607: failed to add control-plane node to current ha (multi-control plane) cluster. args "out/minikube-darwin-amd64 node add -p ha-514000 --control-plane -v=7 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (75.495314ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/AddSecondaryNode (0.24s)

                                                
                                    
x
+
TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:304: expected profile "ha-514000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-514000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-514000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServe
rPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-514000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4\",\"Containe
rRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\"
:false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
ha_test.go:307: expected profile "ha-514000" in json of 'profile list' to have "HAppy" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-514000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-514000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-514000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4
\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000000
0},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-514000 -n ha-514000: exit status 7 (75.212504ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-514000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.22s)

                                                
                                    
x
+
TestImageBuild/serial/Setup (11.35s)

                                                
                                                
=== RUN   TestImageBuild/serial/Setup
image_test.go:69: (dbg) Run:  out/minikube-darwin-amd64 start -p image-413000 --driver=hyperkit 
image_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p image-413000 --driver=hyperkit : exit status 60 (11.272702701s)

                                                
                                                
-- stdout --
	* [image-413000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "image-413000" primary control-plane node in "image-413000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "image-413000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p image-413000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
image_test.go:70: failed to start minikube with args: "out/minikube-darwin-amd64 start -p image-413000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p image-413000 -n image-413000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p image-413000 -n image-413000: exit status 7 (75.941242ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "image-413000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestImageBuild/serial/Setup (11.35s)

                                                
                                    
x
+
TestJSONOutput/start/Command (11.07s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 start -p json-output-885000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit 
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p json-output-885000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit : exit status 60 (11.072002068s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"66677add-bff6-481a-ac1f-7c1107f8242f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-885000] minikube v1.32.0 on Darwin 14.3.1","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"dc1eaa88-cc01-417b-98eb-69711f07300b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17909"}}
	{"specversion":"1.0","id":"55652a6a-cf0e-48de-a4de-add3bf81b6ca","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig"}}
	{"specversion":"1.0","id":"bee0f0a6-89d1-40e3-9b05-5ff54cbeb99b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-amd64"}}
	{"specversion":"1.0","id":"b3feeadf-83a0-481e-aae6-025887ee74fb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"63c2bc81-cd35-4e54-b52b-c773a8bc38b1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube"}}
	{"specversion":"1.0","id":"a3e8acf1-40fa-4946-ad16-18b2b108c6bb","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"d9d69aca-c979-4272-ab89-3be60c3240d1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the hyperkit driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"f4b6d311-931f-4242-9275-482f1c0d214d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"json-output-885000\" primary control-plane node in \"json-output-885000\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"b843dae1-7ceb-44c1-98a2-ee13f96e1069","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"321267e4-bfcd-4d8b-833d-4ed3e8f858ce","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Deleting \"json-output-885000\" in hyperkit ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"ad7334b2-a5e7-44f3-83a5-7358849f3c27","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"}}
	{"specversion":"1.0","id":"90e2f6d8-6fae-4c4f-a58c-cfc05526c811","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"7f2e538f-34e6-434b-ab4b-546cf80112d5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"Failed to start hyperkit VM. Running \"minikube delete -p json-output-885000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"}}
	{"specversion":"1.0","id":"1cee7ed4-05fe-485d-a430-1c63b5ade66d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.","exitcode":"60","issues":"https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594","message":"Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1","name":"PR_HYPERKIT_VMNET_FRAMEWORK","url":""}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 start -p json-output-885000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit ": exit status 60
--- FAIL: TestJSONOutput/start/Command (11.07s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
json_output_test.go:114: step 9 has already been assigned to another step:
Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
Cannot use for:
Deleting "json-output-885000" in hyperkit ...
[Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 66677add-bff6-481a-ac1f-7c1107f8242f
datacontenttype: application/json
Data,
{
"currentstep": "0",
"message": "[json-output-885000] minikube v1.32.0 on Darwin 14.3.1",
"name": "Initial Minikube Setup",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: dc1eaa88-cc01-417b-98eb-69711f07300b
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_LOCATION=17909"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 55652a6a-cf0e-48de-a4de-add3bf81b6ca
datacontenttype: application/json
Data,
{
"message": "KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: bee0f0a6-89d1-40e3-9b05-5ff54cbeb99b
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_BIN=out/minikube-darwin-amd64"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: b3feeadf-83a0-481e-aae6-025887ee74fb
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 63c2bc81-cd35-4e54-b52b-c773a8bc38b1
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: a3e8acf1-40fa-4946-ad16-18b2b108c6bb
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_FORCE_SYSTEMD="
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: d9d69aca-c979-4272-ab89-3be60c3240d1
datacontenttype: application/json
Data,
{
"currentstep": "1",
"message": "Using the hyperkit driver based on user configuration",
"name": "Selecting Driver",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: f4b6d311-931f-4242-9275-482f1c0d214d
datacontenttype: application/json
Data,
{
"currentstep": "3",
"message": "Starting \"json-output-885000\" primary control-plane node in \"json-output-885000\" cluster",
"name": "Starting Node",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: b843dae1-7ceb-44c1-98a2-ee13f96e1069
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 321267e4-bfcd-4d8b-833d-4ed3e8f858ce
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Deleting \"json-output-885000\" in hyperkit ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: ad7334b2-a5e7-44f3-83a5-7358849f3c27
datacontenttype: application/json
Data,
{
"message": "StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 90e2f6d8-6fae-4c4f-a58c-cfc05526c811
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 7f2e538f-34e6-434b-ab4b-546cf80112d5
datacontenttype: application/json
Data,
{
"message": "Failed to start hyperkit VM. Running \"minikube delete -p json-output-885000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 1cee7ed4-05fe-485d-a430-1c63b5ade66d
datacontenttype: application/json
Data,
{
"advice": "Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.",
"exitcode": "60",
"issues": "https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594",
"message": "Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1",
"name": "PR_HYPERKIT_VMNET_FRAMEWORK",
"url": ""
}
]
--- FAIL: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
json_output_test.go:144: current step is not in increasing order: [Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 66677add-bff6-481a-ac1f-7c1107f8242f
datacontenttype: application/json
Data,
{
"currentstep": "0",
"message": "[json-output-885000] minikube v1.32.0 on Darwin 14.3.1",
"name": "Initial Minikube Setup",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: dc1eaa88-cc01-417b-98eb-69711f07300b
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_LOCATION=17909"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 55652a6a-cf0e-48de-a4de-add3bf81b6ca
datacontenttype: application/json
Data,
{
"message": "KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: bee0f0a6-89d1-40e3-9b05-5ff54cbeb99b
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_BIN=out/minikube-darwin-amd64"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: b3feeadf-83a0-481e-aae6-025887ee74fb
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 63c2bc81-cd35-4e54-b52b-c773a8bc38b1
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: a3e8acf1-40fa-4946-ad16-18b2b108c6bb
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_FORCE_SYSTEMD="
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: d9d69aca-c979-4272-ab89-3be60c3240d1
datacontenttype: application/json
Data,
{
"currentstep": "1",
"message": "Using the hyperkit driver based on user configuration",
"name": "Selecting Driver",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: f4b6d311-931f-4242-9275-482f1c0d214d
datacontenttype: application/json
Data,
{
"currentstep": "3",
"message": "Starting \"json-output-885000\" primary control-plane node in \"json-output-885000\" cluster",
"name": "Starting Node",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: b843dae1-7ceb-44c1-98a2-ee13f96e1069
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 321267e4-bfcd-4d8b-833d-4ed3e8f858ce
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Deleting \"json-output-885000\" in hyperkit ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: ad7334b2-a5e7-44f3-83a5-7358849f3c27
datacontenttype: application/json
Data,
{
"message": "StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 90e2f6d8-6fae-4c4f-a58c-cfc05526c811
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 7f2e538f-34e6-434b-ab4b-546cf80112d5
datacontenttype: application/json
Data,
{
"message": "Failed to start hyperkit VM. Running \"minikube delete -p json-output-885000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 1cee7ed4-05fe-485d-a430-1c63b5ade66d
datacontenttype: application/json
Data,
{
"advice": "Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.",
"exitcode": "60",
"issues": "https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594",
"message": "Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1",
"name": "PR_HYPERKIT_VMNET_FRAMEWORK",
"url": ""
}
]
--- FAIL: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.14s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 pause -p json-output-885000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p json-output-885000 --output=json --user=testUser: exit status 83 (140.68436ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"4fa71b78-9669-4f8f-80f1-c0b6b3a0f98b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"The control-plane node json-output-885000 host is not running: state=Stopped"}}
	{"specversion":"1.0","id":"4fce9b81-585d-41b7-8544-14fc2a92b7dc","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"To start a cluster, run: \"minikube start -p json-output-885000\""}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 pause -p json-output-885000 --output=json --user=testUser": exit status 83
--- FAIL: TestJSONOutput/pause/Command (0.14s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.14s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 unpause -p json-output-885000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 unpause -p json-output-885000 --output=json --user=testUser: exit status 83 (140.450147ms)

                                                
                                                
-- stdout --
	* The control-plane node json-output-885000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p json-output-885000"

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 unpause -p json-output-885000 --output=json --user=testUser": exit status 83
json_output_test.go:213: unable to marshal output: * The control-plane node json-output-885000 host is not running: state=Stopped
json_output_test.go:70: converting to cloud events: invalid character '*' looking for beginning of value
--- FAIL: TestJSONOutput/unpause/Command (0.14s)

                                                
                                    
x
+
TestMinikubeProfile (12.13s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-amd64 start -p first-455000 --driver=hyperkit 
E0304 17:52:26.235972   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
minikube_profile_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p first-455000 --driver=hyperkit : exit status 60 (11.268390518s)

                                                
                                                
-- stdout --
	* [first-455000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "first-455000" primary control-plane node in "first-455000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "first-455000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p first-455000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
minikube_profile_test.go:46: test pre-condition failed. args "out/minikube-darwin-amd64 start -p first-455000 --driver=hyperkit ": exit status 60
panic.go:626: *** TestMinikubeProfile FAILED at 2024-03-04 17:52:29.251282 -0800 PST m=+947.954370616
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p second-458000 -n second-458000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p second-458000 -n second-458000: exit status 85 (130.65626ms)

                                                
                                                
-- stdout --
	* Profile "second-458000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p second-458000"

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 85 (may be ok)
helpers_test.go:241: "second-458000" host is not running, skipping log retrieval (state="* Profile \"second-458000\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p second-458000\"")
helpers_test.go:175: Cleaning up "second-458000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p second-458000
panic.go:626: *** TestMinikubeProfile FAILED at 2024-03-04 17:52:29.765698 -0800 PST m=+948.468780949
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p first-455000 -n first-455000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p first-455000 -n first-455000: exit status 7 (75.742338ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "first-455000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "first-455000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p first-455000
--- FAIL: TestMinikubeProfile (12.13s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (11.36s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-amd64 start -p mount-start-1-118000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit 
mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p mount-start-1-118000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit : exit status 60 (11.27888509s)

                                                
                                                
-- stdout --
	* [mount-start-1-118000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting minikube without Kubernetes in cluster mount-start-1-118000
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "mount-start-1-118000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p mount-start-1-118000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-amd64 start -p mount-start-1-118000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p mount-start-1-118000 -n mount-start-1-118000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p mount-start-1-118000 -n mount-start-1-118000: exit status 7 (76.081862ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "mount-start-1-118000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMountStart/serial/StartWithMountFirst (11.36s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (11.24s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-664000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit 
multinode_test.go:96: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-664000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit : exit status 60 (11.160859856s)

                                                
                                                
-- stdout --
	* [multinode-664000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "multinode-664000" primary control-plane node in "multinode-664000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "multinode-664000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:52:42.177370   95495 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:52:42.177626   95495 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:52:42.177632   95495 out.go:304] Setting ErrFile to fd 2...
	I0304 17:52:42.177636   95495 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:52:42.177810   95495 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:52:42.179190   95495 out.go:298] Setting JSON to false
	I0304 17:52:42.202252   95495 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24731,"bootTime":1709578831,"procs":489,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:52:42.202368   95495 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:52:42.224599   95495 out.go:177] * [multinode-664000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:52:42.266181   95495 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:52:42.266234   95495 notify.go:220] Checking for updates...
	I0304 17:52:42.308952   95495 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:52:42.330037   95495 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:52:42.351008   95495 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:52:42.372040   95495 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:52:42.393335   95495 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:52:42.414454   95495 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:52:42.443970   95495 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 17:52:42.486232   95495 start.go:297] selected driver: hyperkit
	I0304 17:52:42.486264   95495 start.go:901] validating driver "hyperkit" against <nil>
	I0304 17:52:42.486286   95495 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:52:42.490346   95495 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:52:42.490458   95495 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:52:42.498258   95495 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:52:42.502374   95495 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:52:42.502402   95495 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0304 17:52:42.502437   95495 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 17:52:42.502660   95495 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 17:52:42.502721   95495 cni.go:84] Creating CNI manager for ""
	I0304 17:52:42.502730   95495 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I0304 17:52:42.502736   95495 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0304 17:52:42.502808   95495 start.go:340] cluster config:
	{Name:multinode-664000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-664000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock:
SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:52:42.502891   95495 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:52:42.545051   95495 out.go:177] * Starting "multinode-664000" primary control-plane node in "multinode-664000" cluster
	I0304 17:52:42.566195   95495 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:52:42.566296   95495 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:52:42.566318   95495 cache.go:56] Caching tarball of preloaded images
	I0304 17:52:42.566550   95495 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:52:42.566565   95495 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 17:52:42.566964   95495 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/multinode-664000/config.json ...
	I0304 17:52:42.566998   95495 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/multinode-664000/config.json: {Name:mk55f667cb155ba68e8cf692396e4394c513d685 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 17:52:42.567555   95495 start.go:360] acquireMachinesLock for multinode-664000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:52:42.567642   95495 start.go:364] duration metric: took 69.588µs to acquireMachinesLock for "multinode-664000"
	I0304 17:52:42.567673   95495 start.go:93] Provisioning new machine with config: &{Name:multinode-664000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-664000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:52:42.567733   95495 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:52:42.588983   95495 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 17:52:42.589279   95495 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:52:42.589358   95495 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:52:42.598854   95495 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63833
	I0304 17:52:42.599202   95495 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:52:42.599643   95495 main.go:141] libmachine: Using API Version  1
	I0304 17:52:42.599653   95495 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:52:42.599880   95495 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:52:42.599987   95495 main.go:141] libmachine: (multinode-664000) Calling .GetMachineName
	I0304 17:52:42.600067   95495 main.go:141] libmachine: (multinode-664000) Calling .DriverName
	I0304 17:52:42.600161   95495 start.go:159] libmachine.API.Create for "multinode-664000" (driver="hyperkit")
	I0304 17:52:42.600188   95495 client.go:168] LocalClient.Create starting
	I0304 17:52:42.600223   95495 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:52:42.600276   95495 main.go:141] libmachine: Decoding PEM data...
	I0304 17:52:42.600293   95495 main.go:141] libmachine: Parsing certificate...
	I0304 17:52:42.600358   95495 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:52:42.600396   95495 main.go:141] libmachine: Decoding PEM data...
	I0304 17:52:42.600408   95495 main.go:141] libmachine: Parsing certificate...
	I0304 17:52:42.600428   95495 main.go:141] libmachine: Running pre-create checks...
	I0304 17:52:42.600436   95495 main.go:141] libmachine: (multinode-664000) Calling .PreCreateCheck
	I0304 17:52:42.600507   95495 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:52:42.600677   95495 main.go:141] libmachine: (multinode-664000) Calling .GetConfigRaw
	I0304 17:52:42.610440   95495 main.go:141] libmachine: Creating machine...
	I0304 17:52:42.610463   95495 main.go:141] libmachine: (multinode-664000) Calling .Create
	I0304 17:52:42.610695   95495 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:52:42.610944   95495 main.go:141] libmachine: (multinode-664000) DBG | I0304 17:52:42.610662   95503 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:52:42.611043   95495 main.go:141] libmachine: (multinode-664000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:52:42.787446   95495 main.go:141] libmachine: (multinode-664000) DBG | I0304 17:52:42.787342   95503 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/id_rsa...
	I0304 17:52:42.936821   95495 main.go:141] libmachine: (multinode-664000) DBG | I0304 17:52:42.936735   95503 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/multinode-664000.rawdisk...
	I0304 17:52:42.936839   95495 main.go:141] libmachine: (multinode-664000) DBG | Writing magic tar header
	I0304 17:52:42.936853   95495 main.go:141] libmachine: (multinode-664000) DBG | Writing SSH key tar header
	I0304 17:52:42.937563   95495 main.go:141] libmachine: (multinode-664000) DBG | I0304 17:52:42.937500   95503 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000 ...
	I0304 17:52:43.300738   95495 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:52:43.300775   95495 main.go:141] libmachine: (multinode-664000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.pid
	I0304 17:52:43.300873   95495 main.go:141] libmachine: (multinode-664000) DBG | Using UUID 9960b157-67f5-41d6-885d-dcf82b870d17
	I0304 17:52:43.336020   95495 main.go:141] libmachine: (multinode-664000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:52:43.336098   95495 client.go:171] duration metric: took 735.892249ms to LocalClient.Create
	I0304 17:52:45.336723   95495 start.go:128] duration metric: took 2.768919625s to createHost
	I0304 17:52:45.336752   95495 start.go:83] releasing machines lock for "multinode-664000", held for 2.769069724s
	W0304 17:52:45.336784   95495 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 17:52:45.337391   95495 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:52:45.337432   95495 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:52:45.346650   95495 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63835
	I0304 17:52:45.346990   95495 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:52:45.347310   95495 main.go:141] libmachine: Using API Version  1
	I0304 17:52:45.347337   95495 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:52:45.347583   95495 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:52:45.347949   95495 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:52:45.347971   95495 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:52:45.355985   95495 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63837
	I0304 17:52:45.356328   95495 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:52:45.356676   95495 main.go:141] libmachine: Using API Version  1
	I0304 17:52:45.356696   95495 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:52:45.356915   95495 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:52:45.357036   95495 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:52:45.357121   95495 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:52:45.357150   95495 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:52:45.357168   95495 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:52:45.357207   95495 main.go:141] libmachine: (multinode-664000) Calling .DriverName
	I0304 17:52:45.411718   95495 out.go:177] * Deleting "multinode-664000" in hyperkit ...
	I0304 17:52:45.432643   95495 main.go:141] libmachine: (multinode-664000) Calling .Remove
	I0304 17:52:45.432927   95495 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:52:45.432949   95495 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:52:45.432970   95495 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:52:45.433001   95495 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	W0304 17:52:45.452571   95495 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:52:45.452584   95495 start.go:728] Will try again in 5 seconds ...
	I0304 17:52:50.453723   95495 start.go:360] acquireMachinesLock for multinode-664000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:52:50.453902   95495 start.go:364] duration metric: took 145.975µs to acquireMachinesLock for "multinode-664000"
	I0304 17:52:50.453935   95495 start.go:93] Provisioning new machine with config: &{Name:multinode-664000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-664000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:52:50.454074   95495 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:52:50.478603   95495 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 17:52:50.478752   95495 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:52:50.478844   95495 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:52:50.488150   95495 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63839
	I0304 17:52:50.488486   95495 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:52:50.488852   95495 main.go:141] libmachine: Using API Version  1
	I0304 17:52:50.488865   95495 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:52:50.489090   95495 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:52:50.489204   95495 main.go:141] libmachine: (multinode-664000) Calling .GetMachineName
	I0304 17:52:50.489301   95495 main.go:141] libmachine: (multinode-664000) Calling .DriverName
	I0304 17:52:50.489410   95495 start.go:159] libmachine.API.Create for "multinode-664000" (driver="hyperkit")
	I0304 17:52:50.489429   95495 client.go:168] LocalClient.Create starting
	I0304 17:52:50.489465   95495 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:52:50.489524   95495 main.go:141] libmachine: Decoding PEM data...
	I0304 17:52:50.489538   95495 main.go:141] libmachine: Parsing certificate...
	I0304 17:52:50.489582   95495 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:52:50.489619   95495 main.go:141] libmachine: Decoding PEM data...
	I0304 17:52:50.489638   95495 main.go:141] libmachine: Parsing certificate...
	I0304 17:52:50.489650   95495 main.go:141] libmachine: Running pre-create checks...
	I0304 17:52:50.489655   95495 main.go:141] libmachine: (multinode-664000) Calling .PreCreateCheck
	I0304 17:52:50.489740   95495 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:52:50.489765   95495 main.go:141] libmachine: (multinode-664000) Calling .GetConfigRaw
	I0304 17:52:50.490263   95495 main.go:141] libmachine: Creating machine...
	I0304 17:52:50.490271   95495 main.go:141] libmachine: (multinode-664000) Calling .Create
	I0304 17:52:50.490346   95495 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:52:50.490458   95495 main.go:141] libmachine: (multinode-664000) DBG | I0304 17:52:50.490341   95510 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:52:50.490510   95495 main.go:141] libmachine: (multinode-664000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:52:50.668509   95495 main.go:141] libmachine: (multinode-664000) DBG | I0304 17:52:50.668449   95510 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/id_rsa...
	I0304 17:52:50.728800   95495 main.go:141] libmachine: (multinode-664000) DBG | I0304 17:52:50.728730   95510 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/multinode-664000.rawdisk...
	I0304 17:52:50.728824   95495 main.go:141] libmachine: (multinode-664000) DBG | Writing magic tar header
	I0304 17:52:50.728837   95495 main.go:141] libmachine: (multinode-664000) DBG | Writing SSH key tar header
	I0304 17:52:50.729308   95495 main.go:141] libmachine: (multinode-664000) DBG | I0304 17:52:50.729240   95510 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000 ...
	I0304 17:52:51.090187   95495 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:52:51.090223   95495 main.go:141] libmachine: (multinode-664000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.pid
	I0304 17:52:51.090267   95495 main.go:141] libmachine: (multinode-664000) DBG | Using UUID 12ca1451-d0e9-4f1d-9535-a4f8eec5c947
	I0304 17:52:51.124274   95495 main.go:141] libmachine: (multinode-664000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:52:51.124355   95495 client.go:171] duration metric: took 634.911486ms to LocalClient.Create
	I0304 17:52:53.125266   95495 start.go:128] duration metric: took 2.671126079s to createHost
	I0304 17:52:53.125308   95495 start.go:83] releasing machines lock for "multinode-664000", held for 2.671345031s
	W0304 17:52:53.125474   95495 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-664000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-664000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:52:53.147335   95495 out.go:177] 
	W0304 17:52:53.192042   95495 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:52:53.192118   95495 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:52:53.192134   95495 out.go:239] * Related issues:
	* Related issues:
	W0304 17:52:53.192158   95495 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:52:53.192227   95495 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:52:53.214070   95495 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:98: failed to start cluster. args "out/minikube-darwin-amd64 start -p multinode-664000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000: exit status 7 (75.558764ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-664000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/FreshStart2Nodes (11.24s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (92.54s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (101.912113ms)

                                                
                                                
** stderr ** 
	error: cluster "multinode-664000" does not exist

                                                
                                                
** /stderr **
multinode_test.go:495: failed to create busybox deployment to multinode cluster
multinode_test.go:498: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- rollout status deployment/busybox: exit status 1 (101.250575ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:500: failed to deploy busybox to multinode cluster
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.645771ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
E0304 17:52:53.929852   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.090783ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.442196ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.610375ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (103.910937ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.870939ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.641063ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (105.378103ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (102.712033ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.310316ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.750373ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:524: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:528: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:528: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (101.348658ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:530: failed get Pod names
multinode_test.go:536: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- exec  -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- exec  -- nslookup kubernetes.io: exit status 1 (101.453394ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:538: Pod  could not resolve 'kubernetes.io': exit status 1
multinode_test.go:546: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- exec  -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- exec  -- nslookup kubernetes.default: exit status 1 (101.166952ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:548: Pod  could not resolve 'kubernetes.default': exit status 1
multinode_test.go:554: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- exec  -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (102.224765ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:556: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000: exit status 7 (75.22639ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-664000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeployApp2Nodes (92.54s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.18s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:564: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-664000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (101.472894ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:566: failed to get Pod names: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000: exit status 7 (74.515704ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-664000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.18s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (0.22s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run:  out/minikube-darwin-amd64 node add -p multinode-664000 -v 3 --alsologtostderr
multinode_test.go:121: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p multinode-664000 -v 3 --alsologtostderr: exit status 83 (139.989082ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-664000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-664000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:54:26.131640   95628 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:54:26.131918   95628 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:26.131923   95628 out.go:304] Setting ErrFile to fd 2...
	I0304 17:54:26.131927   95628 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:26.132087   95628 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:54:26.132415   95628 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:54:26.132707   95628 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:54:26.133087   95628 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:54:26.133125   95628 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:54:26.140923   95628 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63850
	I0304 17:54:26.141330   95628 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:54:26.141754   95628 main.go:141] libmachine: Using API Version  1
	I0304 17:54:26.141785   95628 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:54:26.142027   95628 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:54:26.142144   95628 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:54:26.142230   95628 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:54:26.142270   95628 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:54:26.142284   95628 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:54:26.164043   95628 out.go:177] * The control-plane node multinode-664000 host is not running: state=Stopped
	I0304 17:54:26.185366   95628 out.go:177]   To start a cluster, run: "minikube start -p multinode-664000"

                                                
                                                
** /stderr **
multinode_test.go:123: failed to add node to current cluster. args "out/minikube-darwin-amd64 node add -p multinode-664000 -v 3 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000: exit status 7 (75.03333ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-664000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/AddNode (0.22s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.11s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run:  kubectl --context multinode-664000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
multinode_test.go:221: (dbg) Non-zero exit: kubectl --context multinode-664000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (36.974629ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: multinode-664000

                                                
                                                
** /stderr **
multinode_test.go:223: failed to 'kubectl get nodes' with args "kubectl --context multinode-664000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1
multinode_test.go:230: failed to decode json from label list: args "kubectl --context multinode-664000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000: exit status 7 (74.645759ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-664000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/MultiNodeLabels (0.11s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.22s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
multinode_test.go:166: expected profile "multinode-664000" in json of 'profile list' include 3 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"multinode-664000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"multinode-664000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KV
MNUMACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"multinode-664000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"Kubernetes
Version\":\"v1.28.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseIn
terval\":60000000000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000: exit status 7 (75.374113ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-664000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ProfileList (0.22s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (0.15s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status --output json --alsologtostderr
multinode_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status --output json --alsologtostderr: exit status 7 (75.515892ms)

                                                
                                                
-- stdout --
	{"Name":"multinode-664000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:54:26.679041   95648 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:54:26.679318   95648 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:26.679323   95648 out.go:304] Setting ErrFile to fd 2...
	I0304 17:54:26.679327   95648 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:26.679522   95648 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:54:26.679714   95648 out.go:298] Setting JSON to true
	I0304 17:54:26.679735   95648 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:54:26.679777   95648 notify.go:220] Checking for updates...
	I0304 17:54:26.681068   95648 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:54:26.681094   95648 status.go:255] checking status of multinode-664000 ...
	I0304 17:54:26.681482   95648 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:54:26.681528   95648 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:54:26.689986   95648 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63865
	I0304 17:54:26.690498   95648 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:54:26.690903   95648 main.go:141] libmachine: Using API Version  1
	I0304 17:54:26.690918   95648 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:54:26.691111   95648 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:54:26.691210   95648 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:54:26.691291   95648 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:54:26.691335   95648 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:54:26.691350   95648 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:54:26.691364   95648 status.go:330] multinode-664000 host status = "Stopped" (err=<nil>)
	I0304 17:54:26.691376   95648 status.go:343] host is not running, skipping remaining checks
	I0304 17:54:26.691383   95648 status.go:257] multinode-664000 status: &{Name:multinode-664000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:191: failed to decode json from status: args "out/minikube-darwin-amd64 -p multinode-664000 status --output json --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000: exit status 7 (74.720402ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-664000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/CopyFile (0.15s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (0.39s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 node stop m03
multinode_test.go:248: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 node stop m03: exit status 85 (159.700143ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_295f67d8757edd996fe5c1e7ccde72c355ccf4dc_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:250: node stop returned an error. args "out/minikube-darwin-amd64 -p multinode-664000 node stop m03": exit status 85
multinode_test.go:254: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status: exit status 7 (75.967151ms)

                                                
                                                
-- stdout --
	multinode-664000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:261: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status --alsologtostderr: exit status 7 (74.697812ms)

                                                
                                                
-- stdout --
	multinode-664000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:54:27.067062   95659 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:54:27.067251   95659 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:27.067256   95659 out.go:304] Setting ErrFile to fd 2...
	I0304 17:54:27.067260   95659 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:27.067441   95659 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:54:27.067616   95659 out.go:298] Setting JSON to false
	I0304 17:54:27.067637   95659 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:54:27.067679   95659 notify.go:220] Checking for updates...
	I0304 17:54:27.067909   95659 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:54:27.067926   95659 status.go:255] checking status of multinode-664000 ...
	I0304 17:54:27.068277   95659 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:54:27.068321   95659 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:54:27.076368   95659 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63874
	I0304 17:54:27.076679   95659 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:54:27.077077   95659 main.go:141] libmachine: Using API Version  1
	I0304 17:54:27.077093   95659 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:54:27.077302   95659 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:54:27.077404   95659 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:54:27.077488   95659 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:54:27.077508   95659 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:54:27.077518   95659 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:54:27.077543   95659 status.go:330] multinode-664000 host status = "Stopped" (err=<nil>)
	I0304 17:54:27.077552   95659 status.go:343] host is not running, skipping remaining checks
	I0304 17:54:27.077559   95659 status.go:257] multinode-664000 status: &{Name:multinode-664000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:267: incorrect number of running kubelets: args "out/minikube-darwin-amd64 -p multinode-664000 status --alsologtostderr": multinode-664000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000: exit status 7 (75.649494ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-664000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopNode (0.39s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (47.06s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 node start m03 -v=7 --alsologtostderr
multinode_test.go:282: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 node start m03 -v=7 --alsologtostderr: exit status 85 (159.875305ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:54:27.217396   95665 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:54:27.218307   95665 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:27.218313   95665 out.go:304] Setting ErrFile to fd 2...
	I0304 17:54:27.218316   95665 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:27.218497   95665 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:54:27.218817   95665 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:54:27.219116   95665 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:54:27.240108   95665 out.go:177] 
	W0304 17:54:27.262020   95665 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	W0304 17:54:27.262043   95665 out.go:239] * 
	* 
	W0304 17:54:27.270329   95665 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I0304 17:54:27.291023   95665 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:284: I0304 17:54:27.217396   95665 out.go:291] Setting OutFile to fd 1 ...
I0304 17:54:27.218307   95665 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:54:27.218313   95665 out.go:304] Setting ErrFile to fd 2...
I0304 17:54:27.218316   95665 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0304 17:54:27.218497   95665 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
I0304 17:54:27.218817   95665 mustload.go:65] Loading cluster: multinode-664000
I0304 17:54:27.219116   95665 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0304 17:54:27.240108   95665 out.go:177] 
W0304 17:54:27.262020   95665 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
W0304 17:54:27.262043   95665 out.go:239] * 
* 
W0304 17:54:27.270329   95665 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I0304 17:54:27.291023   95665 out.go:177] 
multinode_test.go:285: node start returned an error. args "out/minikube-darwin-amd64 -p multinode-664000 node start m03 -v=7 --alsologtostderr": exit status 85
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr: exit status 7 (74.764326ms)

                                                
                                                
-- stdout --
	multinode-664000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:54:27.377007   95667 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:54:27.377187   95667 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:27.377193   95667 out.go:304] Setting ErrFile to fd 2...
	I0304 17:54:27.377197   95667 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:27.377361   95667 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:54:27.378153   95667 out.go:298] Setting JSON to false
	I0304 17:54:27.378182   95667 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:54:27.378373   95667 notify.go:220] Checking for updates...
	I0304 17:54:27.378792   95667 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:54:27.378814   95667 status.go:255] checking status of multinode-664000 ...
	I0304 17:54:27.379160   95667 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:54:27.379205   95667 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:54:27.387405   95667 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63880
	I0304 17:54:27.387752   95667 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:54:27.388161   95667 main.go:141] libmachine: Using API Version  1
	I0304 17:54:27.388171   95667 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:54:27.388380   95667 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:54:27.388485   95667 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:54:27.388561   95667 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:54:27.388586   95667 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:54:27.388597   95667 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:54:27.388612   95667 status.go:330] multinode-664000 host status = "Stopped" (err=<nil>)
	I0304 17:54:27.388620   95667 status.go:343] host is not running, skipping remaining checks
	I0304 17:54:27.388627   95667 status.go:257] multinode-664000 status: &{Name:multinode-664000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr: exit status 7 (77.507046ms)

                                                
                                                
-- stdout --
	multinode-664000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:54:28.480638   95670 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:54:28.480822   95670 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:28.480827   95670 out.go:304] Setting ErrFile to fd 2...
	I0304 17:54:28.480831   95670 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:28.481576   95670 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:54:28.482000   95670 out.go:298] Setting JSON to false
	I0304 17:54:28.482024   95670 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:54:28.482083   95670 notify.go:220] Checking for updates...
	I0304 17:54:28.482291   95670 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:54:28.482309   95670 status.go:255] checking status of multinode-664000 ...
	I0304 17:54:28.482651   95670 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:54:28.482694   95670 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:54:28.490816   95670 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63883
	I0304 17:54:28.491156   95670 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:54:28.491577   95670 main.go:141] libmachine: Using API Version  1
	I0304 17:54:28.491594   95670 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:54:28.491797   95670 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:54:28.491898   95670 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:54:28.491975   95670 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:54:28.492033   95670 status.go:330] multinode-664000 host status = "Stopped" (err=<nil>)
	I0304 17:54:28.492040   95670 status.go:343] host is not running, skipping remaining checks
	I0304 17:54:28.492044   95670 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:54:28.492047   95670 status.go:257] multinode-664000 status: &{Name:multinode-664000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}
	I0304 17:54:28.492060   95670 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr: exit status 7 (76.106683ms)

                                                
                                                
-- stdout --
	multinode-664000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:54:29.496011   95673 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:54:29.496203   95673 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:29.496208   95673 out.go:304] Setting ErrFile to fd 2...
	I0304 17:54:29.496212   95673 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:29.496385   95673 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:54:29.496577   95673 out.go:298] Setting JSON to false
	I0304 17:54:29.496601   95673 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:54:29.496641   95673 notify.go:220] Checking for updates...
	I0304 17:54:29.497848   95673 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:54:29.497871   95673 status.go:255] checking status of multinode-664000 ...
	I0304 17:54:29.498234   95673 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:54:29.498283   95673 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:54:29.506709   95673 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63886
	I0304 17:54:29.507046   95673 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:54:29.507475   95673 main.go:141] libmachine: Using API Version  1
	I0304 17:54:29.507484   95673 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:54:29.507702   95673 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:54:29.507818   95673 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:54:29.507906   95673 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:54:29.507926   95673 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:54:29.507943   95673 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:54:29.508006   95673 status.go:330] multinode-664000 host status = "Stopped" (err=<nil>)
	I0304 17:54:29.508017   95673 status.go:343] host is not running, skipping remaining checks
	I0304 17:54:29.508023   95673 status.go:257] multinode-664000 status: &{Name:multinode-664000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr: exit status 7 (76.176239ms)

                                                
                                                
-- stdout --
	multinode-664000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:54:30.881036   95676 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:54:30.881308   95676 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:30.881319   95676 out.go:304] Setting ErrFile to fd 2...
	I0304 17:54:30.881323   95676 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:30.881493   95676 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:54:30.881674   95676 out.go:298] Setting JSON to false
	I0304 17:54:30.881696   95676 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:54:30.881732   95676 notify.go:220] Checking for updates...
	I0304 17:54:30.881967   95676 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:54:30.881985   95676 status.go:255] checking status of multinode-664000 ...
	I0304 17:54:30.882331   95676 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:54:30.882393   95676 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:54:30.890555   95676 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63889
	I0304 17:54:30.890888   95676 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:54:30.891296   95676 main.go:141] libmachine: Using API Version  1
	I0304 17:54:30.891305   95676 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:54:30.891557   95676 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:54:30.891691   95676 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:54:30.891777   95676 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:54:30.891798   95676 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:54:30.891807   95676 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:54:30.891855   95676 status.go:330] multinode-664000 host status = "Stopped" (err=<nil>)
	I0304 17:54:30.891869   95676 status.go:343] host is not running, skipping remaining checks
	I0304 17:54:30.891876   95676 status.go:257] multinode-664000 status: &{Name:multinode-664000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr: exit status 7 (75.434122ms)

                                                
                                                
-- stdout --
	multinode-664000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:54:32.917935   95679 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:54:32.918126   95679 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:32.918132   95679 out.go:304] Setting ErrFile to fd 2...
	I0304 17:54:32.918136   95679 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:32.918313   95679 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:54:32.918501   95679 out.go:298] Setting JSON to false
	I0304 17:54:32.918522   95679 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:54:32.918559   95679 notify.go:220] Checking for updates...
	I0304 17:54:32.918785   95679 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:54:32.918804   95679 status.go:255] checking status of multinode-664000 ...
	I0304 17:54:32.919145   95679 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:54:32.919208   95679 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:54:32.927380   95679 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63892
	I0304 17:54:32.927705   95679 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:54:32.928125   95679 main.go:141] libmachine: Using API Version  1
	I0304 17:54:32.928135   95679 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:54:32.928350   95679 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:54:32.928451   95679 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:54:32.928545   95679 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:54:32.928556   95679 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:54:32.928576   95679 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:54:32.928609   95679 status.go:330] multinode-664000 host status = "Stopped" (err=<nil>)
	I0304 17:54:32.928624   95679 status.go:343] host is not running, skipping remaining checks
	I0304 17:54:32.928631   95679 status.go:257] multinode-664000 status: &{Name:multinode-664000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr: exit status 7 (75.854671ms)

                                                
                                                
-- stdout --
	multinode-664000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:54:37.158751   95686 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:54:37.159047   95686 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:37.159053   95686 out.go:304] Setting ErrFile to fd 2...
	I0304 17:54:37.159057   95686 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:37.159232   95686 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:54:37.159409   95686 out.go:298] Setting JSON to false
	I0304 17:54:37.159430   95686 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:54:37.159475   95686 notify.go:220] Checking for updates...
	I0304 17:54:37.159734   95686 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:54:37.159754   95686 status.go:255] checking status of multinode-664000 ...
	I0304 17:54:37.160114   95686 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:54:37.160172   95686 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:54:37.168454   95686 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63895
	I0304 17:54:37.168765   95686 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:54:37.169193   95686 main.go:141] libmachine: Using API Version  1
	I0304 17:54:37.169204   95686 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:54:37.169477   95686 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:54:37.169589   95686 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:54:37.169676   95686 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:54:37.169688   95686 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:54:37.169700   95686 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:54:37.169739   95686 status.go:330] multinode-664000 host status = "Stopped" (err=<nil>)
	I0304 17:54:37.169750   95686 status.go:343] host is not running, skipping remaining checks
	I0304 17:54:37.169757   95686 status.go:257] multinode-664000 status: &{Name:multinode-664000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr: exit status 7 (77.225719ms)

                                                
                                                
-- stdout --
	multinode-664000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:54:46.869836   95694 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:54:46.870119   95694 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:46.870125   95694 out.go:304] Setting ErrFile to fd 2...
	I0304 17:54:46.870129   95694 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:54:46.870301   95694 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:54:46.870484   95694 out.go:298] Setting JSON to false
	I0304 17:54:46.870507   95694 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:54:46.870545   95694 notify.go:220] Checking for updates...
	I0304 17:54:46.870757   95694 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:54:46.870775   95694 status.go:255] checking status of multinode-664000 ...
	I0304 17:54:46.871143   95694 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:54:46.871205   95694 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:54:46.879215   95694 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63898
	I0304 17:54:46.879532   95694 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:54:46.879942   95694 main.go:141] libmachine: Using API Version  1
	I0304 17:54:46.879951   95694 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:54:46.880181   95694 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:54:46.880282   95694 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:54:46.880361   95694 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:54:46.880383   95694 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:54:46.880392   95694 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:54:46.880475   95694 status.go:330] multinode-664000 host status = "Stopped" (err=<nil>)
	I0304 17:54:46.880490   95694 status.go:343] host is not running, skipping remaining checks
	I0304 17:54:46.880496   95694 status.go:257] multinode-664000 status: &{Name:multinode-664000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr: exit status 7 (77.4305ms)

                                                
                                                
-- stdout --
	multinode-664000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:55:02.427137   95707 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:55:02.427423   95707 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:55:02.427428   95707 out.go:304] Setting ErrFile to fd 2...
	I0304 17:55:02.427432   95707 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:55:02.427630   95707 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:55:02.427814   95707 out.go:298] Setting JSON to false
	I0304 17:55:02.427836   95707 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:55:02.427875   95707 notify.go:220] Checking for updates...
	I0304 17:55:02.428129   95707 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:55:02.428146   95707 status.go:255] checking status of multinode-664000 ...
	I0304 17:55:02.428542   95707 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:02.428582   95707 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:55:02.437188   95707 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63901
	I0304 17:55:02.437551   95707 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:55:02.437968   95707 main.go:141] libmachine: Using API Version  1
	I0304 17:55:02.437976   95707 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:55:02.438222   95707 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:55:02.438341   95707 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:55:02.438428   95707 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:02.438443   95707 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:55:02.438462   95707 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:55:02.438469   95707 status.go:330] multinode-664000 host status = "Stopped" (err=<nil>)
	I0304 17:55:02.438476   95707 status.go:343] host is not running, skipping remaining checks
	I0304 17:55:02.438484   95707 status.go:257] multinode-664000 status: &{Name:multinode-664000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr: exit status 7 (76.249396ms)

                                                
                                                
-- stdout --
	multinode-664000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:55:14.126470   95713 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:55:14.126655   95713 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:55:14.126660   95713 out.go:304] Setting ErrFile to fd 2...
	I0304 17:55:14.126664   95713 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:55:14.126853   95713 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:55:14.127062   95713 out.go:298] Setting JSON to false
	I0304 17:55:14.127083   95713 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:55:14.127572   95713 notify.go:220] Checking for updates...
	I0304 17:55:14.128370   95713 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:55:14.128389   95713 status.go:255] checking status of multinode-664000 ...
	I0304 17:55:14.128781   95713 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:14.128830   95713 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:55:14.137377   95713 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63904
	I0304 17:55:14.137719   95713 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:55:14.138143   95713 main.go:141] libmachine: Using API Version  1
	I0304 17:55:14.138165   95713 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:55:14.138399   95713 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:55:14.138511   95713 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:55:14.138597   95713 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:14.138626   95713 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:55:14.138641   95713 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:55:14.138675   95713 status.go:330] multinode-664000 host status = "Stopped" (err=<nil>)
	I0304 17:55:14.138686   95713 status.go:343] host is not running, skipping remaining checks
	I0304 17:55:14.138692   95713 status.go:257] multinode-664000 status: &{Name:multinode-664000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:294: failed to run minikube status. args "out/minikube-darwin-amd64 -p multinode-664000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000: exit status 7 (74.835437ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-664000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StartAfterStop (47.06s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (8.9s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-664000
multinode_test.go:321: (dbg) Run:  out/minikube-darwin-amd64 stop -p multinode-664000
multinode_test.go:321: (dbg) Done: out/minikube-darwin-amd64 stop -p multinode-664000: (2.841370497s)
multinode_test.go:326: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-664000 --wait=true -v=8 --alsologtostderr
multinode_test.go:326: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-664000 --wait=true -v=8 --alsologtostderr: exit status 60 (5.854448451s)

                                                
                                                
-- stdout --
	* [multinode-664000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "multinode-664000" primary control-plane node in "multinode-664000" cluster
	* Restarting existing hyperkit VM for "multinode-664000" ...
	* Restarting existing hyperkit VM for "multinode-664000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:55:17.183531   95741 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:55:17.184239   95741 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:55:17.184248   95741 out.go:304] Setting ErrFile to fd 2...
	I0304 17:55:17.184254   95741 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:55:17.184886   95741 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:55:17.186402   95741 out.go:298] Setting JSON to false
	I0304 17:55:17.208957   95741 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24886,"bootTime":1709578831,"procs":488,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:55:17.209055   95741 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:55:17.231273   95741 out.go:177] * [multinode-664000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:55:17.273762   95741 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:55:17.273835   95741 notify.go:220] Checking for updates...
	I0304 17:55:17.317748   95741 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:55:17.339523   95741 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:55:17.360777   95741 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:55:17.381929   95741 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:55:17.403789   95741 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:55:17.432738   95741 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:55:17.432929   95741 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:55:17.433631   95741 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:17.433687   95741 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:55:17.442386   95741 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63920
	I0304 17:55:17.442750   95741 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:55:17.443194   95741 main.go:141] libmachine: Using API Version  1
	I0304 17:55:17.443225   95741 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:55:17.443441   95741 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:55:17.443572   95741 main.go:141] libmachine: (multinode-664000) Calling .DriverName
	I0304 17:55:17.471534   95741 out.go:177] * Using the hyperkit driver based on existing profile
	I0304 17:55:17.513378   95741 start.go:297] selected driver: hyperkit
	I0304 17:55:17.513405   95741 start.go:901] validating driver "hyperkit" against &{Name:multinode-664000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-664000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:55:17.513576   95741 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:55:17.513764   95741 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:55:17.513942   95741 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:55:17.523076   95741 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:55:17.527566   95741 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:17.527614   95741 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0304 17:55:17.530407   95741 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 17:55:17.530482   95741 cni.go:84] Creating CNI manager for ""
	I0304 17:55:17.530490   95741 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0304 17:55:17.530569   95741 start.go:340] cluster config:
	{Name:multinode-664000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-664000 Namespace:default APIServ
erHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disable
Metrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:55:17.530659   95741 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:55:17.572227   95741 out.go:177] * Starting "multinode-664000" primary control-plane node in "multinode-664000" cluster
	I0304 17:55:17.593344   95741 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:55:17.593414   95741 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:55:17.593441   95741 cache.go:56] Caching tarball of preloaded images
	I0304 17:55:17.593611   95741 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:55:17.593628   95741 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 17:55:17.593770   95741 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/multinode-664000/config.json ...
	I0304 17:55:17.594713   95741 start.go:360] acquireMachinesLock for multinode-664000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:55:17.594791   95741 start.go:364] duration metric: took 61.057µs to acquireMachinesLock for "multinode-664000"
	I0304 17:55:17.594816   95741 start.go:96] Skipping create...Using existing machine configuration
	I0304 17:55:17.594829   95741 fix.go:54] fixHost starting: 
	I0304 17:55:17.595128   95741 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:17.595153   95741 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:55:17.603610   95741 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63922
	I0304 17:55:17.603957   95741 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:55:17.604314   95741 main.go:141] libmachine: Using API Version  1
	I0304 17:55:17.604326   95741 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:55:17.604540   95741 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:55:17.604647   95741 main.go:141] libmachine: (multinode-664000) Calling .DriverName
	I0304 17:55:17.604737   95741 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:55:17.604816   95741 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:17.604863   95741 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:55:17.604888   95741 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:55:17.604914   95741 fix.go:112] recreateIfNeeded on multinode-664000: state=Stopped err=<nil>
	I0304 17:55:17.604959   95741 main.go:141] libmachine: (multinode-664000) Calling .DriverName
	W0304 17:55:17.605041   95741 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 17:55:17.626401   95741 out.go:177] * Restarting existing hyperkit VM for "multinode-664000" ...
	I0304 17:55:17.668402   95741 main.go:141] libmachine: (multinode-664000) Calling .Start
	I0304 17:55:17.668625   95741 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:17.668674   95741 main.go:141] libmachine: (multinode-664000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.pid
	I0304 17:55:17.668745   95741 main.go:141] libmachine: (multinode-664000) DBG | Using UUID 12ca1451-d0e9-4f1d-9535-a4f8eec5c947
	I0304 17:55:17.707657   95741 main.go:141] libmachine: (multinode-664000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:55:17.707770   95741 fix.go:56] duration metric: took 112.941515ms for fixHost
	I0304 17:55:17.707780   95741 start.go:83] releasing machines lock for "multinode-664000", held for 112.979734ms
	W0304 17:55:17.707795   95741 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0304 17:55:17.707856   95741 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:55:17.707863   95741 start.go:728] Will try again in 5 seconds ...
	I0304 17:55:22.710098   95741 start.go:360] acquireMachinesLock for multinode-664000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:55:22.710270   95741 start.go:364] duration metric: took 121.309µs to acquireMachinesLock for "multinode-664000"
	I0304 17:55:22.710303   95741 start.go:96] Skipping create...Using existing machine configuration
	I0304 17:55:22.710311   95741 fix.go:54] fixHost starting: 
	I0304 17:55:22.710745   95741 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:22.710790   95741 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:55:22.720451   95741 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63924
	I0304 17:55:22.720987   95741 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:55:22.721363   95741 main.go:141] libmachine: Using API Version  1
	I0304 17:55:22.721372   95741 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:55:22.721604   95741 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:55:22.721732   95741 main.go:141] libmachine: (multinode-664000) Calling .DriverName
	I0304 17:55:22.721819   95741 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:55:22.721906   95741 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:22.721926   95741 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:55:22.721933   95741 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:55:22.721954   95741 fix.go:112] recreateIfNeeded on multinode-664000: state=Stopped err=<nil>
	I0304 17:55:22.721966   95741 main.go:141] libmachine: (multinode-664000) Calling .DriverName
	W0304 17:55:22.722045   95741 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 17:55:22.743629   95741 out.go:177] * Restarting existing hyperkit VM for "multinode-664000" ...
	I0304 17:55:22.786192   95741 main.go:141] libmachine: (multinode-664000) Calling .Start
	I0304 17:55:22.786468   95741 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:22.786498   95741 main.go:141] libmachine: (multinode-664000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.pid
	I0304 17:55:22.786577   95741 main.go:141] libmachine: (multinode-664000) DBG | Using UUID 12ca1451-d0e9-4f1d-9535-a4f8eec5c947
	I0304 17:55:22.788411   95741 main.go:141] libmachine: (multinode-664000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:55:22.788505   95741 fix.go:56] duration metric: took 78.193534ms for fixHost
	I0304 17:55:22.788516   95741 start.go:83] releasing machines lock for "multinode-664000", held for 78.233461ms
	W0304 17:55:22.788596   95741 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-664000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-664000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:55:22.830374   95741 out.go:177] 
	W0304 17:55:22.851162   95741 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:55:22.851247   95741 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:55:22.851261   95741 out.go:239] * Related issues:
	* Related issues:
	W0304 17:55:22.851288   95741 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:55:22.851304   95741 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:55:22.893204   95741 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:328: failed to run minikube start. args "out/minikube-darwin-amd64 node list -p multinode-664000" : exit status 60
multinode_test.go:331: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-664000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000: exit status 7 (74.523325ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-664000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartKeepsNodes (8.90s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (0.29s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 node delete m03
multinode_test.go:416: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 node delete m03: exit status 83 (138.002213ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-664000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-664000"

                                                
                                                
-- /stdout --
multinode_test.go:418: node delete returned an error. args "out/minikube-darwin-amd64 -p multinode-664000 node delete m03": exit status 83
multinode_test.go:422: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status --alsologtostderr
multinode_test.go:422: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status --alsologtostderr: exit status 7 (74.853915ms)

                                                
                                                
-- stdout --
	multinode-664000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:55:23.318445   95766 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:55:23.318723   95766 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:55:23.318728   95766 out.go:304] Setting ErrFile to fd 2...
	I0304 17:55:23.318732   95766 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:55:23.318903   95766 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:55:23.319082   95766 out.go:298] Setting JSON to false
	I0304 17:55:23.319103   95766 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:55:23.319143   95766 notify.go:220] Checking for updates...
	I0304 17:55:23.320116   95766 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:55:23.320175   95766 status.go:255] checking status of multinode-664000 ...
	I0304 17:55:23.320813   95766 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:23.320877   95766 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:55:23.329076   95766 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63932
	I0304 17:55:23.329386   95766 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:55:23.329792   95766 main.go:141] libmachine: Using API Version  1
	I0304 17:55:23.329802   95766 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:55:23.329994   95766 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:55:23.330101   95766 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:55:23.330174   95766 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:23.330193   95766 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:55:23.330206   95766 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:55:23.330222   95766 status.go:330] multinode-664000 host status = "Stopped" (err=<nil>)
	I0304 17:55:23.330230   95766 status.go:343] host is not running, skipping remaining checks
	I0304 17:55:23.330236   95766 status.go:257] multinode-664000 status: &{Name:multinode-664000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:424: failed to run minikube status. args "out/minikube-darwin-amd64 -p multinode-664000 status --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000: exit status 7 (75.258399ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-664000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeleteNode (0.29s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (2.15s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 stop
multinode_test.go:345: (dbg) Done: out/minikube-darwin-amd64 -p multinode-664000 stop: (1.920306163s)
multinode_test.go:351: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status: exit status 7 (75.980978ms)

                                                
                                                
-- stdout --
	multinode-664000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:358: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-664000 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-664000 status --alsologtostderr: exit status 7 (74.898393ms)

                                                
                                                
-- stdout --
	multinode-664000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:55:25.466541   95788 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:55:25.466814   95788 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:55:25.466819   95788 out.go:304] Setting ErrFile to fd 2...
	I0304 17:55:25.466823   95788 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:55:25.466999   95788 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:55:25.467176   95788 out.go:298] Setting JSON to false
	I0304 17:55:25.467198   95788 mustload.go:65] Loading cluster: multinode-664000
	I0304 17:55:25.467235   95788 notify.go:220] Checking for updates...
	I0304 17:55:25.467489   95788 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:55:25.467507   95788 status.go:255] checking status of multinode-664000 ...
	I0304 17:55:25.467843   95788 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:25.467885   95788 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:55:25.475907   95788 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63947
	I0304 17:55:25.476220   95788 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:55:25.476641   95788 main.go:141] libmachine: Using API Version  1
	I0304 17:55:25.476671   95788 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:55:25.476938   95788 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:55:25.477062   95788 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:55:25.477142   95788 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:25.477155   95788 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:55:25.477171   95788 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:55:25.477228   95788 status.go:330] multinode-664000 host status = "Stopped" (err=<nil>)
	I0304 17:55:25.477241   95788 status.go:343] host is not running, skipping remaining checks
	I0304 17:55:25.477247   95788 status.go:257] multinode-664000 status: &{Name:multinode-664000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:364: incorrect number of stopped hosts: args "out/minikube-darwin-amd64 -p multinode-664000 status --alsologtostderr": multinode-664000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
multinode_test.go:368: incorrect number of stopped kubelets: args "out/minikube-darwin-amd64 -p multinode-664000 status --alsologtostderr": multinode-664000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000: exit status 7 (75.517373ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-664000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopMultiNode (2.15s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (5.89s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-664000 --wait=true -v=8 --alsologtostderr --driver=hyperkit 
multinode_test.go:376: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-664000 --wait=true -v=8 --alsologtostderr --driver=hyperkit : exit status 60 (5.812128006s)

                                                
                                                
-- stdout --
	* [multinode-664000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "multinode-664000" primary control-plane node in "multinode-664000" cluster
	* Restarting existing hyperkit VM for "multinode-664000" ...
	* Restarting existing hyperkit VM for "multinode-664000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:55:25.615792   95794 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:55:25.615982   95794 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:55:25.615988   95794 out.go:304] Setting ErrFile to fd 2...
	I0304 17:55:25.615991   95794 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:55:25.616692   95794 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:55:25.618649   95794 out.go:298] Setting JSON to false
	I0304 17:55:25.641170   95794 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24894,"bootTime":1709578831,"procs":501,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:55:25.641272   95794 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:55:25.662693   95794 out.go:177] * [multinode-664000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:55:25.704752   95794 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:55:25.704803   95794 notify.go:220] Checking for updates...
	I0304 17:55:25.746648   95794 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:55:25.788334   95794 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:55:25.809692   95794 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:55:25.830783   95794 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:55:25.851596   95794 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:55:25.873178   95794 config.go:182] Loaded profile config "multinode-664000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:55:25.873700   95794 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:25.873798   95794 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:55:25.882913   95794 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63953
	I0304 17:55:25.883262   95794 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:55:25.883667   95794 main.go:141] libmachine: Using API Version  1
	I0304 17:55:25.883680   95794 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:55:25.883875   95794 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:55:25.883976   95794 main.go:141] libmachine: (multinode-664000) Calling .DriverName
	I0304 17:55:25.884158   95794 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:55:25.884393   95794 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:25.884417   95794 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:55:25.892418   95794 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63955
	I0304 17:55:25.892738   95794 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:55:25.893101   95794 main.go:141] libmachine: Using API Version  1
	I0304 17:55:25.893117   95794 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:55:25.893349   95794 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:55:25.893464   95794 main.go:141] libmachine: (multinode-664000) Calling .DriverName
	I0304 17:55:25.921845   95794 out.go:177] * Using the hyperkit driver based on existing profile
	I0304 17:55:25.963725   95794 start.go:297] selected driver: hyperkit
	I0304 17:55:25.963753   95794 start.go:901] validating driver "hyperkit" against &{Name:multinode-664000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-664000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:55:25.963946   95794 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:55:25.964160   95794 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:55:25.964346   95794 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:55:25.973148   95794 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:55:25.977538   95794 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:25.977564   95794 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0304 17:55:25.980342   95794 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 17:55:25.980414   95794 cni.go:84] Creating CNI manager for ""
	I0304 17:55:25.980423   95794 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0304 17:55:25.980501   95794 start.go:340] cluster config:
	{Name:multinode-664000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-664000 Namespace:default APIServ
erHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disable
Metrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:55:25.980588   95794 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:55:26.022359   95794 out.go:177] * Starting "multinode-664000" primary control-plane node in "multinode-664000" cluster
	I0304 17:55:26.043745   95794 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:55:26.043820   95794 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:55:26.043870   95794 cache.go:56] Caching tarball of preloaded images
	I0304 17:55:26.044040   95794 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:55:26.044075   95794 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 17:55:26.044205   95794 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/multinode-664000/config.json ...
	I0304 17:55:26.045012   95794 start.go:360] acquireMachinesLock for multinode-664000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:55:26.045116   95794 start.go:364] duration metric: took 82.465µs to acquireMachinesLock for "multinode-664000"
	I0304 17:55:26.045150   95794 start.go:96] Skipping create...Using existing machine configuration
	I0304 17:55:26.045164   95794 fix.go:54] fixHost starting: 
	I0304 17:55:26.045454   95794 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:26.045483   95794 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:55:26.054047   95794 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63957
	I0304 17:55:26.054385   95794 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:55:26.054779   95794 main.go:141] libmachine: Using API Version  1
	I0304 17:55:26.054798   95794 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:55:26.055026   95794 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:55:26.055127   95794 main.go:141] libmachine: (multinode-664000) Calling .DriverName
	I0304 17:55:26.055217   95794 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:55:26.055297   95794 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:26.055322   95794 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:55:26.055330   95794 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:55:26.055366   95794 fix.go:112] recreateIfNeeded on multinode-664000: state=Stopped err=<nil>
	I0304 17:55:26.055395   95794 main.go:141] libmachine: (multinode-664000) Calling .DriverName
	W0304 17:55:26.055472   95794 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 17:55:26.097460   95794 out.go:177] * Restarting existing hyperkit VM for "multinode-664000" ...
	I0304 17:55:26.118539   95794 main.go:141] libmachine: (multinode-664000) Calling .Start
	I0304 17:55:26.118703   95794 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:26.118747   95794 main.go:141] libmachine: (multinode-664000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.pid
	I0304 17:55:26.118786   95794 main.go:141] libmachine: (multinode-664000) DBG | Using UUID 12ca1451-d0e9-4f1d-9535-a4f8eec5c947
	I0304 17:55:26.119800   95794 main.go:141] libmachine: (multinode-664000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:55:26.119895   95794 fix.go:56] duration metric: took 74.731465ms for fixHost
	I0304 17:55:26.119904   95794 start.go:83] releasing machines lock for "multinode-664000", held for 74.779802ms
	W0304 17:55:26.119918   95794 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0304 17:55:26.119968   95794 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:55:26.119974   95794 start.go:728] Will try again in 5 seconds ...
	I0304 17:55:31.121067   95794 start.go:360] acquireMachinesLock for multinode-664000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:55:31.121244   95794 start.go:364] duration metric: took 140.065µs to acquireMachinesLock for "multinode-664000"
	I0304 17:55:31.121291   95794 start.go:96] Skipping create...Using existing machine configuration
	I0304 17:55:31.121299   95794 fix.go:54] fixHost starting: 
	I0304 17:55:31.121744   95794 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:31.121783   95794 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:55:31.130642   95794 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63959
	I0304 17:55:31.131015   95794 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:55:31.131338   95794 main.go:141] libmachine: Using API Version  1
	I0304 17:55:31.131349   95794 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:55:31.131554   95794 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:55:31.131663   95794 main.go:141] libmachine: (multinode-664000) Calling .DriverName
	I0304 17:55:31.131758   95794 main.go:141] libmachine: (multinode-664000) Calling .GetState
	I0304 17:55:31.131852   95794 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:31.131883   95794 main.go:141] libmachine: (multinode-664000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.json: no such file or directory
	I0304 17:55:31.131889   95794 main.go:141] libmachine: (multinode-664000) DBG | hyperkit pid from json: 0
	I0304 17:55:31.131963   95794 fix.go:112] recreateIfNeeded on multinode-664000: state=Stopped err=<nil>
	I0304 17:55:31.131995   95794 main.go:141] libmachine: (multinode-664000) Calling .DriverName
	W0304 17:55:31.132096   95794 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 17:55:31.175104   95794 out.go:177] * Restarting existing hyperkit VM for "multinode-664000" ...
	I0304 17:55:31.196486   95794 main.go:141] libmachine: (multinode-664000) Calling .Start
	I0304 17:55:31.196766   95794 main.go:141] libmachine: (multinode-664000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:31.196819   95794 main.go:141] libmachine: (multinode-664000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/multinode-664000/hyperkit.pid
	I0304 17:55:31.196912   95794 main.go:141] libmachine: (multinode-664000) DBG | Using UUID 12ca1451-d0e9-4f1d-9535-a4f8eec5c947
	I0304 17:55:31.199290   95794 main.go:141] libmachine: (multinode-664000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:55:31.199366   95794 fix.go:56] duration metric: took 78.064928ms for fixHost
	I0304 17:55:31.199393   95794 start.go:83] releasing machines lock for "multinode-664000", held for 78.135041ms
	W0304 17:55:31.199454   95794 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-664000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-664000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:55:31.241204   95794 out.go:177] 
	W0304 17:55:31.262325   95794 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:55:31.262427   95794 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:55:31.262476   95794 out.go:239] * Related issues:
	* Related issues:
	W0304 17:55:31.262578   95794 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:55:31.262650   95794 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:55:31.304351   95794 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:378: failed to start cluster. args "out/minikube-darwin-amd64 start -p multinode-664000 --wait=true -v=8 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000: exit status 7 (75.938685ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-664000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartMultiNode (5.89s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (23.35s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-664000
multinode_test.go:464: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-664000-m01 --driver=hyperkit 
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-664000-m01 --driver=hyperkit : exit status 60 (11.579104363s)

                                                
                                                
-- stdout --
	* [multinode-664000-m01] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "multinode-664000-m01" primary control-plane node in "multinode-664000-m01" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "multinode-664000-m01" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-664000-m01" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-664000-m02 --driver=hyperkit 
multinode_test.go:472: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-664000-m02 --driver=hyperkit : exit status 60 (11.21757094s)

                                                
                                                
-- stdout --
	* [multinode-664000-m02] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "multinode-664000-m02" primary control-plane node in "multinode-664000-m02" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "multinode-664000-m02" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-664000-m02" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
multinode_test.go:474: failed to start profile. args "out/minikube-darwin-amd64 start -p multinode-664000-m02 --driver=hyperkit " : exit status 60
multinode_test.go:479: (dbg) Run:  out/minikube-darwin-amd64 node add -p multinode-664000
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p multinode-664000: exit status 83 (139.711358ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-664000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-664000"

                                                
                                                
-- /stdout --
multinode_test.go:484: (dbg) Run:  out/minikube-darwin-amd64 delete -p multinode-664000-m02
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-664000 -n multinode-664000: exit status 7 (75.643608ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-664000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ValidateNameConflict (23.35s)

                                                
                                    
x
+
TestPreload (11.61s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-darwin-amd64 start -p test-preload-745000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4
preload_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p test-preload-745000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4: exit status 60 (11.266456959s)

                                                
                                                
-- stdout --
	* [test-preload-745000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "test-preload-745000" primary control-plane node in "test-preload-745000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "test-preload-745000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:55:55.199977   95873 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:55:55.200238   95873 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:55:55.200244   95873 out.go:304] Setting ErrFile to fd 2...
	I0304 17:55:55.200248   95873 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:55:55.200416   95873 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:55:55.201895   95873 out.go:298] Setting JSON to false
	I0304 17:55:55.224148   95873 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24924,"bootTime":1709578831,"procs":493,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:55:55.224246   95873 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:55:55.246408   95873 out.go:177] * [test-preload-745000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:55:55.289221   95873 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:55:55.289294   95873 notify.go:220] Checking for updates...
	I0304 17:55:55.332747   95873 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:55:55.353964   95873 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:55:55.375071   95873 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:55:55.395774   95873 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:55:55.416997   95873 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:55:55.439039   95873 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:55:55.439212   95873 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:55:55.469912   95873 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 17:55:55.512050   95873 start.go:297] selected driver: hyperkit
	I0304 17:55:55.512080   95873 start.go:901] validating driver "hyperkit" against <nil>
	I0304 17:55:55.512099   95873 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:55:55.516298   95873 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:55:55.516413   95873 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:55:55.524275   95873 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:55:55.528172   95873 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:55.528194   95873 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0304 17:55:55.528240   95873 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 17:55:55.528462   95873 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 17:55:55.528527   95873 cni.go:84] Creating CNI manager for ""
	I0304 17:55:55.528549   95873 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 17:55:55.528557   95873 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0304 17:55:55.528621   95873 start.go:340] cluster config:
	{Name:test-preload-745000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-745000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAu
thSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:55:55.528711   95873 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:55:55.570979   95873 out.go:177] * Starting "test-preload-745000" primary control-plane node in "test-preload-745000" cluster
	I0304 17:55:55.592091   95873 preload.go:132] Checking if preload exists for k8s version v1.24.4 and runtime docker
	I0304 17:55:55.592227   95873 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/test-preload-745000/config.json ...
	I0304 17:55:55.592269   95873 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/test-preload-745000/config.json: {Name:mkd4e267cb710d8f2d7bbf2d78f4f4470435daa8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 17:55:55.592292   95873 cache.go:107] acquiring lock: {Name:mkb69e339230bce54c06e24ec70ec4393a65223e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:55:55.592324   95873 cache.go:107] acquiring lock: {Name:mk7e74aa7efc6cea27f4e1b12011b7614a86e05a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:55:55.592383   95873 cache.go:107] acquiring lock: {Name:mkb5f51425a22c37f437d1598607a49286061a51 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:55:55.592380   95873 cache.go:107] acquiring lock: {Name:mk54ea95c3b101ab297e5fc3ab203914f20edc3a Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:55:55.592492   95873 cache.go:107] acquiring lock: {Name:mk24134ed0b048c4ab25996a938d1f2cf247c962 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:55:55.592491   95873 cache.go:107] acquiring lock: {Name:mk6b665c5d0480c2024be9d626c1d091421d1a2c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:55:55.592545   95873 cache.go:107] acquiring lock: {Name:mk363454b6ce13354d36c70a174930634ac60ce7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:55:55.592649   95873 cache.go:107] acquiring lock: {Name:mk293e6d20aff5c424d9f86b81fe6b420ba31a93 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:55:55.592873   95873 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.24.4
	I0304 17:55:55.592901   95873 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I0304 17:55:55.592894   95873 start.go:360] acquireMachinesLock for test-preload-745000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:55:55.592945   95873 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0304 17:55:55.592967   95873 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.24.4
	I0304 17:55:55.593003   95873 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.4
	I0304 17:55:55.593018   95873 start.go:364] duration metric: took 81.303µs to acquireMachinesLock for "test-preload-745000"
	I0304 17:55:55.593057   95873 start.go:93] Provisioning new machine with config: &{Name:test-preload-745000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCon
fig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-745000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]
MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:55:55.593118   95873 image.go:134] retrieving image: registry.k8s.io/pause:3.7
	I0304 17:55:55.593118   95873 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.24.4
	I0304 17:55:55.593125   95873 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:55:55.636022   95873 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 17:55:55.593230   95873 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I0304 17:55:55.636280   95873 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:55.636354   95873 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:55:55.639391   95873 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0304 17:55:55.639481   95873 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.4
	I0304 17:55:55.642312   95873 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.4
	I0304 17:55:55.642323   95873 image.go:177] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I0304 17:55:55.642366   95873 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.4
	I0304 17:55:55.642374   95873 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I0304 17:55:55.642595   95873 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.4
	I0304 17:55:55.642601   95873 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I0304 17:55:55.647212   95873 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63999
	I0304 17:55:55.647541   95873 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:55:55.647946   95873 main.go:141] libmachine: Using API Version  1
	I0304 17:55:55.647958   95873 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:55:55.648167   95873 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:55:55.648269   95873 main.go:141] libmachine: (test-preload-745000) Calling .GetMachineName
	I0304 17:55:55.648350   95873 main.go:141] libmachine: (test-preload-745000) Calling .DriverName
	I0304 17:55:55.648445   95873 start.go:159] libmachine.API.Create for "test-preload-745000" (driver="hyperkit")
	I0304 17:55:55.648469   95873 client.go:168] LocalClient.Create starting
	I0304 17:55:55.648501   95873 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:55:55.648560   95873 main.go:141] libmachine: Decoding PEM data...
	I0304 17:55:55.648573   95873 main.go:141] libmachine: Parsing certificate...
	I0304 17:55:55.648627   95873 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:55:55.648663   95873 main.go:141] libmachine: Decoding PEM data...
	I0304 17:55:55.648674   95873 main.go:141] libmachine: Parsing certificate...
	I0304 17:55:55.648689   95873 main.go:141] libmachine: Running pre-create checks...
	I0304 17:55:55.648699   95873 main.go:141] libmachine: (test-preload-745000) Calling .PreCreateCheck
	I0304 17:55:55.648779   95873 main.go:141] libmachine: (test-preload-745000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:55.648947   95873 main.go:141] libmachine: (test-preload-745000) Calling .GetConfigRaw
	I0304 17:55:55.649390   95873 main.go:141] libmachine: Creating machine...
	I0304 17:55:55.649398   95873 main.go:141] libmachine: (test-preload-745000) Calling .Create
	I0304 17:55:55.649470   95873 main.go:141] libmachine: (test-preload-745000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:55.649592   95873 main.go:141] libmachine: (test-preload-745000) DBG | I0304 17:55:55.649465   95881 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:55:55.649638   95873 main.go:141] libmachine: (test-preload-745000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:55:55.828728   95873 main.go:141] libmachine: (test-preload-745000) DBG | I0304 17:55:55.828649   95881 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/test-preload-745000/id_rsa...
	I0304 17:55:55.935424   95873 main.go:141] libmachine: (test-preload-745000) DBG | I0304 17:55:55.935351   95881 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/test-preload-745000/test-preload-745000.rawdisk...
	I0304 17:55:55.935459   95873 main.go:141] libmachine: (test-preload-745000) DBG | Writing magic tar header
	I0304 17:55:55.935498   95873 main.go:141] libmachine: (test-preload-745000) DBG | Writing SSH key tar header
	I0304 17:55:55.935965   95873 main.go:141] libmachine: (test-preload-745000) DBG | I0304 17:55:55.935929   95881 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/test-preload-745000 ...
	I0304 17:55:56.083701   95873 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4
	I0304 17:55:56.090146   95873 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7
	I0304 17:55:56.101051   95873 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4
	I0304 17:55:56.112937   95873 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4
	I0304 17:55:56.177974   95873 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.3-0
	I0304 17:55:56.218630   95873 cache.go:157] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7 exists
	I0304 17:55:56.218660   95873 cache.go:96] cache image "registry.k8s.io/pause:3.7" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7" took 626.115268ms
	I0304 17:55:56.218671   95873 cache.go:80] save to tar file registry.k8s.io/pause:3.7 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7 succeeded
	I0304 17:55:56.255428   95873 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4
	I0304 17:55:56.297326   95873 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5
	I0304 17:55:56.300405   95873 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6
	I0304 17:55:56.301636   95873 main.go:141] libmachine: (test-preload-745000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:56.301653   95873 main.go:141] libmachine: (test-preload-745000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/test-preload-745000/hyperkit.pid
	I0304 17:55:56.301705   95873 main.go:141] libmachine: (test-preload-745000) DBG | Using UUID 993b0932-b6e2-4268-a3cc-832d8cd4b98e
	I0304 17:55:56.340472   95873 main.go:141] libmachine: (test-preload-745000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:55:56.340569   95873 client.go:171] duration metric: took 692.083046ms to LocalClient.Create
	I0304 17:55:56.576466   95873 cache.go:157] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0304 17:55:56.576486   95873 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 984.192449ms
	I0304 17:55:56.576493   95873 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0304 17:55:58.340722   95873 start.go:128] duration metric: took 2.747551132s to createHost
	I0304 17:55:58.340735   95873 start.go:83] releasing machines lock for "test-preload-745000", held for 2.747676705s
	W0304 17:55:58.340756   95873 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 17:55:58.341035   95873 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:58.341054   95873 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:55:58.349381   95873 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64012
	I0304 17:55:58.349732   95873 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:55:58.350049   95873 main.go:141] libmachine: Using API Version  1
	I0304 17:55:58.350077   95873 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:55:58.350316   95873 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:55:58.350684   95873 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:55:58.350710   95873 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:55:58.359069   95873 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64014
	I0304 17:55:58.359410   95873 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:55:58.359800   95873 main.go:141] libmachine: Using API Version  1
	I0304 17:55:58.359820   95873 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:55:58.360052   95873 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:55:58.360151   95873 main.go:141] libmachine: (test-preload-745000) Calling .GetState
	I0304 17:55:58.360233   95873 main.go:141] libmachine: (test-preload-745000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:58.360256   95873 main.go:141] libmachine: (test-preload-745000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/test-preload-745000/hyperkit.json: no such file or directory
	I0304 17:55:58.360266   95873 main.go:141] libmachine: (test-preload-745000) DBG | hyperkit pid from json: 0
	I0304 17:55:58.360307   95873 main.go:141] libmachine: (test-preload-745000) Calling .DriverName
	I0304 17:55:58.405524   95873 out.go:177] * Deleting "test-preload-745000" in hyperkit ...
	I0304 17:55:58.426464   95873 main.go:141] libmachine: (test-preload-745000) Calling .Remove
	I0304 17:55:58.426695   95873 main.go:141] libmachine: (test-preload-745000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:58.426728   95873 main.go:141] libmachine: (test-preload-745000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/test-preload-745000/hyperkit.json: no such file or directory
	I0304 17:55:58.426751   95873 main.go:141] libmachine: (test-preload-745000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:55:58.426778   95873 main.go:141] libmachine: (test-preload-745000) DBG | hyperkit pid from json: 0
	W0304 17:55:58.443960   95873 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:55:58.443979   95873 start.go:728] Will try again in 5 seconds ...
	I0304 17:55:58.603299   95873 cache.go:157] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6 exists
	I0304 17:55:58.603318   95873 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.8.6" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6" took 3.010795566s
	I0304 17:55:58.603326   95873 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.8.6 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6 succeeded
	I0304 17:55:59.062369   95873 cache.go:157] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4 exists
	I0304 17:55:59.062385   95873 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.24.4" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4" took 3.469913832s
	I0304 17:55:59.062392   95873 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.24.4 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4 succeeded
	I0304 17:56:00.963291   95873 cache.go:157] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4 exists
	I0304 17:56:00.963308   95873 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.24.4" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4" took 5.370887133s
	I0304 17:56:00.963316   95873 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.24.4 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4 succeeded
	I0304 17:56:01.111651   95873 cache.go:157] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4 exists
	I0304 17:56:01.111665   95873 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.24.4" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4" took 5.519175678s
	I0304 17:56:01.111683   95873 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.24.4 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4 succeeded
	I0304 17:56:02.936799   95873 cache.go:157] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4 exists
	I0304 17:56:02.936814   95873 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.24.4" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4" took 7.344416565s
	I0304 17:56:02.936821   95873 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.24.4 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4 succeeded
	I0304 17:56:03.444708   95873 start.go:360] acquireMachinesLock for test-preload-745000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:56:03.444866   95873 start.go:364] duration metric: took 120.945µs to acquireMachinesLock for "test-preload-745000"
	I0304 17:56:03.444883   95873 start.go:93] Provisioning new machine with config: &{Name:test-preload-745000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCon
fig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-745000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]
MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:56:03.445023   95873 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:56:03.491060   95873 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 17:56:03.491215   95873 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:56:03.491234   95873 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:56:03.499711   95873 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64016
	I0304 17:56:03.500296   95873 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:56:03.500627   95873 main.go:141] libmachine: Using API Version  1
	I0304 17:56:03.500638   95873 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:56:03.500885   95873 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:56:03.500999   95873 main.go:141] libmachine: (test-preload-745000) Calling .GetMachineName
	I0304 17:56:03.501085   95873 main.go:141] libmachine: (test-preload-745000) Calling .DriverName
	I0304 17:56:03.501195   95873 start.go:159] libmachine.API.Create for "test-preload-745000" (driver="hyperkit")
	I0304 17:56:03.501208   95873 client.go:168] LocalClient.Create starting
	I0304 17:56:03.501245   95873 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:56:03.501298   95873 main.go:141] libmachine: Decoding PEM data...
	I0304 17:56:03.501310   95873 main.go:141] libmachine: Parsing certificate...
	I0304 17:56:03.501352   95873 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:56:03.501387   95873 main.go:141] libmachine: Decoding PEM data...
	I0304 17:56:03.501401   95873 main.go:141] libmachine: Parsing certificate...
	I0304 17:56:03.501414   95873 main.go:141] libmachine: Running pre-create checks...
	I0304 17:56:03.501419   95873 main.go:141] libmachine: (test-preload-745000) Calling .PreCreateCheck
	I0304 17:56:03.501491   95873 main.go:141] libmachine: (test-preload-745000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:56:03.501527   95873 main.go:141] libmachine: (test-preload-745000) Calling .GetConfigRaw
	I0304 17:56:03.502221   95873 main.go:141] libmachine: Creating machine...
	I0304 17:56:03.502229   95873 main.go:141] libmachine: (test-preload-745000) Calling .Create
	I0304 17:56:03.502308   95873 main.go:141] libmachine: (test-preload-745000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:56:03.502438   95873 main.go:141] libmachine: (test-preload-745000) DBG | I0304 17:56:03.502301   95924 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:56:03.502487   95873 main.go:141] libmachine: (test-preload-745000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:56:03.690204   95873 main.go:141] libmachine: (test-preload-745000) DBG | I0304 17:56:03.690139   95924 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/test-preload-745000/id_rsa...
	I0304 17:56:03.833806   95873 main.go:141] libmachine: (test-preload-745000) DBG | I0304 17:56:03.833765   95924 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/test-preload-745000/test-preload-745000.rawdisk...
	I0304 17:56:03.833818   95873 main.go:141] libmachine: (test-preload-745000) DBG | Writing magic tar header
	I0304 17:56:03.833842   95873 main.go:141] libmachine: (test-preload-745000) DBG | Writing SSH key tar header
	I0304 17:56:03.834427   95873 main.go:141] libmachine: (test-preload-745000) DBG | I0304 17:56:03.834376   95924 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/test-preload-745000 ...
	I0304 17:56:04.199351   95873 main.go:141] libmachine: (test-preload-745000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0304 17:56:04.199385   95873 main.go:141] libmachine: (test-preload-745000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/test-preload-745000/hyperkit.pid
	I0304 17:56:04.199421   95873 main.go:141] libmachine: (test-preload-745000) DBG | Using UUID 9cb8e219-2412-4003-9513-ee6a333fae2d
	I0304 17:56:04.235657   95873 main.go:141] libmachine: (test-preload-745000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:56:04.235752   95873 client.go:171] duration metric: took 734.529995ms to LocalClient.Create
	I0304 17:56:06.235843   95873 start.go:128] duration metric: took 2.790770984s to createHost
	I0304 17:56:06.235855   95873 start.go:83] releasing machines lock for "test-preload-745000", held for 2.790951069s
	W0304 17:56:06.235933   95873 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p test-preload-745000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p test-preload-745000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:56:06.278859   95873 out.go:177] 
	W0304 17:56:06.300038   95873 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:56:06.300086   95873 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:56:06.300107   95873 out.go:239] * Related issues:
	* Related issues:
	W0304 17:56:06.300139   95873 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:56:06.300154   95873 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:56:06.341859   95873 out.go:177] 

                                                
                                                
** /stderr **
preload_test.go:46: out/minikube-darwin-amd64 start -p test-preload-745000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4 failed: exit status 60
panic.go:626: *** TestPreload FAILED at 2024-03-04 17:56:06.407396 -0800 PST m=+1165.108082923
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p test-preload-745000 -n test-preload-745000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p test-preload-745000 -n test-preload-745000: exit status 7 (74.793593ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "test-preload-745000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "test-preload-745000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p test-preload-745000
--- FAIL: TestPreload (11.61s)

                                                
                                    
x
+
TestScheduledStopUnix (11.41s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-darwin-amd64 start -p scheduled-stop-848000 --memory=2048 --driver=hyperkit 
scheduled_stop_test.go:128: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p scheduled-stop-848000 --memory=2048 --driver=hyperkit : exit status 60 (11.064566308s)

                                                
                                                
-- stdout --
	* [scheduled-stop-848000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "scheduled-stop-848000" primary control-plane node in "scheduled-stop-848000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "scheduled-stop-848000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p scheduled-stop-848000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
scheduled_stop_test.go:130: starting minikube: exit status 60

                                                
                                                
-- stdout --
	* [scheduled-stop-848000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "scheduled-stop-848000" primary control-plane node in "scheduled-stop-848000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "scheduled-stop-848000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p scheduled-stop-848000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
panic.go:626: *** TestScheduledStopUnix FAILED at 2024-03-04 17:56:17.810916 -0800 PST m=+1176.511477293
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p scheduled-stop-848000 -n scheduled-stop-848000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p scheduled-stop-848000 -n scheduled-stop-848000: exit status 7 (75.890378ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "scheduled-stop-848000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "scheduled-stop-848000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p scheduled-stop-848000
--- FAIL: TestScheduledStopUnix (11.41s)

                                                
                                    
x
+
TestSkaffold (14.32s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:59: (dbg) Run:  /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/skaffold.exe2487597243 version
skaffold_test.go:63: skaffold version: v2.10.0
skaffold_test.go:66: (dbg) Run:  out/minikube-darwin-amd64 start -p skaffold-887000 --memory=2600 --driver=hyperkit 
skaffold_test.go:66: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p skaffold-887000 --memory=2600 --driver=hyperkit : exit status 60 (11.25922245s)

                                                
                                                
-- stdout --
	* [skaffold-887000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "skaffold-887000" primary control-plane node in "skaffold-887000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	* Deleting "skaffold-887000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p skaffold-887000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
skaffold_test.go:68: starting minikube: exit status 60

                                                
                                                
-- stdout --
	* [skaffold-887000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "skaffold-887000" primary control-plane node in "skaffold-887000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	* Deleting "skaffold-887000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p skaffold-887000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
panic.go:626: *** TestSkaffold FAILED at 2024-03-04 17:56:32.132714 -0800 PST m=+1190.833116315
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p skaffold-887000 -n skaffold-887000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p skaffold-887000 -n skaffold-887000: exit status 7 (75.727915ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "skaffold-887000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "skaffold-887000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p skaffold-887000
--- FAIL: TestSkaffold (14.32s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (43.71s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.454252310 start -p running-upgrade-200000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:120: (dbg) Non-zero exit: /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.454252310 start -p running-upgrade-200000 --memory=2200 --vm-driver=hyperkit : exit status 60 (28.437959856s)

                                                
                                                
-- stdout --
	* [running-upgrade-200000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* minikube 1.32.0 is available! Download it: https://github.com/kubernetes/minikube/releases/tag/v1.32.0
	* To disable this notice, run: 'minikube config set WantUpdateNotification false'
	
	  - KUBECONFIG=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/legacy_kubeconfig2384831669
	* Using the hyperkit driver based on user configuration
	* Downloading VM boot image ...
	* Starting control plane node running-upgrade-200000 in cluster running-upgrade-200000
	* Downloading Kubernetes v1.24.1 preload ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "running-upgrade-200000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p running-upgrade-200000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:120: (dbg) Run:  /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.454252310 start -p running-upgrade-200000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:120: (dbg) Non-zero exit: /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.454252310 start -p running-upgrade-200000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.786922819s)

                                                
                                                
-- stdout --
	* [running-upgrade-200000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/legacy_kubeconfig2539376772
	* Using the hyperkit driver based on existing profile
	* Starting control plane node running-upgrade-200000 in cluster running-upgrade-200000
	* Restarting existing hyperkit VM for "running-upgrade-200000" ...
	* Restarting existing hyperkit VM for "running-upgrade-200000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p running-upgrade-200000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:120: (dbg) Run:  /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.454252310 start -p running-upgrade-200000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:120: (dbg) Non-zero exit: /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.454252310 start -p running-upgrade-200000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.832215557s)

                                                
                                                
-- stdout --
	* [running-upgrade-200000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/legacy_kubeconfig2820037874
	* Using the hyperkit driver based on existing profile
	* Starting control plane node running-upgrade-200000 in cluster running-upgrade-200000
	* Restarting existing hyperkit VM for "running-upgrade-200000" ...
	* Restarting existing hyperkit VM for "running-upgrade-200000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p running-upgrade-200000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:126: legacy v1.26.0 start failed: exit status 60
panic.go:626: *** TestRunningBinaryUpgrade FAILED at 2024-03-04 17:58:17.796185 -0800 PST m=+1296.495419756
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p running-upgrade-200000 -n running-upgrade-200000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p running-upgrade-200000 -n running-upgrade-200000: exit status 7 (75.779884ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "running-upgrade-200000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "running-upgrade-200000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p running-upgrade-200000
--- FAIL: TestRunningBinaryUpgrade (43.71s)

                                                
                                    
x
+
TestKubernetesUpgrade (20.67s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-darwin-amd64 start -p kubernetes-upgrade-890000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=hyperkit 
version_upgrade_test.go:222: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubernetes-upgrade-890000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=hyperkit : exit status 60 (11.38101067s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-890000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "kubernetes-upgrade-890000" primary control-plane node in "kubernetes-upgrade-890000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "kubernetes-upgrade-890000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:58:18.198831   96401 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:58:18.198990   96401 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:58:18.198995   96401 out.go:304] Setting ErrFile to fd 2...
	I0304 17:58:18.198999   96401 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:58:18.199181   96401 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:58:18.200699   96401 out.go:298] Setting JSON to false
	I0304 17:58:18.224028   96401 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25067,"bootTime":1709578831,"procs":495,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:58:18.224151   96401 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:58:18.246209   96401 out.go:177] * [kubernetes-upgrade-890000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:58:18.309570   96401 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:58:18.288596   96401 notify.go:220] Checking for updates...
	I0304 17:58:18.351451   96401 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:58:18.372658   96401 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:58:18.393580   96401 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:58:18.414638   96401 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:58:18.435784   96401 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:58:18.457515   96401 config.go:182] Loaded profile config "cert-expiration-767000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:58:18.457716   96401 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:58:18.457860   96401 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:58:18.487690   96401 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 17:58:18.529634   96401 start.go:297] selected driver: hyperkit
	I0304 17:58:18.529661   96401 start.go:901] validating driver "hyperkit" against <nil>
	I0304 17:58:18.529680   96401 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:58:18.534108   96401 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:58:18.534212   96401 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:58:18.542013   96401 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:58:18.546022   96401 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:58:18.546059   96401 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 17:58:18.546098   96401 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 17:58:18.546312   96401 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0304 17:58:18.546361   96401 cni.go:84] Creating CNI manager for ""
	I0304 17:58:18.546378   96401 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0304 17:58:18.546455   96401 start.go:340] cluster config:
	{Name:kubernetes-upgrade-890000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-890000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:58:18.546566   96401 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:58:18.588637   96401 out.go:177] * Starting "kubernetes-upgrade-890000" primary control-plane node in "kubernetes-upgrade-890000" cluster
	I0304 17:58:18.609831   96401 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0304 17:58:18.609917   96401 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0304 17:58:18.609951   96401 cache.go:56] Caching tarball of preloaded images
	I0304 17:58:18.610135   96401 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:58:18.610154   96401 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0304 17:58:18.610303   96401 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/kubernetes-upgrade-890000/config.json ...
	I0304 17:58:18.610338   96401 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/kubernetes-upgrade-890000/config.json: {Name:mk6cd2c84d8e97158718c842295ad590187c8647 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 17:58:18.610936   96401 start.go:360] acquireMachinesLock for kubernetes-upgrade-890000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:58:18.611049   96401 start.go:364] duration metric: took 82.242µs to acquireMachinesLock for "kubernetes-upgrade-890000"
	I0304 17:58:18.611090   96401 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-890000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-890000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt
imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:58:18.611171   96401 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:58:18.633620   96401 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 17:58:18.633891   96401 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:58:18.633962   96401 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:58:18.643150   96401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64253
	I0304 17:58:18.643514   96401 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:58:18.643956   96401 main.go:141] libmachine: Using API Version  1
	I0304 17:58:18.643968   96401 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:58:18.644173   96401 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:58:18.644267   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .GetMachineName
	I0304 17:58:18.644347   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .DriverName
	I0304 17:58:18.644456   96401 start.go:159] libmachine.API.Create for "kubernetes-upgrade-890000" (driver="hyperkit")
	I0304 17:58:18.644478   96401 client.go:168] LocalClient.Create starting
	I0304 17:58:18.644508   96401 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:58:18.644555   96401 main.go:141] libmachine: Decoding PEM data...
	I0304 17:58:18.644575   96401 main.go:141] libmachine: Parsing certificate...
	I0304 17:58:18.644624   96401 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:58:18.644659   96401 main.go:141] libmachine: Decoding PEM data...
	I0304 17:58:18.644667   96401 main.go:141] libmachine: Parsing certificate...
	I0304 17:58:18.644699   96401 main.go:141] libmachine: Running pre-create checks...
	I0304 17:58:18.644708   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .PreCreateCheck
	I0304 17:58:18.644794   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:58:18.644995   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .GetConfigRaw
	I0304 17:58:18.654994   96401 main.go:141] libmachine: Creating machine...
	I0304 17:58:18.655015   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .Create
	I0304 17:58:18.655173   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:58:18.655380   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | I0304 17:58:18.655147   96409 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:58:18.655545   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:58:18.832008   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | I0304 17:58:18.831918   96409 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubernetes-upgrade-890000/id_rsa...
	I0304 17:58:19.039372   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | I0304 17:58:19.039279   96409 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubernetes-upgrade-890000/kubernetes-upgrade-890000.rawdisk...
	I0304 17:58:19.039388   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | Writing magic tar header
	I0304 17:58:19.039401   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | Writing SSH key tar header
	I0304 17:58:19.040184   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | I0304 17:58:19.040077   96409 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubernetes-upgrade-890000 ...
	I0304 17:58:19.403558   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:58:19.403581   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubernetes-upgrade-890000/hyperkit.pid
	I0304 17:58:19.403595   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | Using UUID 4897a690-60a8-4a19-a3ea-95229d582542
	I0304 17:58:19.441595   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:58:19.441679   96401 client.go:171] duration metric: took 797.183635ms to LocalClient.Create
	I0304 17:58:21.442338   96401 start.go:128] duration metric: took 2.831119777s to createHost
	I0304 17:58:21.442364   96401 start.go:83] releasing machines lock for "kubernetes-upgrade-890000", held for 2.831272238s
	W0304 17:58:21.442394   96401 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 17:58:21.442935   96401 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:58:21.442990   96401 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:58:21.452454   96401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64255
	I0304 17:58:21.452869   96401 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:58:21.453259   96401 main.go:141] libmachine: Using API Version  1
	I0304 17:58:21.453273   96401 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:58:21.453521   96401 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:58:21.453913   96401 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:58:21.453936   96401 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:58:21.462162   96401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64257
	I0304 17:58:21.462550   96401 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:58:21.462866   96401 main.go:141] libmachine: Using API Version  1
	I0304 17:58:21.462875   96401 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:58:21.463099   96401 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:58:21.463209   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .GetState
	I0304 17:58:21.463302   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:58:21.463317   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubernetes-upgrade-890000/hyperkit.json: no such file or directory
	I0304 17:58:21.463326   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | hyperkit pid from json: 0
	I0304 17:58:21.463385   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .DriverName
	I0304 17:58:21.517656   96401 out.go:177] * Deleting "kubernetes-upgrade-890000" in hyperkit ...
	I0304 17:58:21.538712   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .Remove
	I0304 17:58:21.539009   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:58:21.539039   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:58:21.539059   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | hyperkit pid from json: 0
	I0304 17:58:21.539081   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubernetes-upgrade-890000/hyperkit.json: no such file or directory
	W0304 17:58:21.559481   96401 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:58:21.559494   96401 start.go:728] Will try again in 5 seconds ...
	I0304 17:58:26.560570   96401 start.go:360] acquireMachinesLock for kubernetes-upgrade-890000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:58:26.560753   96401 start.go:364] duration metric: took 140.516µs to acquireMachinesLock for "kubernetes-upgrade-890000"
	I0304 17:58:26.560788   96401 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-890000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-890000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt
imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:58:26.560883   96401 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:58:26.607269   96401 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 17:58:26.607437   96401 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:58:26.607487   96401 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:58:26.616742   96401 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64259
	I0304 17:58:26.617096   96401 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:58:26.617435   96401 main.go:141] libmachine: Using API Version  1
	I0304 17:58:26.617446   96401 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:58:26.617701   96401 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:58:26.617824   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .GetMachineName
	I0304 17:58:26.617914   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .DriverName
	I0304 17:58:26.618020   96401 start.go:159] libmachine.API.Create for "kubernetes-upgrade-890000" (driver="hyperkit")
	I0304 17:58:26.618036   96401 client.go:168] LocalClient.Create starting
	I0304 17:58:26.618065   96401 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:58:26.618116   96401 main.go:141] libmachine: Decoding PEM data...
	I0304 17:58:26.618127   96401 main.go:141] libmachine: Parsing certificate...
	I0304 17:58:26.618166   96401 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:58:26.618201   96401 main.go:141] libmachine: Decoding PEM data...
	I0304 17:58:26.618214   96401 main.go:141] libmachine: Parsing certificate...
	I0304 17:58:26.618226   96401 main.go:141] libmachine: Running pre-create checks...
	I0304 17:58:26.618232   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .PreCreateCheck
	I0304 17:58:26.618334   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:58:26.618345   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .GetConfigRaw
	I0304 17:58:26.618931   96401 main.go:141] libmachine: Creating machine...
	I0304 17:58:26.618940   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .Create
	I0304 17:58:26.619025   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:58:26.619146   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | I0304 17:58:26.619011   96424 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:58:26.619201   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:58:26.871296   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | I0304 17:58:26.871208   96424 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubernetes-upgrade-890000/id_rsa...
	I0304 17:58:26.942566   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | I0304 17:58:26.942485   96424 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubernetes-upgrade-890000/kubernetes-upgrade-890000.rawdisk...
	I0304 17:58:26.942577   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | Writing magic tar header
	I0304 17:58:26.942589   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | Writing SSH key tar header
	I0304 17:58:26.943300   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | I0304 17:58:26.943260   96424 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubernetes-upgrade-890000 ...
	I0304 17:58:27.309632   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:58:27.309651   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubernetes-upgrade-890000/hyperkit.pid
	I0304 17:58:27.309709   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | Using UUID a61d2e75-ad42-4df6-aab0-5a767395a3f0
	I0304 17:58:27.346822   96401 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:58:27.346907   96401 client.go:171] duration metric: took 728.855583ms to LocalClient.Create
	I0304 17:58:29.347509   96401 start.go:128] duration metric: took 2.786576174s to createHost
	I0304 17:58:29.347534   96401 start.go:83] releasing machines lock for "kubernetes-upgrade-890000", held for 2.786734566s
	W0304 17:58:29.347660   96401 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-890000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-890000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:58:29.389943   96401 out.go:177] 
	W0304 17:58:29.413197   96401 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:58:29.413278   96401 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:58:29.413297   96401 out.go:239] * Related issues:
	* Related issues:
	W0304 17:58:29.413332   96401 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:58:29.413352   96401 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:58:29.435087   96401 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:224: failed to start minikube HEAD with oldest k8s version: out/minikube-darwin-amd64 start -p kubernetes-upgrade-890000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=hyperkit : exit status 60
version_upgrade_test.go:227: (dbg) Run:  out/minikube-darwin-amd64 stop -p kubernetes-upgrade-890000
version_upgrade_test.go:227: (dbg) Done: out/minikube-darwin-amd64 stop -p kubernetes-upgrade-890000: (3.030338036s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-darwin-amd64 -p kubernetes-upgrade-890000 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p kubernetes-upgrade-890000 status --format={{.Host}}: exit status 7 (75.528614ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 start -p kubernetes-upgrade-890000 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=hyperkit 
version_upgrade_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubernetes-upgrade-890000 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=hyperkit : exit status 60 (5.791347369s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-890000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "kubernetes-upgrade-890000" primary control-plane node in "kubernetes-upgrade-890000" cluster
	* Restarting existing hyperkit VM for "kubernetes-upgrade-890000" ...
	* Restarting existing hyperkit VM for "kubernetes-upgrade-890000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:58:32.687527   96453 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:58:32.688193   96453 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:58:32.688201   96453 out.go:304] Setting ErrFile to fd 2...
	I0304 17:58:32.688207   96453 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:58:32.688791   96453 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:58:32.690321   96453 out.go:298] Setting JSON to false
	I0304 17:58:32.712893   96453 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25081,"bootTime":1709578831,"procs":496,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:58:32.713007   96453 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:58:32.734684   96453 out.go:177] * [kubernetes-upgrade-890000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:58:32.776418   96453 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:58:32.776500   96453 notify.go:220] Checking for updates...
	I0304 17:58:32.798716   96453 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:58:32.820198   96453 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:58:32.841231   96453 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:58:32.862432   96453 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:58:32.883486   96453 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:58:32.904623   96453 config.go:182] Loaded profile config "kubernetes-upgrade-890000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0304 17:58:32.904961   96453 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:58:32.905009   96453 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:58:32.913448   96453 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64275
	I0304 17:58:32.913816   96453 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:58:32.914258   96453 main.go:141] libmachine: Using API Version  1
	I0304 17:58:32.914267   96453 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:58:32.914481   96453 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:58:32.914583   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .DriverName
	I0304 17:58:32.914770   96453 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:58:32.915000   96453 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:58:32.915024   96453 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:58:32.922873   96453 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64277
	I0304 17:58:32.923186   96453 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:58:32.923502   96453 main.go:141] libmachine: Using API Version  1
	I0304 17:58:32.923510   96453 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:58:32.923703   96453 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:58:32.923796   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .DriverName
	I0304 17:58:32.952422   96453 out.go:177] * Using the hyperkit driver based on existing profile
	I0304 17:58:32.994318   96453 start.go:297] selected driver: hyperkit
	I0304 17:58:32.994346   96453 start.go:901] validating driver "hyperkit" against &{Name:kubernetes-upgrade-890000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-890000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt
imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:58:32.994518   96453 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:58:32.998731   96453 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:58:32.998831   96453 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:58:33.006696   96453 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:58:33.010639   96453 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:58:33.010676   96453 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 17:58:33.010852   96453 cni.go:84] Creating CNI manager for ""
	I0304 17:58:33.010869   96453 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 17:58:33.010906   96453 start.go:340] cluster config:
	{Name:kubernetes-upgrade-890000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:kubernetes-upgrade-890000 Na
mespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMne
tClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:58:33.010998   96453 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:58:33.053297   96453 out.go:177] * Starting "kubernetes-upgrade-890000" primary control-plane node in "kubernetes-upgrade-890000" cluster
	I0304 17:58:33.074476   96453 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0304 17:58:33.074553   96453 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0304 17:58:33.074603   96453 cache.go:56] Caching tarball of preloaded images
	I0304 17:58:33.074748   96453 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:58:33.074761   96453 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0304 17:58:33.074849   96453 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/kubernetes-upgrade-890000/config.json ...
	I0304 17:58:33.075323   96453 start.go:360] acquireMachinesLock for kubernetes-upgrade-890000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:58:33.075403   96453 start.go:364] duration metric: took 40.81µs to acquireMachinesLock for "kubernetes-upgrade-890000"
	I0304 17:58:33.075422   96453 start.go:96] Skipping create...Using existing machine configuration
	I0304 17:58:33.075432   96453 fix.go:54] fixHost starting: 
	I0304 17:58:33.075656   96453 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:58:33.075676   96453 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:58:33.084141   96453 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64279
	I0304 17:58:33.084501   96453 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:58:33.084845   96453 main.go:141] libmachine: Using API Version  1
	I0304 17:58:33.084856   96453 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:58:33.085043   96453 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:58:33.085141   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .DriverName
	I0304 17:58:33.085236   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .GetState
	I0304 17:58:33.085328   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:58:33.085351   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubernetes-upgrade-890000/hyperkit.json: no such file or directory
	I0304 17:58:33.085364   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | hyperkit pid from json: 0
	I0304 17:58:33.085397   96453 fix.go:112] recreateIfNeeded on kubernetes-upgrade-890000: state=Stopped err=<nil>
	I0304 17:58:33.085421   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .DriverName
	W0304 17:58:33.085499   96453 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 17:58:33.127174   96453 out.go:177] * Restarting existing hyperkit VM for "kubernetes-upgrade-890000" ...
	I0304 17:58:33.148476   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .Start
	I0304 17:58:33.148764   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:58:33.148799   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubernetes-upgrade-890000/hyperkit.pid
	I0304 17:58:33.148850   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | Using UUID a61d2e75-ad42-4df6-aab0-5a767395a3f0
	I0304 17:58:33.150694   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:58:33.150814   96453 fix.go:56] duration metric: took 75.379939ms for fixHost
	I0304 17:58:33.150827   96453 start.go:83] releasing machines lock for "kubernetes-upgrade-890000", held for 75.415826ms
	W0304 17:58:33.150846   96453 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0304 17:58:33.150901   96453 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:58:33.150910   96453 start.go:728] Will try again in 5 seconds ...
	I0304 17:58:38.151953   96453 start.go:360] acquireMachinesLock for kubernetes-upgrade-890000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:58:38.152123   96453 start.go:364] duration metric: took 122.231µs to acquireMachinesLock for "kubernetes-upgrade-890000"
	I0304 17:58:38.152168   96453 start.go:96] Skipping create...Using existing machine configuration
	I0304 17:58:38.152195   96453 fix.go:54] fixHost starting: 
	I0304 17:58:38.152802   96453 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:58:38.152848   96453 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:58:38.162317   96453 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64281
	I0304 17:58:38.162724   96453 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:58:38.163094   96453 main.go:141] libmachine: Using API Version  1
	I0304 17:58:38.163105   96453 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:58:38.163311   96453 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:58:38.163427   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .DriverName
	I0304 17:58:38.163526   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .GetState
	I0304 17:58:38.163618   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:58:38.163631   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | hyperkit pid from json: 0
	I0304 17:58:38.163646   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubernetes-upgrade-890000/hyperkit.json: no such file or directory
	I0304 17:58:38.163673   96453 fix.go:112] recreateIfNeeded on kubernetes-upgrade-890000: state=Stopped err=<nil>
	I0304 17:58:38.163684   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .DriverName
	W0304 17:58:38.163761   96453 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 17:58:38.185312   96453 out.go:177] * Restarting existing hyperkit VM for "kubernetes-upgrade-890000" ...
	I0304 17:58:38.207110   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) Calling .Start
	I0304 17:58:38.207503   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:58:38.207579   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubernetes-upgrade-890000/hyperkit.pid
	I0304 17:58:38.207630   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | Using UUID a61d2e75-ad42-4df6-aab0-5a767395a3f0
	I0304 17:58:38.245990   96453 main.go:141] libmachine: (kubernetes-upgrade-890000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:58:38.246096   96453 fix.go:56] duration metric: took 93.916596ms for fixHost
	I0304 17:58:38.246105   96453 start.go:83] releasing machines lock for "kubernetes-upgrade-890000", held for 93.967246ms
	W0304 17:58:38.246159   96453 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-890000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-890000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:58:38.291059   96453 out.go:177] 
	W0304 17:58:38.312021   96453 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:58:38.312091   96453 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:58:38.312111   96453 out.go:239] * Related issues:
	* Related issues:
	W0304 17:58:38.312175   96453 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:58:38.312203   96453 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:58:38.355113   96453 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:245: failed to upgrade with newest k8s version. args: out/minikube-darwin-amd64 start -p kubernetes-upgrade-890000 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=hyperkit  : exit status 60
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-890000 version --output=json
version_upgrade_test.go:248: (dbg) Non-zero exit: kubectl --context kubernetes-upgrade-890000 version --output=json: exit status 1 (37.757753ms)

                                                
                                                
** stderr ** 
	error: context "kubernetes-upgrade-890000" does not exist

                                                
                                                
** /stderr **
version_upgrade_test.go:250: error running kubectl: exit status 1
panic.go:626: *** TestKubernetesUpgrade FAILED at 2024-03-04 17:58:38.457701 -0800 PST m=+1317.156706576
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p kubernetes-upgrade-890000 -n kubernetes-upgrade-890000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p kubernetes-upgrade-890000 -n kubernetes-upgrade-890000: exit status 7 (75.300327ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "kubernetes-upgrade-890000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "kubernetes-upgrade-890000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p kubernetes-upgrade-890000
--- FAIL: TestKubernetesUpgrade (20.67s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (25.93s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.189797347 start -p stopped-upgrade-063000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:183: (dbg) Non-zero exit: /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.189797347 start -p stopped-upgrade-063000 --memory=2200 --vm-driver=hyperkit : exit status 60 (11.452029899s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-063000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/legacy_kubeconfig1829641409
	* Using the hyperkit driver based on user configuration
	* Starting control plane node stopped-upgrade-063000 in cluster stopped-upgrade-063000
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "stopped-upgrade-063000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-063000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:183: (dbg) Run:  /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.189797347 start -p stopped-upgrade-063000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:183: (dbg) Non-zero exit: /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.189797347 start -p stopped-upgrade-063000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.787540529s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-063000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/legacy_kubeconfig3081208038
	* Using the hyperkit driver based on existing profile
	* Starting control plane node stopped-upgrade-063000 in cluster stopped-upgrade-063000
	* Restarting existing hyperkit VM for "stopped-upgrade-063000" ...
	* Restarting existing hyperkit VM for "stopped-upgrade-063000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-063000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:183: (dbg) Run:  /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.189797347 start -p stopped-upgrade-063000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:183: (dbg) Non-zero exit: /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/minikube-v1.26.0.189797347 start -p stopped-upgrade-063000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.810484088s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-063000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/legacy_kubeconfig2013281881
	* Using the hyperkit driver based on existing profile
	* Starting control plane node stopped-upgrade-063000 in cluster stopped-upgrade-063000
	* Restarting existing hyperkit VM for "stopped-upgrade-063000" ...
	* Restarting existing hyperkit VM for "stopped-upgrade-063000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-063000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:189: legacy v1.26.0 start failed: exit status 60
--- FAIL: TestStoppedBinaryUpgrade/Upgrade (25.93s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (0.32s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-darwin-amd64 logs -p stopped-upgrade-063000
version_upgrade_test.go:206: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p stopped-upgrade-063000: exit status 83 (319.200002ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| Command |                         Args                         |          Profile          |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| ssh     | -p cilium-612000 sudo cat                            | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | /etc/hosts                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo cat                            | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | /etc/resolv.conf                                     |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo crictl                         | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | pods                                                 |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo crictl                         | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | ps --all                                             |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo find                           | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | /etc/cni -type f -exec sh -c                         |                           |         |         |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo ip a s                         | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	| ssh     | -p cilium-612000 sudo ip r s                         | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	| ssh     | -p cilium-612000 sudo                                | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | iptables-save                                        |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo iptables                       | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | -t nat -L -n -v                                      |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo                                | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | systemctl status kubelet --all                       |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo                                | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | systemctl cat kubelet                                |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo                                | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | journalctl -xeu kubelet --all                        |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo cat                            | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | /etc/kubernetes/kubelet.conf                         |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo cat                            | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | /var/lib/kubelet/config.yaml                         |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo                                | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | systemctl status docker --all                        |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo                                | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | systemctl cat docker                                 |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo cat                            | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | /etc/docker/daemon.json                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo docker                         | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | system info                                          |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo                                | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | systemctl status cri-docker                          |                           |         |         |                     |                     |
	|         | --all --full --no-pager                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo                                | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | systemctl cat cri-docker                             |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo cat                            | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | /etc/systemd/system/cri-docker.service.d/10-cni.conf |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo cat                            | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | /usr/lib/systemd/system/cri-docker.service           |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo                                | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | cri-dockerd --version                                |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo                                | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | systemctl status containerd                          |                           |         |         |                     |                     |
	|         | --all --full --no-pager                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo                                | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | systemctl cat containerd                             |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo cat                            | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | /lib/systemd/system/containerd.service               |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo cat                            | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | /etc/containerd/config.toml                          |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo                                | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | containerd config dump                               |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo                                | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | systemctl status crio --all                          |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo                                | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | systemctl cat crio --no-pager                        |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo find                           | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | /etc/crio -type f -exec sh -c                        |                           |         |         |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                           |         |         |                     |                     |
	| ssh     | -p cilium-612000 sudo crio                           | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | config                                               |                           |         |         |                     |                     |
	| delete  | -p cilium-612000                                     | cilium-612000             | jenkins | v1.32.0 | 04 Mar 24 17:56 PST | 04 Mar 24 17:56 PST |
	| delete  | -p offline-docker-929000                             | offline-docker-929000     | jenkins | v1.32.0 | 04 Mar 24 17:56 PST | 04 Mar 24 17:56 PST |
	| start   | -p force-systemd-env-702000                          | force-systemd-env-702000  | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| start   | -p force-systemd-flag-728000                         | force-systemd-flag-728000 | jenkins | v1.32.0 | 04 Mar 24 17:56 PST |                     |
	|         | --memory=2048 --force-systemd                        |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | force-systemd-env-702000                             | force-systemd-env-702000  | jenkins | v1.32.0 | 04 Mar 24 17:57 PST |                     |
	|         | ssh docker info --format                             |                           |         |         |                     |                     |
	|         | {{.CgroupDriver}}                                    |                           |         |         |                     |                     |
	| delete  | -p force-systemd-env-702000                          | force-systemd-env-702000  | jenkins | v1.32.0 | 04 Mar 24 17:57 PST | 04 Mar 24 17:57 PST |
	| start   | -p docker-flags-377000                               | docker-flags-377000       | jenkins | v1.32.0 | 04 Mar 24 17:57 PST |                     |
	|         | --cache-images=false                                 |                           |         |         |                     |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --install-addons=false                               |                           |         |         |                     |                     |
	|         | --wait=false                                         |                           |         |         |                     |                     |
	|         | --docker-env=FOO=BAR                                 |                           |         |         |                     |                     |
	|         | --docker-env=BAZ=BAT                                 |                           |         |         |                     |                     |
	|         | --docker-opt=debug                                   |                           |         |         |                     |                     |
	|         | --docker-opt=icc=true                                |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | force-systemd-flag-728000                            | force-systemd-flag-728000 | jenkins | v1.32.0 | 04 Mar 24 17:57 PST |                     |
	|         | ssh docker info --format                             |                           |         |         |                     |                     |
	|         | {{.CgroupDriver}}                                    |                           |         |         |                     |                     |
	| delete  | -p force-systemd-flag-728000                         | force-systemd-flag-728000 | jenkins | v1.32.0 | 04 Mar 24 17:57 PST | 04 Mar 24 17:57 PST |
	| start   | -p cert-expiration-767000                            | cert-expiration-767000    | jenkins | v1.32.0 | 04 Mar 24 17:57 PST |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --cert-expiration=3m                                 |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | docker-flags-377000 ssh                              | docker-flags-377000       | jenkins | v1.32.0 | 04 Mar 24 17:57 PST |                     |
	|         | sudo systemctl show docker                           |                           |         |         |                     |                     |
	|         | --property=Environment                               |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | docker-flags-377000 ssh                              | docker-flags-377000       | jenkins | v1.32.0 | 04 Mar 24 17:57 PST |                     |
	|         | sudo systemctl show docker                           |                           |         |         |                     |                     |
	|         | --property=ExecStart                                 |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| delete  | -p docker-flags-377000                               | docker-flags-377000       | jenkins | v1.32.0 | 04 Mar 24 17:57 PST | 04 Mar 24 17:57 PST |
	| start   | -p cert-options-223000                               | cert-options-223000       | jenkins | v1.32.0 | 04 Mar 24 17:57 PST |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --apiserver-ips=127.0.0.1                            |                           |         |         |                     |                     |
	|         | --apiserver-ips=192.168.15.15                        |                           |         |         |                     |                     |
	|         | --apiserver-names=localhost                          |                           |         |         |                     |                     |
	|         | --apiserver-names=www.google.com                     |                           |         |         |                     |                     |
	|         | --apiserver-port=8555                                |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | cert-options-223000 ssh                              | cert-options-223000       | jenkins | v1.32.0 | 04 Mar 24 17:57 PST |                     |
	|         | openssl x509 -text -noout -in                        |                           |         |         |                     |                     |
	|         | /var/lib/minikube/certs/apiserver.crt                |                           |         |         |                     |                     |
	| ssh     | -p cert-options-223000 -- sudo                       | cert-options-223000       | jenkins | v1.32.0 | 04 Mar 24 17:57 PST |                     |
	|         | cat /etc/kubernetes/admin.conf                       |                           |         |         |                     |                     |
	| delete  | -p cert-options-223000                               | cert-options-223000       | jenkins | v1.32.0 | 04 Mar 24 17:57 PST | 04 Mar 24 17:57 PST |
	| start   | -p running-upgrade-200000                            | minikube                  | jenkins | v1.26.0 | 04 Mar 24 17:57 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p running-upgrade-200000                            | minikube                  | jenkins | v1.26.0 | 04 Mar 24 17:58 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p running-upgrade-200000                            | minikube                  | jenkins | v1.26.0 | 04 Mar 24 17:58 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| delete  | -p running-upgrade-200000                            | running-upgrade-200000    | jenkins | v1.32.0 | 04 Mar 24 17:58 PST | 04 Mar 24 17:58 PST |
	| start   | -p kubernetes-upgrade-890000                         | kubernetes-upgrade-890000 | jenkins | v1.32.0 | 04 Mar 24 17:58 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                         |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| stop    | -p kubernetes-upgrade-890000                         | kubernetes-upgrade-890000 | jenkins | v1.32.0 | 04 Mar 24 17:58 PST | 04 Mar 24 17:58 PST |
	| start   | -p kubernetes-upgrade-890000                         | kubernetes-upgrade-890000 | jenkins | v1.32.0 | 04 Mar 24 17:58 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.29.0-rc.2                    |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| delete  | -p kubernetes-upgrade-890000                         | kubernetes-upgrade-890000 | jenkins | v1.32.0 | 04 Mar 24 17:58 PST | 04 Mar 24 17:58 PST |
	| start   | -p stopped-upgrade-063000                            | minikube                  | jenkins | v1.26.0 | 04 Mar 24 17:58 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p stopped-upgrade-063000                            | minikube                  | jenkins | v1.26.0 | 04 Mar 24 17:58 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p stopped-upgrade-063000                            | minikube                  | jenkins | v1.26.0 | 04 Mar 24 17:59 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/04 17:59:00
	Running on machine: MacOS-Agent-2
	Binary: Built with gc go1.18.3 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0304 17:59:00.291229   96521 out.go:296] Setting OutFile to fd 1 ...
	I0304 17:59:00.291408   96521 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0304 17:59:00.291411   96521 out.go:309] Setting ErrFile to fd 2...
	I0304 17:59:00.291414   96521 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0304 17:59:00.291752   96521 root.go:329] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:59:00.292020   96521 out.go:303] Setting JSON to false
	I0304 17:59:00.314202   96521 start.go:115] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25109,"bootTime":1709578831,"procs":495,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:59:00.314293   96521 start.go:123] gopshost.Virtualization returned error: not implemented yet
	I0304 17:59:00.336307   96521 out.go:177] * [stopped-upgrade-063000] minikube v1.26.0 on Darwin 14.3.1
	I0304 17:59:00.379155   96521 notify.go:193] Checking for updates...
	I0304 17:59:00.379182   96521 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:59:00.401079   96521 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:59:00.422586   96521 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:59:00.443777   96521 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:59:00.464730   96521 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:59:00.485475   96521 out.go:177]   - KUBECONFIG=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/legacy_kubeconfig2013281881
	I0304 17:59:00.507459   96521 config.go:178] Loaded profile config "stopped-upgrade-063000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0304 17:59:00.507918   96521 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:59:00.507969   96521 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0304 17:59:00.516608   96521 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:64317
	I0304 17:59:00.516989   96521 main.go:134] libmachine: () Calling .GetVersion
	I0304 17:59:00.517406   96521 main.go:134] libmachine: Using API Version  1
	I0304 17:59:00.517416   96521 main.go:134] libmachine: () Calling .SetConfigRaw
	I0304 17:59:00.517641   96521 main.go:134] libmachine: () Calling .GetMachineName
	I0304 17:59:00.517730   96521 main.go:134] libmachine: (stopped-upgrade-063000) Calling .DriverName
	I0304 17:59:00.517870   96521 driver.go:360] Setting default libvirt URI to qemu:///system
	I0304 17:59:00.518134   96521 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:59:00.518152   96521 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0304 17:59:00.525883   96521 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:64319
	I0304 17:59:00.526219   96521 main.go:134] libmachine: () Calling .GetVersion
	I0304 17:59:00.526578   96521 main.go:134] libmachine: Using API Version  1
	I0304 17:59:00.526593   96521 main.go:134] libmachine: () Calling .SetConfigRaw
	I0304 17:59:00.526801   96521 main.go:134] libmachine: () Calling .GetMachineName
	I0304 17:59:00.526898   96521 main.go:134] libmachine: (stopped-upgrade-063000) Calling .DriverName
	I0304 17:59:00.555649   96521 out.go:177] * Using the hyperkit driver based on existing profile
	I0304 17:59:00.576548   96521 start.go:284] selected driver: hyperkit
	I0304 17:59:00.576597   96521 start.go:805] validating driver "hyperkit" against &{Name:stopped-upgrade-063000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:s
topped-upgrade-063000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath:}
	I0304 17:59:00.576726   96521 start.go:816] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:59:00.580104   96521 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:59:00.580198   96521 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:59:00.588034   96521 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:59:00.592996   96521 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:59:00.593033   96521 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 17:59:00.593114   96521 cni.go:95] Creating CNI manager for ""
	I0304 17:59:00.593122   96521 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
	I0304 17:59:00.593132   96521 start_flags.go:310] config:
	{Name:stopped-upgrade-063000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:stopped-upgrade-063000 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0304 17:59:00.593242   96521 iso.go:128] acquiring lock: {Name:mkd790de3daab2e80924e886b83273bfc7aa024b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:59:00.635824   96521 out.go:177] * Starting control plane node stopped-upgrade-063000 in cluster stopped-upgrade-063000
	I0304 17:59:00.656629   96521 preload.go:132] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I0304 17:59:00.656759   96521 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4
	I0304 17:59:00.656787   96521 cache.go:57] Caching tarball of preloaded images
	I0304 17:59:00.656988   96521 preload.go:174] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:59:00.657006   96521 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.1 on docker
	I0304 17:59:00.657143   96521 profile.go:148] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/stopped-upgrade-063000/config.json ...
	I0304 17:59:00.657918   96521 cache.go:208] Successfully downloaded all kic artifacts
	I0304 17:59:00.657968   96521 start.go:352] acquiring machines lock for stopped-upgrade-063000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:59:00.658052   96521 start.go:356] acquired machines lock for "stopped-upgrade-063000" in 66.134µs
	I0304 17:59:00.658076   96521 start.go:94] Skipping create...Using existing machine configuration
	I0304 17:59:00.658089   96521 fix.go:55] fixHost starting: 
	I0304 17:59:00.658508   96521 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:59:00.658545   96521 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0304 17:59:00.667120   96521 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:64321
	I0304 17:59:00.667467   96521 main.go:134] libmachine: () Calling .GetVersion
	I0304 17:59:00.667822   96521 main.go:134] libmachine: Using API Version  1
	I0304 17:59:00.667830   96521 main.go:134] libmachine: () Calling .SetConfigRaw
	I0304 17:59:00.668041   96521 main.go:134] libmachine: () Calling .GetMachineName
	I0304 17:59:00.668158   96521 main.go:134] libmachine: (stopped-upgrade-063000) Calling .DriverName
	I0304 17:59:00.668249   96521 main.go:134] libmachine: (stopped-upgrade-063000) Calling .GetState
	I0304 17:59:00.668328   96521 main.go:134] libmachine: (stopped-upgrade-063000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:59:00.668344   96521 main.go:134] libmachine: (stopped-upgrade-063000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/stopped-upgrade-063000/hyperkit.json: no such file or directory
	I0304 17:59:00.668385   96521 main.go:134] libmachine: (stopped-upgrade-063000) DBG | hyperkit pid from json: 0
	I0304 17:59:00.668410   96521 fix.go:103] recreateIfNeeded on stopped-upgrade-063000: state=Stopped err=<nil>
	I0304 17:59:00.668430   96521 main.go:134] libmachine: (stopped-upgrade-063000) Calling .DriverName
	W0304 17:59:00.668529   96521 fix.go:129] unexpected machine state, will restart: <nil>
	I0304 17:59:00.710713   96521 out.go:177] * Restarting existing hyperkit VM for "stopped-upgrade-063000" ...
	I0304 17:59:00.731599   96521 main.go:134] libmachine: (stopped-upgrade-063000) Calling .Start
	I0304 17:59:00.731841   96521 main.go:134] libmachine: (stopped-upgrade-063000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:59:00.731907   96521 main.go:134] libmachine: (stopped-upgrade-063000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/stopped-upgrade-063000/hyperkit.pid
	I0304 17:59:00.732008   96521 main.go:134] libmachine: (stopped-upgrade-063000) DBG | Using UUID e85494f2-da93-11ee-96aa-f01898ef957c
	I0304 17:59:00.769653   96521 main.go:134] libmachine: (stopped-upgrade-063000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:59:00.769770   96521 fix.go:57] fixHost completed within 111.682973ms
	I0304 17:59:00.769775   96521 start.go:81] releasing machines lock for "stopped-upgrade-063000", held for 111.716102ms
	W0304 17:59:00.769788   96521 start.go:599] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0304 17:59:00.769883   96521 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:59:00.769893   96521 start.go:614] Will try again in 5 seconds ...
	I0304 17:59:05.772045   96521 start.go:352] acquiring machines lock for stopped-upgrade-063000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:59:05.772198   96521 start.go:356] acquired machines lock for "stopped-upgrade-063000" in 130.3µs
	I0304 17:59:05.772232   96521 start.go:94] Skipping create...Using existing machine configuration
	I0304 17:59:05.772237   96521 fix.go:55] fixHost starting: 
	I0304 17:59:05.772701   96521 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:59:05.772740   96521 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0304 17:59:05.781907   96521 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:64323
	I0304 17:59:05.782254   96521 main.go:134] libmachine: () Calling .GetVersion
	I0304 17:59:05.782621   96521 main.go:134] libmachine: Using API Version  1
	I0304 17:59:05.782641   96521 main.go:134] libmachine: () Calling .SetConfigRaw
	I0304 17:59:05.782875   96521 main.go:134] libmachine: () Calling .GetMachineName
	I0304 17:59:05.782983   96521 main.go:134] libmachine: (stopped-upgrade-063000) Calling .DriverName
	I0304 17:59:05.783058   96521 main.go:134] libmachine: (stopped-upgrade-063000) Calling .GetState
	I0304 17:59:05.783147   96521 main.go:134] libmachine: (stopped-upgrade-063000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:59:05.783156   96521 main.go:134] libmachine: (stopped-upgrade-063000) DBG | hyperkit pid from json: 0
	I0304 17:59:05.783175   96521 main.go:134] libmachine: (stopped-upgrade-063000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/stopped-upgrade-063000/hyperkit.json: no such file or directory
	I0304 17:59:05.783197   96521 fix.go:103] recreateIfNeeded on stopped-upgrade-063000: state=Stopped err=<nil>
	I0304 17:59:05.783205   96521 main.go:134] libmachine: (stopped-upgrade-063000) Calling .DriverName
	W0304 17:59:05.783283   96521 fix.go:129] unexpected machine state, will restart: <nil>
	I0304 17:59:05.804883   96521 out.go:177] * Restarting existing hyperkit VM for "stopped-upgrade-063000" ...
	I0304 17:59:05.847524   96521 main.go:134] libmachine: (stopped-upgrade-063000) Calling .Start
	I0304 17:59:05.847788   96521 main.go:134] libmachine: (stopped-upgrade-063000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:59:05.847840   96521 main.go:134] libmachine: (stopped-upgrade-063000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/stopped-upgrade-063000/hyperkit.pid
	I0304 17:59:05.847912   96521 main.go:134] libmachine: (stopped-upgrade-063000) DBG | Using UUID e85494f2-da93-11ee-96aa-f01898ef957c
	I0304 17:59:05.849857   96521 main.go:134] libmachine: (stopped-upgrade-063000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:59:05.849994   96521 fix.go:57] fixHost completed within 77.74965ms
	I0304 17:59:05.850003   96521 start.go:81] releasing machines lock for "stopped-upgrade-063000", held for 77.796005ms
	W0304 17:59:05.850171   96521 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-063000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:59:05.892338   96521 out.go:177] 
	W0304 17:59:05.913563   96521 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 17:59:05.913652   96521 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 17:59:05.913665   96521 out.go:239] * Related issues:
	W0304 17:59:05.913760   96521 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	W0304 17:59:05.913811   96521 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	I0304 17:59:05.976650   96521 out.go:177] 
	
	
	* The control-plane node stopped-upgrade-063000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p stopped-upgrade-063000"

                                                
                                                
-- /stdout --
version_upgrade_test.go:208: `minikube logs` after upgrade to HEAD from v1.26.0 failed: exit status 83
--- FAIL: TestStoppedBinaryUpgrade/MinikubeLogs (0.32s)

                                                
                                    
x
+
TestPause/serial/Start (11.27s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-darwin-amd64 start -p pause-373000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit 
pause_test.go:80: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p pause-373000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit : exit status 60 (11.188532124s)

                                                
                                                
-- stdout --
	* [pause-373000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "pause-373000" primary control-plane node in "pause-373000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "pause-373000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p pause-373000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
pause_test.go:82: failed to start minikube with args: "out/minikube-darwin-amd64 start -p pause-373000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-373000 -n pause-373000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-373000 -n pause-373000: exit status 7 (76.052304ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "pause-373000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestPause/serial/Start (11.27s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (11.24s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-466000 --driver=hyperkit 
no_kubernetes_test.go:95: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-466000 --driver=hyperkit : exit status 60 (11.167419759s)

                                                
                                                
-- stdout --
	* [NoKubernetes-466000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "NoKubernetes-466000" primary control-plane node in "NoKubernetes-466000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "NoKubernetes-466000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-466000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:97: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-466000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-466000 -n NoKubernetes-466000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-466000 -n NoKubernetes-466000: exit status 7 (76.408183ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-466000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithK8s (11.24s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (5.94s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-466000 --no-kubernetes --driver=hyperkit 
no_kubernetes_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-466000 --no-kubernetes --driver=hyperkit : exit status 60 (5.862340061s)

                                                
                                                
-- stdout --
	* [NoKubernetes-466000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-466000
	* Restarting existing hyperkit VM for "NoKubernetes-466000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-466000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-466000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:114: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-466000 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-466000 -n NoKubernetes-466000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-466000 -n NoKubernetes-466000: exit status 7 (77.478714ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-466000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithStopK8s (5.94s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (5.96s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-466000 --no-kubernetes --driver=hyperkit 
no_kubernetes_test.go:136: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-466000 --no-kubernetes --driver=hyperkit : exit status 60 (5.884018252s)

                                                
                                                
-- stdout --
	* [NoKubernetes-466000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-466000
	* Restarting existing hyperkit VM for "NoKubernetes-466000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-466000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-466000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:138: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-466000 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-466000 -n NoKubernetes-466000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-466000 -n NoKubernetes-466000: exit status 7 (75.983247ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-466000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/Start (5.96s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (5.86s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-466000 --driver=hyperkit 
no_kubernetes_test.go:191: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-466000 --driver=hyperkit : exit status 60 (5.780617839s)

                                                
                                                
-- stdout --
	* [NoKubernetes-466000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-466000
	* Restarting existing hyperkit VM for "NoKubernetes-466000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-466000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-466000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:193: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-466000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-466000 -n NoKubernetes-466000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-466000 -n NoKubernetes-466000: exit status 7 (75.867704ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-466000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartNoArgs (5.86s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (11.68s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p auto-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p auto-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=hyperkit : exit status 60 (11.679363804s)

                                                
                                                
-- stdout --
	* [auto-612000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "auto-612000" primary control-plane node in "auto-612000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "auto-612000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:59:51.375136   96698 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:59:51.375308   96698 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:59:51.375313   96698 out.go:304] Setting ErrFile to fd 2...
	I0304 17:59:51.375317   96698 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:59:51.375495   96698 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:59:51.376947   96698 out.go:298] Setting JSON to false
	I0304 17:59:51.399162   96698 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25160,"bootTime":1709578831,"procs":494,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:59:51.399260   96698 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:59:51.421689   96698 out.go:177] * [auto-612000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:59:51.463959   96698 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:59:51.464037   96698 notify.go:220] Checking for updates...
	I0304 17:59:51.506726   96698 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:59:51.549059   96698 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:59:51.591892   96698 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:59:51.612934   96698 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:59:51.633841   96698 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:59:51.655916   96698 config.go:182] Loaded profile config "cert-expiration-767000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:59:51.656104   96698 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:59:51.656301   96698 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:59:51.685824   96698 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 17:59:51.708634   96698 start.go:297] selected driver: hyperkit
	I0304 17:59:51.708659   96698 start.go:901] validating driver "hyperkit" against <nil>
	I0304 17:59:51.708673   96698 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:59:51.712287   96698 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:59:51.712398   96698 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:59:51.720235   96698 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:59:51.724146   96698 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:59:51.724169   96698 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 17:59:51.724204   96698 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 17:59:51.724411   96698 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 17:59:51.724464   96698 cni.go:84] Creating CNI manager for ""
	I0304 17:59:51.724482   96698 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 17:59:51.724488   96698 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0304 17:59:51.724547   96698 start.go:340] cluster config:
	{Name:auto-612000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:auto-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:d
ocker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgen
tPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:59:51.724643   96698 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:59:51.745970   96698 out.go:177] * Starting "auto-612000" primary control-plane node in "auto-612000" cluster
	I0304 17:59:51.787625   96698 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:59:51.787692   96698 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:59:51.787722   96698 cache.go:56] Caching tarball of preloaded images
	I0304 17:59:51.787916   96698 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 17:59:51.787936   96698 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 17:59:51.788088   96698 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/auto-612000/config.json ...
	I0304 17:59:51.788123   96698 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/auto-612000/config.json: {Name:mk53d6d9ca7fd9ec3838d92186fd2b585dc3d42c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 17:59:51.788875   96698 start.go:360] acquireMachinesLock for auto-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 17:59:51.789018   96698 start.go:364] duration metric: took 123.543µs to acquireMachinesLock for "auto-612000"
	I0304 17:59:51.789050   96698 start.go:93] Provisioning new machine with config: &{Name:auto-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.28.4 ClusterName:auto-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mou
ntType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 17:59:51.789133   96698 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 17:59:51.810018   96698 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 17:59:51.810286   96698 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:59:51.810360   96698 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:59:51.819772   96698 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64432
	I0304 17:59:51.820155   96698 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:59:51.820570   96698 main.go:141] libmachine: Using API Version  1
	I0304 17:59:51.820582   96698 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:59:51.820843   96698 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:59:51.820941   96698 main.go:141] libmachine: (auto-612000) Calling .GetMachineName
	I0304 17:59:51.821041   96698 main.go:141] libmachine: (auto-612000) Calling .DriverName
	I0304 17:59:51.821149   96698 start.go:159] libmachine.API.Create for "auto-612000" (driver="hyperkit")
	I0304 17:59:51.821177   96698 client.go:168] LocalClient.Create starting
	I0304 17:59:51.821210   96698 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 17:59:51.821260   96698 main.go:141] libmachine: Decoding PEM data...
	I0304 17:59:51.821277   96698 main.go:141] libmachine: Parsing certificate...
	I0304 17:59:51.821331   96698 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 17:59:51.821366   96698 main.go:141] libmachine: Decoding PEM data...
	I0304 17:59:51.821378   96698 main.go:141] libmachine: Parsing certificate...
	I0304 17:59:51.821395   96698 main.go:141] libmachine: Running pre-create checks...
	I0304 17:59:51.821404   96698 main.go:141] libmachine: (auto-612000) Calling .PreCreateCheck
	I0304 17:59:51.821485   96698 main.go:141] libmachine: (auto-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:59:51.821635   96698 main.go:141] libmachine: (auto-612000) Calling .GetConfigRaw
	I0304 17:59:51.831187   96698 main.go:141] libmachine: Creating machine...
	I0304 17:59:51.831208   96698 main.go:141] libmachine: (auto-612000) Calling .Create
	I0304 17:59:51.831383   96698 main.go:141] libmachine: (auto-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:59:51.831608   96698 main.go:141] libmachine: (auto-612000) DBG | I0304 17:59:51.831355   96706 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:59:51.831737   96698 main.go:141] libmachine: (auto-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 17:59:52.008472   96698 main.go:141] libmachine: (auto-612000) DBG | I0304 17:59:52.008403   96706 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/auto-612000/id_rsa...
	I0304 17:59:52.576179   96698 main.go:141] libmachine: (auto-612000) DBG | I0304 17:59:52.576085   96706 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/auto-612000/auto-612000.rawdisk...
	I0304 17:59:52.576211   96698 main.go:141] libmachine: (auto-612000) DBG | Writing magic tar header
	I0304 17:59:52.576219   96698 main.go:141] libmachine: (auto-612000) DBG | Writing SSH key tar header
	I0304 17:59:52.576862   96698 main.go:141] libmachine: (auto-612000) DBG | I0304 17:59:52.576805   96706 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/auto-612000 ...
	I0304 17:59:52.936090   96698 main.go:141] libmachine: (auto-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:59:52.936108   96698 main.go:141] libmachine: (auto-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/auto-612000/hyperkit.pid
	I0304 17:59:52.936138   96698 main.go:141] libmachine: (auto-612000) DBG | Using UUID baad131e-6a6b-44b8-9bca-7f16c4d7a0db
	I0304 17:59:52.970594   96698 main.go:141] libmachine: (auto-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 17:59:52.970685   96698 client.go:171] duration metric: took 1.149485141s to LocalClient.Create
	I0304 17:59:54.972561   96698 start.go:128] duration metric: took 3.183353354s to createHost
	I0304 17:59:54.972591   96698 start.go:83] releasing machines lock for "auto-612000", held for 3.183527519s
	W0304 17:59:54.972630   96698 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 17:59:54.973302   96698 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:59:54.973350   96698 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:59:54.982593   96698 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64434
	I0304 17:59:54.982942   96698 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:59:54.983321   96698 main.go:141] libmachine: Using API Version  1
	I0304 17:59:54.983335   96698 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:59:54.983549   96698 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:59:54.983881   96698 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 17:59:54.983906   96698 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:59:54.991769   96698 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64436
	I0304 17:59:54.992102   96698 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:59:54.992464   96698 main.go:141] libmachine: Using API Version  1
	I0304 17:59:54.992481   96698 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:59:54.992671   96698 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:59:54.992782   96698 main.go:141] libmachine: (auto-612000) Calling .GetState
	I0304 17:59:54.992861   96698 main.go:141] libmachine: (auto-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:59:54.992872   96698 main.go:141] libmachine: (auto-612000) DBG | hyperkit pid from json: 0
	I0304 17:59:54.992906   96698 main.go:141] libmachine: (auto-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/auto-612000/hyperkit.json: no such file or directory
	I0304 17:59:54.992932   96698 main.go:141] libmachine: (auto-612000) Calling .DriverName
	I0304 17:59:55.046408   96698 out.go:177] * Deleting "auto-612000" in hyperkit ...
	I0304 17:59:55.067237   96698 main.go:141] libmachine: (auto-612000) Calling .Remove
	I0304 17:59:55.067529   96698 main.go:141] libmachine: (auto-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:59:55.067557   96698 main.go:141] libmachine: (auto-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 17:59:55.067597   96698 main.go:141] libmachine: (auto-612000) DBG | hyperkit pid from json: 0
	I0304 17:59:55.067620   96698 main.go:141] libmachine: (auto-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/auto-612000/hyperkit.json: no such file or directory
	W0304 17:59:55.086447   96698 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 17:59:55.086460   96698 start.go:728] Will try again in 5 seconds ...
	I0304 18:00:00.086891   96698 start.go:360] acquireMachinesLock for auto-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:00:00.087092   96698 start.go:364] duration metric: took 163.728µs to acquireMachinesLock for "auto-612000"
	I0304 18:00:00.087121   96698 start.go:93] Provisioning new machine with config: &{Name:auto-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.28.4 ClusterName:auto-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mou
ntType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:00:00.087220   96698 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:00:00.110751   96698 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:00:00.110930   96698 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:00.110981   96698 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:00.120499   96698 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64438
	I0304 18:00:00.120850   96698 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:00.121238   96698 main.go:141] libmachine: Using API Version  1
	I0304 18:00:00.121252   96698 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:00.121454   96698 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:00.121568   96698 main.go:141] libmachine: (auto-612000) Calling .GetMachineName
	I0304 18:00:00.121648   96698 main.go:141] libmachine: (auto-612000) Calling .DriverName
	I0304 18:00:00.121751   96698 start.go:159] libmachine.API.Create for "auto-612000" (driver="hyperkit")
	I0304 18:00:00.121777   96698 client.go:168] LocalClient.Create starting
	I0304 18:00:00.121803   96698 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:00:00.121849   96698 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:00.121860   96698 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:00.121899   96698 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:00:00.121934   96698 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:00.121949   96698 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:00.121967   96698 main.go:141] libmachine: Running pre-create checks...
	I0304 18:00:00.121972   96698 main.go:141] libmachine: (auto-612000) Calling .PreCreateCheck
	I0304 18:00:00.122045   96698 main.go:141] libmachine: (auto-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:00.122062   96698 main.go:141] libmachine: (auto-612000) Calling .GetConfigRaw
	I0304 18:00:00.122689   96698 main.go:141] libmachine: Creating machine...
	I0304 18:00:00.122698   96698 main.go:141] libmachine: (auto-612000) Calling .Create
	I0304 18:00:00.122774   96698 main.go:141] libmachine: (auto-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:00.122889   96698 main.go:141] libmachine: (auto-612000) DBG | I0304 18:00:00.122764   96714 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:00.122939   96698 main.go:141] libmachine: (auto-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:00:00.297884   96698 main.go:141] libmachine: (auto-612000) DBG | I0304 18:00:00.297819   96714 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/auto-612000/id_rsa...
	I0304 18:00:00.414824   96698 main.go:141] libmachine: (auto-612000) DBG | I0304 18:00:00.414755   96714 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/auto-612000/auto-612000.rawdisk...
	I0304 18:00:00.414840   96698 main.go:141] libmachine: (auto-612000) DBG | Writing magic tar header
	I0304 18:00:00.414852   96698 main.go:141] libmachine: (auto-612000) DBG | Writing SSH key tar header
	I0304 18:00:00.415723   96698 main.go:141] libmachine: (auto-612000) DBG | I0304 18:00:00.415661   96714 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/auto-612000 ...
	I0304 18:00:00.780923   96698 main.go:141] libmachine: (auto-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:00.780942   96698 main.go:141] libmachine: (auto-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/auto-612000/hyperkit.pid
	I0304 18:00:00.780957   96698 main.go:141] libmachine: (auto-612000) DBG | Using UUID 4ea2d2a6-15c8-4548-a7a3-f1634467b2a4
	I0304 18:00:00.818424   96698 main.go:141] libmachine: (auto-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:00:00.818507   96698 client.go:171] duration metric: took 696.715423ms to LocalClient.Create
	I0304 18:00:02.818695   96698 start.go:128] duration metric: took 2.731430003s to createHost
	I0304 18:00:02.818725   96698 start.go:83] releasing machines lock for "auto-612000", held for 2.731589147s
	W0304 18:00:02.818852   96698 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p auto-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p auto-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:00:02.863081   96698 out.go:177] 
	W0304 18:00:02.886281   96698 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:00:02.886345   96698 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:00:02.886363   96698 out.go:239] * Related issues:
	* Related issues:
	W0304 18:00:02.886383   96698 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:00:02.886442   96698 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:00:02.908241   96698 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/auto/Start (11.68s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (11.34s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p calico-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p calico-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=hyperkit : exit status 60 (11.338727929s)

                                                
                                                
-- stdout --
	* [calico-612000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "calico-612000" primary control-plane node in "calico-612000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "calico-612000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:00:08.928954   96868 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:00:08.929598   96868 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:00:08.929608   96868 out.go:304] Setting ErrFile to fd 2...
	I0304 18:00:08.929614   96868 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:00:08.930205   96868 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:00:08.931750   96868 out.go:298] Setting JSON to false
	I0304 18:00:08.954314   96868 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25177,"bootTime":1709578831,"procs":531,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:00:08.954444   96868 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:00:08.977584   96868 out.go:177] * [calico-612000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:00:09.019850   96868 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:00:09.020002   96868 notify.go:220] Checking for updates...
	I0304 18:00:09.062641   96868 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:00:09.083684   96868 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:00:09.104458   96868 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:00:09.125735   96868 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:09.146793   96868 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:00:09.168344   96868 config.go:182] Loaded profile config "cert-expiration-767000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:00:09.168533   96868 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:00:09.168735   96868 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:00:09.197581   96868 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 18:00:09.239563   96868 start.go:297] selected driver: hyperkit
	I0304 18:00:09.239591   96868 start.go:901] validating driver "hyperkit" against <nil>
	I0304 18:00:09.239611   96868 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:00:09.244018   96868 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:00:09.244120   96868 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:00:09.251997   96868 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:00:09.255958   96868 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:09.255981   96868 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:00:09.256012   96868 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 18:00:09.256238   96868 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:00:09.256294   96868 cni.go:84] Creating CNI manager for "calico"
	I0304 18:00:09.256306   96868 start_flags.go:319] Found "Calico" CNI - setting NetworkPlugin=cni
	I0304 18:00:09.256371   96868 start.go:340] cluster config:
	{Name:calico-612000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:calico-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunti
me:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSoc
k: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:00:09.256482   96868 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:00:09.277700   96868 out.go:177] * Starting "calico-612000" primary control-plane node in "calico-612000" cluster
	I0304 18:00:09.298655   96868 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 18:00:09.298741   96868 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 18:00:09.298769   96868 cache.go:56] Caching tarball of preloaded images
	I0304 18:00:09.298990   96868 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:00:09.299013   96868 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 18:00:09.299180   96868 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/calico-612000/config.json ...
	I0304 18:00:09.299221   96868 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/calico-612000/config.json: {Name:mk534f1bf972126f60936ecb84965c3b953c591d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 18:00:09.299999   96868 start.go:360] acquireMachinesLock for calico-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:00:09.300116   96868 start.go:364] duration metric: took 94.083µs to acquireMachinesLock for "calico-612000"
	I0304 18:00:09.300159   96868 start.go:93] Provisioning new machine with config: &{Name:calico-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:calico-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:00:09.300242   96868 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:00:09.342692   96868 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:00:09.342960   96868 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:09.343032   96868 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:09.351885   96868 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64514
	I0304 18:00:09.352280   96868 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:09.352703   96868 main.go:141] libmachine: Using API Version  1
	I0304 18:00:09.352714   96868 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:09.352922   96868 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:09.353018   96868 main.go:141] libmachine: (calico-612000) Calling .GetMachineName
	I0304 18:00:09.353104   96868 main.go:141] libmachine: (calico-612000) Calling .DriverName
	I0304 18:00:09.353285   96868 start.go:159] libmachine.API.Create for "calico-612000" (driver="hyperkit")
	I0304 18:00:09.353312   96868 client.go:168] LocalClient.Create starting
	I0304 18:00:09.353344   96868 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:00:09.353397   96868 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:09.353410   96868 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:09.353476   96868 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:00:09.353515   96868 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:09.353528   96868 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:09.353543   96868 main.go:141] libmachine: Running pre-create checks...
	I0304 18:00:09.353552   96868 main.go:141] libmachine: (calico-612000) Calling .PreCreateCheck
	I0304 18:00:09.353635   96868 main.go:141] libmachine: (calico-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:09.353839   96868 main.go:141] libmachine: (calico-612000) Calling .GetConfigRaw
	I0304 18:00:09.354286   96868 main.go:141] libmachine: Creating machine...
	I0304 18:00:09.354294   96868 main.go:141] libmachine: (calico-612000) Calling .Create
	I0304 18:00:09.354373   96868 main.go:141] libmachine: (calico-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:09.354502   96868 main.go:141] libmachine: (calico-612000) DBG | I0304 18:00:09.354364   96876 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:09.354556   96868 main.go:141] libmachine: (calico-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:00:09.529615   96868 main.go:141] libmachine: (calico-612000) DBG | I0304 18:00:09.529547   96876 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/calico-612000/id_rsa...
	I0304 18:00:09.827399   96868 main.go:141] libmachine: (calico-612000) DBG | I0304 18:00:09.827307   96876 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/calico-612000/calico-612000.rawdisk...
	I0304 18:00:09.827418   96868 main.go:141] libmachine: (calico-612000) DBG | Writing magic tar header
	I0304 18:00:09.827432   96868 main.go:141] libmachine: (calico-612000) DBG | Writing SSH key tar header
	I0304 18:00:09.828292   96868 main.go:141] libmachine: (calico-612000) DBG | I0304 18:00:09.828170   96876 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/calico-612000 ...
	I0304 18:00:10.188527   96868 main.go:141] libmachine: (calico-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:10.188547   96868 main.go:141] libmachine: (calico-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/calico-612000/hyperkit.pid
	I0304 18:00:10.188559   96868 main.go:141] libmachine: (calico-612000) DBG | Using UUID ad0d9b6e-4ec7-40c5-9121-352be00171a1
	I0304 18:00:10.225737   96868 main.go:141] libmachine: (calico-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:00:10.225827   96868 client.go:171] duration metric: took 872.49572ms to LocalClient.Create
	I0304 18:00:12.226868   96868 start.go:128] duration metric: took 2.926572613s to createHost
	I0304 18:00:12.226899   96868 start.go:83] releasing machines lock for "calico-612000", held for 2.926738822s
	W0304 18:00:12.226971   96868 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 18:00:12.227514   96868 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:12.227560   96868 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:12.237049   96868 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64516
	I0304 18:00:12.237579   96868 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:12.238075   96868 main.go:141] libmachine: Using API Version  1
	I0304 18:00:12.238087   96868 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:12.238349   96868 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:12.238678   96868 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:12.238696   96868 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:12.246605   96868 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64518
	I0304 18:00:12.246958   96868 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:12.247320   96868 main.go:141] libmachine: Using API Version  1
	I0304 18:00:12.247333   96868 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:12.247530   96868 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:12.247640   96868 main.go:141] libmachine: (calico-612000) Calling .GetState
	I0304 18:00:12.247716   96868 main.go:141] libmachine: (calico-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:12.247760   96868 main.go:141] libmachine: (calico-612000) DBG | hyperkit pid from json: 0
	I0304 18:00:12.247778   96868 main.go:141] libmachine: (calico-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/calico-612000/hyperkit.json: no such file or directory
	I0304 18:00:12.247779   96868 main.go:141] libmachine: (calico-612000) Calling .DriverName
	I0304 18:00:12.290016   96868 out.go:177] * Deleting "calico-612000" in hyperkit ...
	I0304 18:00:12.312329   96868 main.go:141] libmachine: (calico-612000) Calling .Remove
	I0304 18:00:12.312586   96868 main.go:141] libmachine: (calico-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:12.312617   96868 main.go:141] libmachine: (calico-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:12.312728   96868 main.go:141] libmachine: (calico-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/calico-612000/hyperkit.json: no such file or directory
	I0304 18:00:12.312781   96868 main.go:141] libmachine: (calico-612000) DBG | hyperkit pid from json: 0
	W0304 18:00:12.330634   96868 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:00:12.330646   96868 start.go:728] Will try again in 5 seconds ...
	I0304 18:00:17.331935   96868 start.go:360] acquireMachinesLock for calico-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:00:17.332143   96868 start.go:364] duration metric: took 168.727µs to acquireMachinesLock for "calico-612000"
	I0304 18:00:17.332190   96868 start.go:93] Provisioning new machine with config: &{Name:calico-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:calico-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:00:17.332308   96868 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:00:17.355253   96868 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:00:17.355391   96868 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:17.355436   96868 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:17.364882   96868 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64520
	I0304 18:00:17.365237   96868 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:17.365580   96868 main.go:141] libmachine: Using API Version  1
	I0304 18:00:17.365589   96868 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:17.365791   96868 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:17.365889   96868 main.go:141] libmachine: (calico-612000) Calling .GetMachineName
	I0304 18:00:17.365975   96868 main.go:141] libmachine: (calico-612000) Calling .DriverName
	I0304 18:00:17.366085   96868 start.go:159] libmachine.API.Create for "calico-612000" (driver="hyperkit")
	I0304 18:00:17.366099   96868 client.go:168] LocalClient.Create starting
	I0304 18:00:17.366125   96868 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:00:17.366171   96868 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:17.366180   96868 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:17.366225   96868 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:00:17.366262   96868 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:17.366275   96868 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:17.366288   96868 main.go:141] libmachine: Running pre-create checks...
	I0304 18:00:17.366293   96868 main.go:141] libmachine: (calico-612000) Calling .PreCreateCheck
	I0304 18:00:17.366369   96868 main.go:141] libmachine: (calico-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:17.366424   96868 main.go:141] libmachine: (calico-612000) Calling .GetConfigRaw
	I0304 18:00:17.366869   96868 main.go:141] libmachine: Creating machine...
	I0304 18:00:17.366877   96868 main.go:141] libmachine: (calico-612000) Calling .Create
	I0304 18:00:17.366961   96868 main.go:141] libmachine: (calico-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:17.367087   96868 main.go:141] libmachine: (calico-612000) DBG | I0304 18:00:17.366947   96886 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:17.367127   96868 main.go:141] libmachine: (calico-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:00:17.542022   96868 main.go:141] libmachine: (calico-612000) DBG | I0304 18:00:17.541957   96886 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/calico-612000/id_rsa...
	I0304 18:00:17.640061   96868 main.go:141] libmachine: (calico-612000) DBG | I0304 18:00:17.639990   96886 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/calico-612000/calico-612000.rawdisk...
	I0304 18:00:17.640074   96868 main.go:141] libmachine: (calico-612000) DBG | Writing magic tar header
	I0304 18:00:17.640085   96868 main.go:141] libmachine: (calico-612000) DBG | Writing SSH key tar header
	I0304 18:00:17.640981   96868 main.go:141] libmachine: (calico-612000) DBG | I0304 18:00:17.640890   96886 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/calico-612000 ...
	I0304 18:00:18.002109   96868 main.go:141] libmachine: (calico-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:18.002131   96868 main.go:141] libmachine: (calico-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/calico-612000/hyperkit.pid
	I0304 18:00:18.002146   96868 main.go:141] libmachine: (calico-612000) DBG | Using UUID 371e4883-7eb3-4048-9d6c-1ed6a6293279
	I0304 18:00:18.037995   96868 main.go:141] libmachine: (calico-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:00:18.038079   96868 client.go:171] duration metric: took 671.96669ms to LocalClient.Create
	I0304 18:00:20.039375   96868 start.go:128] duration metric: took 2.707020898s to createHost
	I0304 18:00:20.039409   96868 start.go:83] releasing machines lock for "calico-612000", held for 2.707216527s
	W0304 18:00:20.039566   96868 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p calico-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p calico-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:00:20.059930   96868 out.go:177] 
	W0304 18:00:20.082135   96868 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:00:20.082186   96868 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:00:20.082203   96868 out.go:239] * Related issues:
	* Related issues:
	W0304 18:00:20.082240   96868 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:00:20.082261   96868 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:00:20.106151   96868 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/calico/Start (11.34s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (11.29s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p custom-flannel-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p custom-flannel-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=hyperkit : exit status 60 (11.283529579s)

                                                
                                                
-- stdout --
	* [custom-flannel-612000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "custom-flannel-612000" primary control-plane node in "custom-flannel-612000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "custom-flannel-612000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:00:26.728470   97045 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:00:26.728644   97045 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:00:26.728649   97045 out.go:304] Setting ErrFile to fd 2...
	I0304 18:00:26.728653   97045 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:00:26.728837   97045 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:00:26.730261   97045 out.go:298] Setting JSON to false
	I0304 18:00:26.752704   97045 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25195,"bootTime":1709578831,"procs":532,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:00:26.752804   97045 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:00:26.774998   97045 out.go:177] * [custom-flannel-612000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:00:26.817634   97045 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:00:26.817691   97045 notify.go:220] Checking for updates...
	I0304 18:00:26.860370   97045 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:00:26.881470   97045 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:00:26.902323   97045 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:00:26.923380   97045 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:26.944600   97045 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:00:26.967504   97045 config.go:182] Loaded profile config "cert-expiration-767000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:00:26.967705   97045 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:00:26.967856   97045 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:00:26.997163   97045 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 18:00:27.039528   97045 start.go:297] selected driver: hyperkit
	I0304 18:00:27.039557   97045 start.go:901] validating driver "hyperkit" against <nil>
	I0304 18:00:27.039577   97045 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:00:27.043600   97045 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:00:27.043717   97045 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:00:27.051446   97045 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:00:27.055295   97045 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:27.055315   97045 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:00:27.055353   97045 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 18:00:27.055545   97045 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:00:27.055607   97045 cni.go:84] Creating CNI manager for "testdata/kube-flannel.yaml"
	I0304 18:00:27.055630   97045 start_flags.go:319] Found "testdata/kube-flannel.yaml" CNI - setting NetworkPlugin=cni
	I0304 18:00:27.055694   97045 start.go:340] cluster config:
	{Name:custom-flannel-612000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loca
l ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: S
ocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:00:27.055783   97045 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:00:27.098512   97045 out.go:177] * Starting "custom-flannel-612000" primary control-plane node in "custom-flannel-612000" cluster
	I0304 18:00:27.120625   97045 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 18:00:27.120697   97045 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 18:00:27.120726   97045 cache.go:56] Caching tarball of preloaded images
	I0304 18:00:27.120923   97045 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:00:27.120941   97045 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 18:00:27.121099   97045 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/custom-flannel-612000/config.json ...
	I0304 18:00:27.121135   97045 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/custom-flannel-612000/config.json: {Name:mkbdd8a2bcb75b2ec60c89549226c12a2a682f45 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 18:00:27.121874   97045 start.go:360] acquireMachinesLock for custom-flannel-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:00:27.122004   97045 start.go:364] duration metric: took 100.639µs to acquireMachinesLock for "custom-flannel-612000"
	I0304 18:00:27.122051   97045 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mou
ntMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:00:27.122136   97045 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:00:27.143440   97045 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:00:27.143713   97045 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:27.143814   97045 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:27.153266   97045 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64603
	I0304 18:00:27.153625   97045 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:27.154042   97045 main.go:141] libmachine: Using API Version  1
	I0304 18:00:27.154053   97045 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:27.154271   97045 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:27.154391   97045 main.go:141] libmachine: (custom-flannel-612000) Calling .GetMachineName
	I0304 18:00:27.154470   97045 main.go:141] libmachine: (custom-flannel-612000) Calling .DriverName
	I0304 18:00:27.154557   97045 start.go:159] libmachine.API.Create for "custom-flannel-612000" (driver="hyperkit")
	I0304 18:00:27.154590   97045 client.go:168] LocalClient.Create starting
	I0304 18:00:27.154623   97045 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:00:27.154674   97045 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:27.154689   97045 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:27.154748   97045 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:00:27.154796   97045 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:27.154806   97045 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:27.154819   97045 main.go:141] libmachine: Running pre-create checks...
	I0304 18:00:27.154825   97045 main.go:141] libmachine: (custom-flannel-612000) Calling .PreCreateCheck
	I0304 18:00:27.154896   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:27.155042   97045 main.go:141] libmachine: (custom-flannel-612000) Calling .GetConfigRaw
	I0304 18:00:27.164880   97045 main.go:141] libmachine: Creating machine...
	I0304 18:00:27.164903   97045 main.go:141] libmachine: (custom-flannel-612000) Calling .Create
	I0304 18:00:27.165150   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:27.165378   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | I0304 18:00:27.165116   97053 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:27.165553   97045 main.go:141] libmachine: (custom-flannel-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:00:27.341145   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | I0304 18:00:27.341073   97053 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/custom-flannel-612000/id_rsa...
	I0304 18:00:27.438815   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | I0304 18:00:27.438731   97053 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/custom-flannel-612000/custom-flannel-612000.rawdisk...
	I0304 18:00:27.438828   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | Writing magic tar header
	I0304 18:00:27.438842   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | Writing SSH key tar header
	I0304 18:00:27.439787   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | I0304 18:00:27.439676   97053 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/custom-flannel-612000 ...
	I0304 18:00:27.802203   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:27.802218   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/custom-flannel-612000/hyperkit.pid
	I0304 18:00:27.802258   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | Using UUID a7a5eee3-18f4-4c4b-be4b-57707580a23f
	I0304 18:00:27.837277   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:00:27.837370   97045 client.go:171] duration metric: took 682.762343ms to LocalClient.Create
	I0304 18:00:29.838393   97045 start.go:128] duration metric: took 2.716180619s to createHost
	I0304 18:00:29.838420   97045 start.go:83] releasing machines lock for "custom-flannel-612000", held for 2.716372225s
	W0304 18:00:29.838452   97045 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 18:00:29.838992   97045 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:29.839037   97045 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:29.848192   97045 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64605
	I0304 18:00:29.848585   97045 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:29.848973   97045 main.go:141] libmachine: Using API Version  1
	I0304 18:00:29.848995   97045 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:29.849202   97045 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:29.849543   97045 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:29.849569   97045 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:29.857529   97045 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64609
	I0304 18:00:29.857878   97045 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:29.858234   97045 main.go:141] libmachine: Using API Version  1
	I0304 18:00:29.858246   97045 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:29.858456   97045 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:29.858563   97045 main.go:141] libmachine: (custom-flannel-612000) Calling .GetState
	I0304 18:00:29.858640   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:29.858658   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | hyperkit pid from json: 0
	I0304 18:00:29.858669   97045 main.go:141] libmachine: (custom-flannel-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/custom-flannel-612000/hyperkit.json: no such file or directory
	I0304 18:00:29.858699   97045 main.go:141] libmachine: (custom-flannel-612000) Calling .DriverName
	I0304 18:00:29.915752   97045 out.go:177] * Deleting "custom-flannel-612000" in hyperkit ...
	I0304 18:00:29.957901   97045 main.go:141] libmachine: (custom-flannel-612000) Calling .Remove
	I0304 18:00:29.958143   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:29.958174   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:29.958205   97045 main.go:141] libmachine: (custom-flannel-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/custom-flannel-612000/hyperkit.json: no such file or directory
	I0304 18:00:29.958232   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | hyperkit pid from json: 0
	W0304 18:00:30.114463   97045 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:00:30.114493   97045 start.go:728] Will try again in 5 seconds ...
	I0304 18:00:35.114831   97045 start.go:360] acquireMachinesLock for custom-flannel-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:00:35.115009   97045 start.go:364] duration metric: took 142.171µs to acquireMachinesLock for "custom-flannel-612000"
	I0304 18:00:35.115059   97045 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mou
ntMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:00:35.115165   97045 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:00:35.137981   97045 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:00:35.138134   97045 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:35.138181   97045 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:35.147447   97045 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64625
	I0304 18:00:35.147843   97045 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:35.148174   97045 main.go:141] libmachine: Using API Version  1
	I0304 18:00:35.148203   97045 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:35.148413   97045 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:35.148521   97045 main.go:141] libmachine: (custom-flannel-612000) Calling .GetMachineName
	I0304 18:00:35.148617   97045 main.go:141] libmachine: (custom-flannel-612000) Calling .DriverName
	I0304 18:00:35.148711   97045 start.go:159] libmachine.API.Create for "custom-flannel-612000" (driver="hyperkit")
	I0304 18:00:35.148735   97045 client.go:168] LocalClient.Create starting
	I0304 18:00:35.148766   97045 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:00:35.148813   97045 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:35.148826   97045 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:35.148876   97045 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:00:35.148912   97045 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:35.148925   97045 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:35.148940   97045 main.go:141] libmachine: Running pre-create checks...
	I0304 18:00:35.148946   97045 main.go:141] libmachine: (custom-flannel-612000) Calling .PreCreateCheck
	I0304 18:00:35.149021   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:35.149054   97045 main.go:141] libmachine: (custom-flannel-612000) Calling .GetConfigRaw
	I0304 18:00:35.149563   97045 main.go:141] libmachine: Creating machine...
	I0304 18:00:35.149572   97045 main.go:141] libmachine: (custom-flannel-612000) Calling .Create
	I0304 18:00:35.149639   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:35.149766   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | I0304 18:00:35.149633   97080 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:35.149814   97045 main.go:141] libmachine: (custom-flannel-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:00:35.329243   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | I0304 18:00:35.329182   97080 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/custom-flannel-612000/id_rsa...
	I0304 18:00:35.381223   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | I0304 18:00:35.381170   97080 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/custom-flannel-612000/custom-flannel-612000.rawdisk...
	I0304 18:00:35.381237   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | Writing magic tar header
	I0304 18:00:35.381268   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | Writing SSH key tar header
	I0304 18:00:35.381684   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | I0304 18:00:35.381639   97080 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/custom-flannel-612000 ...
	I0304 18:00:35.744668   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:35.744686   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/custom-flannel-612000/hyperkit.pid
	I0304 18:00:35.744734   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | Using UUID cd023129-e7dd-4039-a55f-705c84495739
	I0304 18:00:35.779231   97045 main.go:141] libmachine: (custom-flannel-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:00:35.779314   97045 client.go:171] duration metric: took 630.563585ms to LocalClient.Create
	I0304 18:00:37.781461   97045 start.go:128] duration metric: took 2.666248151s to createHost
	I0304 18:00:37.781484   97045 start.go:83] releasing machines lock for "custom-flannel-612000", held for 2.666430546s
	W0304 18:00:37.781580   97045 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p custom-flannel-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p custom-flannel-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:00:37.825967   97045 out.go:177] 
	W0304 18:00:37.846694   97045 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:00:37.846745   97045 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:00:37.846779   97045 out.go:239] * Related issues:
	* Related issues:
	W0304 18:00:37.846813   97045 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:00:37.846871   97045 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:00:37.888748   97045 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/custom-flannel/Start (11.29s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Start (11.52s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p false-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p false-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=hyperkit : exit status 60 (11.514857905s)

                                                
                                                
-- stdout --
	* [false-612000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "false-612000" primary control-plane node in "false-612000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "false-612000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:00:30.515730   97068 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:00:30.516472   97068 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:00:30.516480   97068 out.go:304] Setting ErrFile to fd 2...
	I0304 18:00:30.516487   97068 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:00:30.517173   97068 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:00:30.518789   97068 out.go:298] Setting JSON to false
	I0304 18:00:30.541410   97068 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25199,"bootTime":1709578831,"procs":533,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:00:30.541499   97068 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:00:30.563096   97068 out.go:177] * [false-612000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:00:30.626554   97068 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:00:30.605693   97068 notify.go:220] Checking for updates...
	I0304 18:00:30.647516   97068 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:00:30.668802   97068 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:00:30.689757   97068 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:00:30.710429   97068 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:30.731853   97068 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:00:30.753488   97068 config.go:182] Loaded profile config "custom-flannel-612000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:00:30.753686   97068 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:00:30.753852   97068 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:00:30.783426   97068 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 18:00:30.804850   97068 start.go:297] selected driver: hyperkit
	I0304 18:00:30.804875   97068 start.go:901] validating driver "hyperkit" against <nil>
	I0304 18:00:30.804895   97068 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:00:30.809328   97068 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:00:30.809427   97068 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:00:30.817361   97068 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:00:30.821299   97068 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:30.821322   97068 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:00:30.821354   97068 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 18:00:30.821581   97068 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:00:30.821635   97068 cni.go:84] Creating CNI manager for "false"
	I0304 18:00:30.821714   97068 start.go:340] cluster config:
	{Name:false-612000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:false-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSH
AgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:00:30.821808   97068 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:00:30.842827   97068 out.go:177] * Starting "false-612000" primary control-plane node in "false-612000" cluster
	I0304 18:00:30.863544   97068 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 18:00:30.863615   97068 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 18:00:30.863639   97068 cache.go:56] Caching tarball of preloaded images
	I0304 18:00:30.863852   97068 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:00:30.863873   97068 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 18:00:30.864022   97068 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/false-612000/config.json ...
	I0304 18:00:30.864056   97068 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/false-612000/config.json: {Name:mk63bb13bb008fb57c3e953dd8f4322a00347e93 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 18:00:30.864611   97068 start.go:360] acquireMachinesLock for false-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:00:30.864708   97068 start.go:364] duration metric: took 76.355µs to acquireMachinesLock for "false-612000"
	I0304 18:00:30.864741   97068 start.go:93] Provisioning new machine with config: &{Name:false-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Ku
bernetesVersion:v1.28.4 ClusterName:false-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0
MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:00:30.864804   97068 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:00:30.906619   97068 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:00:30.906904   97068 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:30.906977   97068 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:30.916159   97068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64619
	I0304 18:00:30.916518   97068 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:30.916945   97068 main.go:141] libmachine: Using API Version  1
	I0304 18:00:30.916962   97068 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:30.917207   97068 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:30.917309   97068 main.go:141] libmachine: (false-612000) Calling .GetMachineName
	I0304 18:00:30.917397   97068 main.go:141] libmachine: (false-612000) Calling .DriverName
	I0304 18:00:30.917498   97068 start.go:159] libmachine.API.Create for "false-612000" (driver="hyperkit")
	I0304 18:00:30.917519   97068 client.go:168] LocalClient.Create starting
	I0304 18:00:30.917556   97068 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:00:30.917607   97068 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:30.917625   97068 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:30.917685   97068 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:00:30.917720   97068 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:30.917731   97068 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:30.917743   97068 main.go:141] libmachine: Running pre-create checks...
	I0304 18:00:30.917753   97068 main.go:141] libmachine: (false-612000) Calling .PreCreateCheck
	I0304 18:00:30.917823   97068 main.go:141] libmachine: (false-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:30.918022   97068 main.go:141] libmachine: (false-612000) Calling .GetConfigRaw
	I0304 18:00:30.918496   97068 main.go:141] libmachine: Creating machine...
	I0304 18:00:30.918504   97068 main.go:141] libmachine: (false-612000) Calling .Create
	I0304 18:00:30.918570   97068 main.go:141] libmachine: (false-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:30.918686   97068 main.go:141] libmachine: (false-612000) DBG | I0304 18:00:30.918558   97076 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:30.918744   97068 main.go:141] libmachine: (false-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:00:31.094023   97068 main.go:141] libmachine: (false-612000) DBG | I0304 18:00:31.093962   97076 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/false-612000/id_rsa...
	I0304 18:00:31.163946   97068 main.go:141] libmachine: (false-612000) DBG | I0304 18:00:31.163870   97076 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/false-612000/false-612000.rawdisk...
	I0304 18:00:31.163959   97068 main.go:141] libmachine: (false-612000) DBG | Writing magic tar header
	I0304 18:00:31.163967   97068 main.go:141] libmachine: (false-612000) DBG | Writing SSH key tar header
	I0304 18:00:31.164854   97068 main.go:141] libmachine: (false-612000) DBG | I0304 18:00:31.164754   97076 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/false-612000 ...
	I0304 18:00:31.527632   97068 main.go:141] libmachine: (false-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:31.527680   97068 main.go:141] libmachine: (false-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/false-612000/hyperkit.pid
	I0304 18:00:31.527724   97068 main.go:141] libmachine: (false-612000) DBG | Using UUID 36acde3d-fa6e-412a-90c6-9e166236981d
	I0304 18:00:31.563908   97068 main.go:141] libmachine: (false-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:00:31.563993   97068 client.go:171] duration metric: took 646.457072ms to LocalClient.Create
	I0304 18:00:33.564137   97068 start.go:128] duration metric: took 2.699281782s to createHost
	I0304 18:00:33.564174   97068 start.go:83] releasing machines lock for "false-612000", held for 2.699427465s
	W0304 18:00:33.564193   97068 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 18:00:33.564582   97068 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:33.564604   97068 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:33.572560   97068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64621
	I0304 18:00:33.572941   97068 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:33.573335   97068 main.go:141] libmachine: Using API Version  1
	I0304 18:00:33.573354   97068 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:33.573567   97068 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:33.573890   97068 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:33.573911   97068 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:33.581687   97068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64623
	I0304 18:00:33.582032   97068 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:33.582363   97068 main.go:141] libmachine: Using API Version  1
	I0304 18:00:33.582373   97068 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:33.582579   97068 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:33.582683   97068 main.go:141] libmachine: (false-612000) Calling .GetState
	I0304 18:00:33.582771   97068 main.go:141] libmachine: (false-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:33.582818   97068 main.go:141] libmachine: (false-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/false-612000/hyperkit.json: no such file or directory
	I0304 18:00:33.582836   97068 main.go:141] libmachine: (false-612000) DBG | hyperkit pid from json: 0
	I0304 18:00:33.582881   97068 main.go:141] libmachine: (false-612000) Calling .DriverName
	I0304 18:00:33.627221   97068 out.go:177] * Deleting "false-612000" in hyperkit ...
	I0304 18:00:33.649099   97068 main.go:141] libmachine: (false-612000) Calling .Remove
	I0304 18:00:33.649388   97068 main.go:141] libmachine: (false-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:33.649408   97068 main.go:141] libmachine: (false-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:33.649428   97068 main.go:141] libmachine: (false-612000) DBG | hyperkit pid from json: 0
	I0304 18:00:33.649534   97068 main.go:141] libmachine: (false-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/false-612000/hyperkit.json: no such file or directory
	W0304 18:00:33.666560   97068 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:00:33.666573   97068 start.go:728] Will try again in 5 seconds ...
	I0304 18:00:38.666736   97068 start.go:360] acquireMachinesLock for false-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:00:38.666803   97068 start.go:364] duration metric: took 49.327µs to acquireMachinesLock for "false-612000"
	I0304 18:00:38.666820   97068 start.go:93] Provisioning new machine with config: &{Name:false-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Ku
bernetesVersion:v1.28.4 ClusterName:false-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0
MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:00:38.666901   97068 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:00:38.687720   97068 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:00:38.687909   97068 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:38.687982   97068 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:38.697559   97068 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64633
	I0304 18:00:38.697913   97068 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:38.698262   97068 main.go:141] libmachine: Using API Version  1
	I0304 18:00:38.698276   97068 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:38.698480   97068 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:38.698586   97068 main.go:141] libmachine: (false-612000) Calling .GetMachineName
	I0304 18:00:38.698673   97068 main.go:141] libmachine: (false-612000) Calling .DriverName
	I0304 18:00:38.698777   97068 start.go:159] libmachine.API.Create for "false-612000" (driver="hyperkit")
	I0304 18:00:38.698794   97068 client.go:168] LocalClient.Create starting
	I0304 18:00:38.698820   97068 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:00:38.698855   97068 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:38.698864   97068 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:38.698904   97068 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:00:38.698929   97068 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:38.698944   97068 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:38.698964   97068 main.go:141] libmachine: Running pre-create checks...
	I0304 18:00:38.698968   97068 main.go:141] libmachine: (false-612000) Calling .PreCreateCheck
	I0304 18:00:38.699061   97068 main.go:141] libmachine: (false-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:38.699117   97068 main.go:141] libmachine: (false-612000) Calling .GetConfigRaw
	I0304 18:00:38.729574   97068 main.go:141] libmachine: Creating machine...
	I0304 18:00:38.729597   97068 main.go:141] libmachine: (false-612000) Calling .Create
	I0304 18:00:38.729833   97068 main.go:141] libmachine: (false-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:38.730140   97068 main.go:141] libmachine: (false-612000) DBG | I0304 18:00:38.729789   97102 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:38.730248   97068 main.go:141] libmachine: (false-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:00:39.073435   97068 main.go:141] libmachine: (false-612000) DBG | I0304 18:00:39.073380   97102 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/false-612000/id_rsa...
	I0304 18:00:39.166464   97068 main.go:141] libmachine: (false-612000) DBG | I0304 18:00:39.166373   97102 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/false-612000/false-612000.rawdisk...
	I0304 18:00:39.166489   97068 main.go:141] libmachine: (false-612000) DBG | Writing magic tar header
	I0304 18:00:39.166504   97068 main.go:141] libmachine: (false-612000) DBG | Writing SSH key tar header
	I0304 18:00:39.167174   97068 main.go:141] libmachine: (false-612000) DBG | I0304 18:00:39.167106   97102 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/false-612000 ...
	I0304 18:00:39.529026   97068 main.go:141] libmachine: (false-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:39.529047   97068 main.go:141] libmachine: (false-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/false-612000/hyperkit.pid
	I0304 18:00:39.529057   97068 main.go:141] libmachine: (false-612000) DBG | Using UUID 3001f779-77ac-411f-b50c-5591c78c7396
	I0304 18:00:39.696390   97068 main.go:141] libmachine: (false-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:00:39.696482   97068 client.go:171] duration metric: took 997.670063ms to LocalClient.Create
	I0304 18:00:41.697304   97068 start.go:128] duration metric: took 3.030339183s to createHost
	I0304 18:00:41.697340   97068 start.go:83] releasing machines lock for "false-612000", held for 3.030494881s
	W0304 18:00:41.697493   97068 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p false-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p false-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:00:41.762188   97068 out.go:177] 
	W0304 18:00:41.804336   97068 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:00:41.804408   97068 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:00:41.804430   97068 out.go:239] * Related issues:
	* Related issues:
	W0304 18:00:41.804468   97068 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:00:41.804491   97068 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:00:41.867259   97068 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/false/Start (11.52s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (12.07s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p kindnet-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kindnet-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=hyperkit : exit status 60 (12.071916235s)

                                                
                                                
-- stdout --
	* [kindnet-612000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "kindnet-612000" primary control-plane node in "kindnet-612000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "kindnet-612000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:00:45.180009   97293 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:00:45.202470   97293 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:00:45.202486   97293 out.go:304] Setting ErrFile to fd 2...
	I0304 18:00:45.202492   97293 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:00:45.202762   97293 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:00:45.204746   97293 out.go:298] Setting JSON to false
	I0304 18:00:45.229914   97293 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25214,"bootTime":1709578831,"procs":548,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:00:45.230017   97293 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:00:45.251225   97293 out.go:177] * [kindnet-612000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:00:45.314255   97293 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:00:45.293427   97293 notify.go:220] Checking for updates...
	I0304 18:00:45.398370   97293 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:00:45.440122   97293 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:00:45.461332   97293 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:00:45.484412   97293 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:45.505158   97293 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:00:45.526788   97293 config.go:182] Loaded profile config "false-612000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:00:45.526891   97293 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:00:45.526983   97293 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:00:45.556370   97293 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 18:00:45.598341   97293 start.go:297] selected driver: hyperkit
	I0304 18:00:45.598358   97293 start.go:901] validating driver "hyperkit" against <nil>
	I0304 18:00:45.598374   97293 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:00:45.601605   97293 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:00:45.601706   97293 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:00:45.609436   97293 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:00:45.613268   97293 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:45.613291   97293 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:00:45.613324   97293 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 18:00:45.613546   97293 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:00:45.613603   97293 cni.go:84] Creating CNI manager for "kindnet"
	I0304 18:00:45.613616   97293 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0304 18:00:45.613678   97293 start.go:340] cluster config:
	{Name:kindnet-612000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:kindnet-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:00:45.613787   97293 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:00:45.661490   97293 out.go:177] * Starting "kindnet-612000" primary control-plane node in "kindnet-612000" cluster
	I0304 18:00:45.704370   97293 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 18:00:45.704442   97293 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 18:00:45.704471   97293 cache.go:56] Caching tarball of preloaded images
	I0304 18:00:45.704666   97293 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:00:45.704686   97293 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 18:00:45.704848   97293 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/kindnet-612000/config.json ...
	I0304 18:00:45.704889   97293 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/kindnet-612000/config.json: {Name:mkc39e54d5e10a8cbacba17f3e6442144e1b3b49 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 18:00:45.726246   97293 start.go:360] acquireMachinesLock for kindnet-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:00:45.726393   97293 start.go:364] duration metric: took 116.247µs to acquireMachinesLock for "kindnet-612000"
	I0304 18:00:45.726448   97293 start.go:93] Provisioning new machine with config: &{Name:kindnet-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kindnet-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:00:45.726556   97293 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:00:45.769211   97293 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:00:45.769360   97293 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:45.769406   97293 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:45.777826   97293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64739
	I0304 18:00:45.778209   97293 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:45.778643   97293 main.go:141] libmachine: Using API Version  1
	I0304 18:00:45.778654   97293 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:45.778912   97293 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:45.779060   97293 main.go:141] libmachine: (kindnet-612000) Calling .GetMachineName
	I0304 18:00:45.779159   97293 main.go:141] libmachine: (kindnet-612000) Calling .DriverName
	I0304 18:00:45.779259   97293 start.go:159] libmachine.API.Create for "kindnet-612000" (driver="hyperkit")
	I0304 18:00:45.779289   97293 client.go:168] LocalClient.Create starting
	I0304 18:00:45.779328   97293 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:00:45.779379   97293 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:45.779397   97293 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:45.779457   97293 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:00:45.779494   97293 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:45.779506   97293 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:45.779523   97293 main.go:141] libmachine: Running pre-create checks...
	I0304 18:00:45.779532   97293 main.go:141] libmachine: (kindnet-612000) Calling .PreCreateCheck
	I0304 18:00:45.779603   97293 main.go:141] libmachine: (kindnet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:45.779761   97293 main.go:141] libmachine: (kindnet-612000) Calling .GetConfigRaw
	I0304 18:00:45.780204   97293 main.go:141] libmachine: Creating machine...
	I0304 18:00:45.780212   97293 main.go:141] libmachine: (kindnet-612000) Calling .Create
	I0304 18:00:45.780299   97293 main.go:141] libmachine: (kindnet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:45.780431   97293 main.go:141] libmachine: (kindnet-612000) DBG | I0304 18:00:45.780288   97310 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:45.780485   97293 main.go:141] libmachine: (kindnet-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:00:46.245066   97293 main.go:141] libmachine: (kindnet-612000) DBG | I0304 18:00:46.245001   97310 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kindnet-612000/id_rsa...
	I0304 18:00:46.509304   97293 main.go:141] libmachine: (kindnet-612000) DBG | I0304 18:00:46.509195   97310 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kindnet-612000/kindnet-612000.rawdisk...
	I0304 18:00:46.509330   97293 main.go:141] libmachine: (kindnet-612000) DBG | Writing magic tar header
	I0304 18:00:46.509349   97293 main.go:141] libmachine: (kindnet-612000) DBG | Writing SSH key tar header
	I0304 18:00:46.530260   97293 main.go:141] libmachine: (kindnet-612000) DBG | I0304 18:00:46.530125   97310 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kindnet-612000 ...
	I0304 18:00:46.990020   97293 main.go:141] libmachine: (kindnet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:46.990044   97293 main.go:141] libmachine: (kindnet-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kindnet-612000/hyperkit.pid
	I0304 18:00:46.990100   97293 main.go:141] libmachine: (kindnet-612000) DBG | Using UUID dc0dcd26-4a70-48a2-9e40-984ea4a29596
	I0304 18:00:47.093144   97293 main.go:141] libmachine: (kindnet-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:00:47.093234   97293 client.go:171] duration metric: took 1.313920541s to LocalClient.Create
	I0304 18:00:49.093395   97293 start.go:128] duration metric: took 3.366762344s to createHost
	I0304 18:00:49.093407   97293 start.go:83] releasing machines lock for "kindnet-612000", held for 3.366964268s
	W0304 18:00:49.093422   97293 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 18:00:49.093751   97293 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:49.093782   97293 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:49.101931   97293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64783
	I0304 18:00:49.102289   97293 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:49.102659   97293 main.go:141] libmachine: Using API Version  1
	I0304 18:00:49.102673   97293 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:49.102867   97293 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:49.103187   97293 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:49.103215   97293 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:49.111239   97293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64785
	I0304 18:00:49.111631   97293 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:49.111987   97293 main.go:141] libmachine: Using API Version  1
	I0304 18:00:49.112001   97293 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:49.112189   97293 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:49.112276   97293 main.go:141] libmachine: (kindnet-612000) Calling .GetState
	I0304 18:00:49.112362   97293 main.go:141] libmachine: (kindnet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:49.112394   97293 main.go:141] libmachine: (kindnet-612000) DBG | hyperkit pid from json: 0
	I0304 18:00:49.112403   97293 main.go:141] libmachine: (kindnet-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kindnet-612000/hyperkit.json: no such file or directory
	I0304 18:00:49.112435   97293 main.go:141] libmachine: (kindnet-612000) Calling .DriverName
	I0304 18:00:49.184059   97293 out.go:177] * Deleting "kindnet-612000" in hyperkit ...
	I0304 18:00:49.225893   97293 main.go:141] libmachine: (kindnet-612000) Calling .Remove
	I0304 18:00:49.226232   97293 main.go:141] libmachine: (kindnet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:49.226259   97293 main.go:141] libmachine: (kindnet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:49.226280   97293 main.go:141] libmachine: (kindnet-612000) DBG | hyperkit pid from json: 0
	I0304 18:00:49.226319   97293 main.go:141] libmachine: (kindnet-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kindnet-612000/hyperkit.json: no such file or directory
	W0304 18:00:49.278042   97293 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:00:49.278058   97293 start.go:728] Will try again in 5 seconds ...
	I0304 18:00:54.279897   97293 start.go:360] acquireMachinesLock for kindnet-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:00:54.280009   97293 start.go:364] duration metric: took 78.81µs to acquireMachinesLock for "kindnet-612000"
	I0304 18:00:54.280048   97293 start.go:93] Provisioning new machine with config: &{Name:kindnet-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kindnet-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:00:54.280122   97293 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:00:54.301667   97293 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:00:54.301830   97293 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:54.301874   97293 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:54.311245   97293 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64793
	I0304 18:00:54.311650   97293 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:54.311989   97293 main.go:141] libmachine: Using API Version  1
	I0304 18:00:54.311999   97293 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:54.312203   97293 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:54.312319   97293 main.go:141] libmachine: (kindnet-612000) Calling .GetMachineName
	I0304 18:00:54.312406   97293 main.go:141] libmachine: (kindnet-612000) Calling .DriverName
	I0304 18:00:54.312513   97293 start.go:159] libmachine.API.Create for "kindnet-612000" (driver="hyperkit")
	I0304 18:00:54.312536   97293 client.go:168] LocalClient.Create starting
	I0304 18:00:54.312593   97293 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:00:54.312645   97293 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:54.312659   97293 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:54.312700   97293 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:00:54.312741   97293 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:54.312755   97293 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:54.312766   97293 main.go:141] libmachine: Running pre-create checks...
	I0304 18:00:54.312773   97293 main.go:141] libmachine: (kindnet-612000) Calling .PreCreateCheck
	I0304 18:00:54.312848   97293 main.go:141] libmachine: (kindnet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:54.312866   97293 main.go:141] libmachine: (kindnet-612000) Calling .GetConfigRaw
	I0304 18:00:54.313406   97293 main.go:141] libmachine: Creating machine...
	I0304 18:00:54.313415   97293 main.go:141] libmachine: (kindnet-612000) Calling .Create
	I0304 18:00:54.313498   97293 main.go:141] libmachine: (kindnet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:54.313618   97293 main.go:141] libmachine: (kindnet-612000) DBG | I0304 18:00:54.313487   97390 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:54.313654   97293 main.go:141] libmachine: (kindnet-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:00:54.489472   97293 main.go:141] libmachine: (kindnet-612000) DBG | I0304 18:00:54.489412   97390 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kindnet-612000/id_rsa...
	I0304 18:00:54.586222   97293 main.go:141] libmachine: (kindnet-612000) DBG | I0304 18:00:54.586148   97390 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kindnet-612000/kindnet-612000.rawdisk...
	I0304 18:00:54.586240   97293 main.go:141] libmachine: (kindnet-612000) DBG | Writing magic tar header
	I0304 18:00:54.586250   97293 main.go:141] libmachine: (kindnet-612000) DBG | Writing SSH key tar header
	I0304 18:00:54.586932   97293 main.go:141] libmachine: (kindnet-612000) DBG | I0304 18:00:54.586888   97390 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kindnet-612000 ...
	I0304 18:00:54.947505   97293 main.go:141] libmachine: (kindnet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:54.947524   97293 main.go:141] libmachine: (kindnet-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kindnet-612000/hyperkit.pid
	I0304 18:00:54.947558   97293 main.go:141] libmachine: (kindnet-612000) DBG | Using UUID 6db219fb-8e35-4bd7-9a33-f2cc8f82e10c
	I0304 18:00:54.984345   97293 main.go:141] libmachine: (kindnet-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:00:54.984424   97293 client.go:171] duration metric: took 671.87348ms to LocalClient.Create
	I0304 18:00:56.984618   97293 start.go:128] duration metric: took 2.704450096s to createHost
	I0304 18:00:56.984647   97293 start.go:83] releasing machines lock for "kindnet-612000", held for 2.704598608s
	W0304 18:00:56.984773   97293 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kindnet-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kindnet-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:00:57.028138   97293 out.go:177] 
	W0304 18:00:57.050283   97293 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:00:57.050365   97293 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:00:57.050381   97293 out.go:239] * Related issues:
	* Related issues:
	W0304 18:00:57.050437   97293 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:00:57.050456   97293 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:00:57.072353   97293 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/kindnet/Start (12.07s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (11.48s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p flannel-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p flannel-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=hyperkit : exit status 60 (11.474181293s)

                                                
                                                
-- stdout --
	* [flannel-612000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "flannel-612000" primary control-plane node in "flannel-612000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "flannel-612000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:00:48.751164   97372 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:00:48.751416   97372 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:00:48.751422   97372 out.go:304] Setting ErrFile to fd 2...
	I0304 18:00:48.751426   97372 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:00:48.751598   97372 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:00:48.753164   97372 out.go:298] Setting JSON to false
	I0304 18:00:48.775429   97372 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25217,"bootTime":1709578831,"procs":560,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:00:48.775520   97372 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:00:48.799111   97372 out.go:177] * [flannel-612000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:00:48.841030   97372 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:00:48.841134   97372 notify.go:220] Checking for updates...
	I0304 18:00:48.884002   97372 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:00:48.925890   97372 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:00:48.947018   97372 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:00:48.968150   97372 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:48.988965   97372 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:00:49.010857   97372 config.go:182] Loaded profile config "kindnet-612000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:00:49.011034   97372 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:00:49.011189   97372 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:00:49.040835   97372 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 18:00:49.082927   97372 start.go:297] selected driver: hyperkit
	I0304 18:00:49.082950   97372 start.go:901] validating driver "hyperkit" against <nil>
	I0304 18:00:49.082969   97372 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:00:49.087413   97372 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:00:49.087524   97372 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:00:49.095473   97372 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:00:49.099475   97372 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:49.099499   97372 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:00:49.099554   97372 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 18:00:49.099759   97372 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:00:49.099817   97372 cni.go:84] Creating CNI manager for "flannel"
	I0304 18:00:49.099827   97372 start_flags.go:319] Found "Flannel" CNI - setting NetworkPlugin=cni
	I0304 18:00:49.099901   97372 start.go:340] cluster config:
	{Name:flannel-612000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:flannel-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:00:49.099982   97372 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:00:49.141825   97372 out.go:177] * Starting "flannel-612000" primary control-plane node in "flannel-612000" cluster
	I0304 18:00:49.204969   97372 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 18:00:49.205041   97372 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 18:00:49.205071   97372 cache.go:56] Caching tarball of preloaded images
	I0304 18:00:49.205276   97372 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:00:49.205295   97372 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 18:00:49.205452   97372 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/flannel-612000/config.json ...
	I0304 18:00:49.205495   97372 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/flannel-612000/config.json: {Name:mkfed5a09ca2bcc3d404ba44d09d09d809762d06 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 18:00:49.226554   97372 start.go:360] acquireMachinesLock for flannel-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:00:49.226690   97372 start.go:364] duration metric: took 108.452µs to acquireMachinesLock for "flannel-612000"
	I0304 18:00:49.226740   97372 start.go:93] Provisioning new machine with config: &{Name:flannel-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:flannel-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:00:49.226836   97372 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:00:49.269829   97372 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:00:49.269989   97372 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:49.270029   97372 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:49.278643   97372 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64787
	I0304 18:00:49.279051   97372 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:49.279496   97372 main.go:141] libmachine: Using API Version  1
	I0304 18:00:49.279516   97372 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:49.279734   97372 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:49.279846   97372 main.go:141] libmachine: (flannel-612000) Calling .GetMachineName
	I0304 18:00:49.279928   97372 main.go:141] libmachine: (flannel-612000) Calling .DriverName
	I0304 18:00:49.280038   97372 start.go:159] libmachine.API.Create for "flannel-612000" (driver="hyperkit")
	I0304 18:00:49.280063   97372 client.go:168] LocalClient.Create starting
	I0304 18:00:49.280096   97372 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:00:49.280143   97372 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:49.280157   97372 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:49.280208   97372 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:00:49.280256   97372 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:49.280269   97372 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:49.280281   97372 main.go:141] libmachine: Running pre-create checks...
	I0304 18:00:49.280288   97372 main.go:141] libmachine: (flannel-612000) Calling .PreCreateCheck
	I0304 18:00:49.280377   97372 main.go:141] libmachine: (flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:49.280543   97372 main.go:141] libmachine: (flannel-612000) Calling .GetConfigRaw
	I0304 18:00:49.299754   97372 main.go:141] libmachine: Creating machine...
	I0304 18:00:49.299777   97372 main.go:141] libmachine: (flannel-612000) Calling .Create
	I0304 18:00:49.300042   97372 main.go:141] libmachine: (flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:49.300297   97372 main.go:141] libmachine: (flannel-612000) DBG | I0304 18:00:49.300001   97382 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:49.300390   97372 main.go:141] libmachine: (flannel-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:00:49.475189   97372 main.go:141] libmachine: (flannel-612000) DBG | I0304 18:00:49.475101   97382 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/flannel-612000/id_rsa...
	I0304 18:00:49.580957   97372 main.go:141] libmachine: (flannel-612000) DBG | I0304 18:00:49.580902   97382 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/flannel-612000/flannel-612000.rawdisk...
	I0304 18:00:49.580972   97372 main.go:141] libmachine: (flannel-612000) DBG | Writing magic tar header
	I0304 18:00:49.580983   97372 main.go:141] libmachine: (flannel-612000) DBG | Writing SSH key tar header
	I0304 18:00:49.581707   97372 main.go:141] libmachine: (flannel-612000) DBG | I0304 18:00:49.581674   97382 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/flannel-612000 ...
	I0304 18:00:49.943857   97372 main.go:141] libmachine: (flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:49.943889   97372 main.go:141] libmachine: (flannel-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/flannel-612000/hyperkit.pid
	I0304 18:00:49.943901   97372 main.go:141] libmachine: (flannel-612000) DBG | Using UUID 30125471-2ad7-4f19-a2f0-e95abc9bac81
	I0304 18:00:49.981229   97372 main.go:141] libmachine: (flannel-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:00:49.981323   97372 client.go:171] duration metric: took 701.241934ms to LocalClient.Create
	I0304 18:00:51.981672   97372 start.go:128] duration metric: took 2.754760508s to createHost
	I0304 18:00:51.981711   97372 start.go:83] releasing machines lock for "flannel-612000", held for 2.75497605s
	W0304 18:00:51.981778   97372 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 18:00:51.982424   97372 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:51.982472   97372 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:51.991387   97372 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64789
	I0304 18:00:51.991752   97372 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:51.992109   97372 main.go:141] libmachine: Using API Version  1
	I0304 18:00:51.992119   97372 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:51.992335   97372 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:51.992694   97372 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:51.992726   97372 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:52.000494   97372 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64791
	I0304 18:00:52.000832   97372 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:52.001216   97372 main.go:141] libmachine: Using API Version  1
	I0304 18:00:52.001231   97372 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:52.001416   97372 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:52.001512   97372 main.go:141] libmachine: (flannel-612000) Calling .GetState
	I0304 18:00:52.001594   97372 main.go:141] libmachine: (flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:52.001621   97372 main.go:141] libmachine: (flannel-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/flannel-612000/hyperkit.json: no such file or directory
	I0304 18:00:52.001630   97372 main.go:141] libmachine: (flannel-612000) DBG | hyperkit pid from json: 0
	I0304 18:00:52.001663   97372 main.go:141] libmachine: (flannel-612000) Calling .DriverName
	I0304 18:00:52.049019   97372 out.go:177] * Deleting "flannel-612000" in hyperkit ...
	I0304 18:00:52.070914   97372 main.go:141] libmachine: (flannel-612000) Calling .Remove
	I0304 18:00:52.071215   97372 main.go:141] libmachine: (flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:52.071239   97372 main.go:141] libmachine: (flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:52.071255   97372 main.go:141] libmachine: (flannel-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/flannel-612000/hyperkit.json: no such file or directory
	I0304 18:00:52.071278   97372 main.go:141] libmachine: (flannel-612000) DBG | hyperkit pid from json: 0
	W0304 18:00:52.089356   97372 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:00:52.089368   97372 start.go:728] Will try again in 5 seconds ...
	I0304 18:00:57.089566   97372 start.go:360] acquireMachinesLock for flannel-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:00:57.089718   97372 start.go:364] duration metric: took 120.968µs to acquireMachinesLock for "flannel-612000"
	I0304 18:00:57.089778   97372 start.go:93] Provisioning new machine with config: &{Name:flannel-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:flannel-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:00:57.089889   97372 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:00:57.200263   97372 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:00:57.200375   97372 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:00:57.200408   97372 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:00:57.208959   97372 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64795
	I0304 18:00:57.209370   97372 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:00:57.209745   97372 main.go:141] libmachine: Using API Version  1
	I0304 18:00:57.209759   97372 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:00:57.209984   97372 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:00:57.210086   97372 main.go:141] libmachine: (flannel-612000) Calling .GetMachineName
	I0304 18:00:57.210172   97372 main.go:141] libmachine: (flannel-612000) Calling .DriverName
	I0304 18:00:57.210264   97372 start.go:159] libmachine.API.Create for "flannel-612000" (driver="hyperkit")
	I0304 18:00:57.210284   97372 client.go:168] LocalClient.Create starting
	I0304 18:00:57.210315   97372 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:00:57.210353   97372 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:57.210363   97372 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:57.210408   97372 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:00:57.210434   97372 main.go:141] libmachine: Decoding PEM data...
	I0304 18:00:57.210447   97372 main.go:141] libmachine: Parsing certificate...
	I0304 18:00:57.210466   97372 main.go:141] libmachine: Running pre-create checks...
	I0304 18:00:57.210470   97372 main.go:141] libmachine: (flannel-612000) Calling .PreCreateCheck
	I0304 18:00:57.210538   97372 main.go:141] libmachine: (flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:57.210575   97372 main.go:141] libmachine: (flannel-612000) Calling .GetConfigRaw
	I0304 18:00:57.211022   97372 main.go:141] libmachine: Creating machine...
	I0304 18:00:57.211030   97372 main.go:141] libmachine: (flannel-612000) Calling .Create
	I0304 18:00:57.211100   97372 main.go:141] libmachine: (flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:57.211222   97372 main.go:141] libmachine: (flannel-612000) DBG | I0304 18:00:57.211088   97393 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:00:57.211269   97372 main.go:141] libmachine: (flannel-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:00:57.390365   97372 main.go:141] libmachine: (flannel-612000) DBG | I0304 18:00:57.390295   97393 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/flannel-612000/id_rsa...
	I0304 18:00:57.479017   97372 main.go:141] libmachine: (flannel-612000) DBG | I0304 18:00:57.478947   97393 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/flannel-612000/flannel-612000.rawdisk...
	I0304 18:00:57.479043   97372 main.go:141] libmachine: (flannel-612000) DBG | Writing magic tar header
	I0304 18:00:57.479060   97372 main.go:141] libmachine: (flannel-612000) DBG | Writing SSH key tar header
	I0304 18:00:57.479708   97372 main.go:141] libmachine: (flannel-612000) DBG | I0304 18:00:57.479671   97393 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/flannel-612000 ...
	I0304 18:00:57.917444   97372 main.go:141] libmachine: (flannel-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:00:57.917469   97372 main.go:141] libmachine: (flannel-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/flannel-612000/hyperkit.pid
	I0304 18:00:57.917487   97372 main.go:141] libmachine: (flannel-612000) DBG | Using UUID d8810716-706a-4c30-8b95-b6074b5a9b51
	I0304 18:00:57.956648   97372 main.go:141] libmachine: (flannel-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:00:57.956742   97372 client.go:171] duration metric: took 746.442646ms to LocalClient.Create
	I0304 18:00:59.958948   97372 start.go:128] duration metric: took 2.869006885s to createHost
	I0304 18:00:59.958992   97372 start.go:83] releasing machines lock for "flannel-612000", held for 2.869229455s
	W0304 18:00:59.959107   97372 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p flannel-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p flannel-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:00.017113   97372 out.go:177] 
	W0304 18:01:00.058939   97372 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:01:00.058987   97372 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:01:00.059007   97372 out.go:239] * Related issues:
	* Related issues:
	W0304 18:01:00.059018   97372 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:01:00.059032   97372 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:01:00.100923   97372 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/flannel/Start (11.48s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (11.77s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p enable-default-cni-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p enable-default-cni-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=hyperkit : exit status 60 (11.764202299s)

                                                
                                                
-- stdout --
	* [enable-default-cni-612000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "enable-default-cni-612000" primary control-plane node in "enable-default-cni-612000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "enable-default-cni-612000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:01:04.023010   97618 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:01:04.023274   97618 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:04.023280   97618 out.go:304] Setting ErrFile to fd 2...
	I0304 18:01:04.023284   97618 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:04.023467   97618 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:01:04.025723   97618 out.go:298] Setting JSON to false
	I0304 18:01:04.049071   97618 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25233,"bootTime":1709578831,"procs":550,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:01:04.049166   97618 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:01:04.120883   97618 out.go:177] * [enable-default-cni-612000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:01:04.162680   97618 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:01:04.162730   97618 notify.go:220] Checking for updates...
	I0304 18:01:04.204479   97618 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:01:04.247466   97618 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:01:04.289564   97618 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:01:04.352661   97618 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:04.415653   97618 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:01:04.436870   97618 config.go:182] Loaded profile config "flannel-612000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:01:04.436990   97618 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:01:04.437082   97618 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:01:04.466568   97618 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 18:01:04.508600   97618 start.go:297] selected driver: hyperkit
	I0304 18:01:04.508628   97618 start.go:901] validating driver "hyperkit" against <nil>
	I0304 18:01:04.508687   97618 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:01:04.513398   97618 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:04.513506   97618 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:01:04.521348   97618 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:01:04.525417   97618 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:04.525439   97618 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:01:04.525474   97618 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	E0304 18:01:04.525666   97618 start_flags.go:464] Found deprecated --enable-default-cni flag, setting --cni=bridge
	I0304 18:01:04.525689   97618 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:01:04.525742   97618 cni.go:84] Creating CNI manager for "bridge"
	I0304 18:01:04.525750   97618 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0304 18:01:04.525819   97618 start.go:340] cluster config:
	{Name:enable-default-cni-612000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPa
th: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:01:04.525909   97618 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:04.584451   97618 out.go:177] * Starting "enable-default-cni-612000" primary control-plane node in "enable-default-cni-612000" cluster
	I0304 18:01:04.626750   97618 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 18:01:04.626822   97618 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 18:01:04.626854   97618 cache.go:56] Caching tarball of preloaded images
	I0304 18:01:04.627059   97618 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:01:04.627078   97618 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 18:01:04.627227   97618 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/enable-default-cni-612000/config.json ...
	I0304 18:01:04.627269   97618 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/enable-default-cni-612000/config.json: {Name:mk900a03a66c1b2765cf11ed27e5ec4cc38de32a Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 18:01:04.648247   97618 start.go:360] acquireMachinesLock for enable-default-cni-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:01:04.648410   97618 start.go:364] duration metric: took 124.25µs to acquireMachinesLock for "enable-default-cni-612000"
	I0304 18:01:04.648471   97618 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:01:04.648591   97618 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:01:04.669535   97618 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:01:04.669685   97618 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:04.669724   97618 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:04.678161   97618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64912
	I0304 18:01:04.678552   97618 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:04.678973   97618 main.go:141] libmachine: Using API Version  1
	I0304 18:01:04.678983   97618 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:04.679226   97618 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:04.679343   97618 main.go:141] libmachine: (enable-default-cni-612000) Calling .GetMachineName
	I0304 18:01:04.679442   97618 main.go:141] libmachine: (enable-default-cni-612000) Calling .DriverName
	I0304 18:01:04.679539   97618 start.go:159] libmachine.API.Create for "enable-default-cni-612000" (driver="hyperkit")
	I0304 18:01:04.679564   97618 client.go:168] LocalClient.Create starting
	I0304 18:01:04.679597   97618 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:01:04.679653   97618 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:04.679671   97618 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:04.679728   97618 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:01:04.679763   97618 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:04.679771   97618 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:04.679783   97618 main.go:141] libmachine: Running pre-create checks...
	I0304 18:01:04.679794   97618 main.go:141] libmachine: (enable-default-cni-612000) Calling .PreCreateCheck
	I0304 18:01:04.679870   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:04.680071   97618 main.go:141] libmachine: (enable-default-cni-612000) Calling .GetConfigRaw
	I0304 18:01:04.680560   97618 main.go:141] libmachine: Creating machine...
	I0304 18:01:04.680568   97618 main.go:141] libmachine: (enable-default-cni-612000) Calling .Create
	I0304 18:01:04.680667   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:04.680766   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | I0304 18:01:04.680630   97636 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:04.680817   97618 main.go:141] libmachine: (enable-default-cni-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:01:05.057206   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | I0304 18:01:05.057144   97636 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/enable-default-cni-612000/id_rsa...
	I0304 18:01:05.173363   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | I0304 18:01:05.173251   97636 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/enable-default-cni-612000/enable-default-cni-612000.rawdisk...
	I0304 18:01:05.173377   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | Writing magic tar header
	I0304 18:01:05.173390   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | Writing SSH key tar header
	I0304 18:01:05.174020   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | I0304 18:01:05.173981   97636 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/enable-default-cni-612000 ...
	I0304 18:01:05.639780   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:05.639803   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/enable-default-cni-612000/hyperkit.pid
	I0304 18:01:05.639817   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | Using UUID 3789a434-424a-44ef-a667-6c421de49313
	I0304 18:01:05.680511   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:01:05.680619   97618 client.go:171] duration metric: took 1.00103345s to LocalClient.Create
	I0304 18:01:07.681487   97618 start.go:128] duration metric: took 3.03283924s to createHost
	I0304 18:01:07.681512   97618 start.go:83] releasing machines lock for "enable-default-cni-612000", held for 3.033054154s
	W0304 18:01:07.681542   97618 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 18:01:07.682101   97618 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:07.682150   97618 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:07.691502   97618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64952
	I0304 18:01:07.691879   97618 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:07.692224   97618 main.go:141] libmachine: Using API Version  1
	I0304 18:01:07.692240   97618 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:07.692491   97618 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:07.692836   97618 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:07.692860   97618 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:07.700798   97618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64954
	I0304 18:01:07.701160   97618 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:07.701520   97618 main.go:141] libmachine: Using API Version  1
	I0304 18:01:07.701538   97618 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:07.701729   97618 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:07.701820   97618 main.go:141] libmachine: (enable-default-cni-612000) Calling .GetState
	I0304 18:01:07.701897   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:07.701925   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | hyperkit pid from json: 0
	I0304 18:01:07.701934   97618 main.go:141] libmachine: (enable-default-cni-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/enable-default-cni-612000/hyperkit.json: no such file or directory
	I0304 18:01:07.701967   97618 main.go:141] libmachine: (enable-default-cni-612000) Calling .DriverName
	I0304 18:01:07.748267   97618 out.go:177] * Deleting "enable-default-cni-612000" in hyperkit ...
	I0304 18:01:07.769510   97618 main.go:141] libmachine: (enable-default-cni-612000) Calling .Remove
	I0304 18:01:07.769830   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:07.769851   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:07.769900   97618 main.go:141] libmachine: (enable-default-cni-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/enable-default-cni-612000/hyperkit.json: no such file or directory
	I0304 18:01:07.769917   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | hyperkit pid from json: 0
	W0304 18:01:07.828734   97618 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:07.828748   97618 start.go:728] Will try again in 5 seconds ...
	I0304 18:01:12.828993   97618 start.go:360] acquireMachinesLock for enable-default-cni-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:01:12.829174   97618 start.go:364] duration metric: took 147.89µs to acquireMachinesLock for "enable-default-cni-612000"
	I0304 18:01:12.829210   97618 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:01:12.829308   97618 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:01:12.853964   97618 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:01:12.854124   97618 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:12.854191   97618 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:12.864037   97618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64962
	I0304 18:01:12.864440   97618 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:12.864813   97618 main.go:141] libmachine: Using API Version  1
	I0304 18:01:12.864830   97618 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:12.865055   97618 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:12.865177   97618 main.go:141] libmachine: (enable-default-cni-612000) Calling .GetMachineName
	I0304 18:01:12.865299   97618 main.go:141] libmachine: (enable-default-cni-612000) Calling .DriverName
	I0304 18:01:12.865411   97618 start.go:159] libmachine.API.Create for "enable-default-cni-612000" (driver="hyperkit")
	I0304 18:01:12.865431   97618 client.go:168] LocalClient.Create starting
	I0304 18:01:12.865461   97618 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:01:12.865516   97618 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:12.865529   97618 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:12.865574   97618 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:01:12.865610   97618 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:12.865623   97618 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:12.865636   97618 main.go:141] libmachine: Running pre-create checks...
	I0304 18:01:12.865641   97618 main.go:141] libmachine: (enable-default-cni-612000) Calling .PreCreateCheck
	I0304 18:01:12.865738   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:12.865764   97618 main.go:141] libmachine: (enable-default-cni-612000) Calling .GetConfigRaw
	I0304 18:01:12.866204   97618 main.go:141] libmachine: Creating machine...
	I0304 18:01:12.866221   97618 main.go:141] libmachine: (enable-default-cni-612000) Calling .Create
	I0304 18:01:12.866326   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:12.866436   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | I0304 18:01:12.866292   97708 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:12.866514   97618 main.go:141] libmachine: (enable-default-cni-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:01:13.042193   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | I0304 18:01:13.042120   97708 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/enable-default-cni-612000/id_rsa...
	I0304 18:01:13.130642   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | I0304 18:01:13.130594   97708 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/enable-default-cni-612000/enable-default-cni-612000.rawdisk...
	I0304 18:01:13.130656   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | Writing magic tar header
	I0304 18:01:13.130667   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | Writing SSH key tar header
	I0304 18:01:13.131606   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | I0304 18:01:13.131509   97708 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/enable-default-cni-612000 ...
	I0304 18:01:13.494726   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:13.494763   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/enable-default-cni-612000/hyperkit.pid
	I0304 18:01:13.494818   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | Using UUID 630c9a3a-72de-4ae6-9046-2bde92cfb19e
	I0304 18:01:13.530772   97618 main.go:141] libmachine: (enable-default-cni-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:01:13.530854   97618 client.go:171] duration metric: took 665.409332ms to LocalClient.Create
	I0304 18:01:15.531491   97618 start.go:128] duration metric: took 2.702112759s to createHost
	I0304 18:01:15.531516   97618 start.go:83] releasing machines lock for "enable-default-cni-612000", held for 2.702301325s
	W0304 18:01:15.531633   97618 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p enable-default-cni-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p enable-default-cni-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:15.553164   97618 out.go:177] 
	W0304 18:01:15.575016   97618 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:01:15.575076   97618 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:01:15.575133   97618 out.go:239] * Related issues:
	* Related issues:
	W0304 18:01:15.575183   97618 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:01:15.575248   97618 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:01:15.639962   97618 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/enable-default-cni/Start (11.77s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (11.42s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p bridge-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p bridge-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=hyperkit : exit status 60 (11.418894444s)

                                                
                                                
-- stdout --
	* [bridge-612000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "bridge-612000" primary control-plane node in "bridge-612000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "bridge-612000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:01:07.317709   97691 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:01:07.317986   97691 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:07.317992   97691 out.go:304] Setting ErrFile to fd 2...
	I0304 18:01:07.317995   97691 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:07.318177   97691 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:01:07.319649   97691 out.go:298] Setting JSON to false
	I0304 18:01:07.342093   97691 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25236,"bootTime":1709578831,"procs":562,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:01:07.342197   97691 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:01:07.363973   97691 out.go:177] * [bridge-612000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:01:07.406416   97691 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:01:07.406448   97691 notify.go:220] Checking for updates...
	I0304 18:01:07.428508   97691 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:01:07.449593   97691 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:01:07.491358   97691 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:01:07.512515   97691 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:07.533523   97691 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:01:07.555343   97691 config.go:182] Loaded profile config "enable-default-cni-612000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:01:07.555537   97691 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:01:07.555708   97691 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:01:07.584651   97691 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 18:01:07.626576   97691 start.go:297] selected driver: hyperkit
	I0304 18:01:07.626621   97691 start.go:901] validating driver "hyperkit" against <nil>
	I0304 18:01:07.626640   97691 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:01:07.631069   97691 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:07.631181   97691 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:01:07.638966   97691 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:01:07.642767   97691 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:07.642803   97691 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:01:07.642839   97691 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 18:01:07.643037   97691 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:01:07.643098   97691 cni.go:84] Creating CNI manager for "bridge"
	I0304 18:01:07.643110   97691 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0304 18:01:07.643177   97691 start.go:340] cluster config:
	{Name:bridge-612000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:bridge-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunti
me:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSoc
k: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:01:07.643264   97691 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:07.685267   97691 out.go:177] * Starting "bridge-612000" primary control-plane node in "bridge-612000" cluster
	I0304 18:01:07.706347   97691 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 18:01:07.706382   97691 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 18:01:07.706402   97691 cache.go:56] Caching tarball of preloaded images
	I0304 18:01:07.706522   97691 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:01:07.706532   97691 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 18:01:07.706614   97691 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/bridge-612000/config.json ...
	I0304 18:01:07.706636   97691 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/bridge-612000/config.json: {Name:mk5e8b688a396f17d2c3297a1ba660283b776041 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 18:01:07.748550   97691 start.go:360] acquireMachinesLock for bridge-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:01:07.748662   97691 start.go:364] duration metric: took 91.051µs to acquireMachinesLock for "bridge-612000"
	I0304 18:01:07.748704   97691 start.go:93] Provisioning new machine with config: &{Name:bridge-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:bridge-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:01:07.748789   97691 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:01:07.790696   97691 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:01:07.791008   97691 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:07.791085   97691 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:07.800554   97691 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64956
	I0304 18:01:07.800950   97691 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:07.801381   97691 main.go:141] libmachine: Using API Version  1
	I0304 18:01:07.801391   97691 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:07.801600   97691 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:07.801697   97691 main.go:141] libmachine: (bridge-612000) Calling .GetMachineName
	I0304 18:01:07.801815   97691 main.go:141] libmachine: (bridge-612000) Calling .DriverName
	I0304 18:01:07.801964   97691 start.go:159] libmachine.API.Create for "bridge-612000" (driver="hyperkit")
	I0304 18:01:07.801999   97691 client.go:168] LocalClient.Create starting
	I0304 18:01:07.802038   97691 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:01:07.802090   97691 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:07.802107   97691 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:07.802171   97691 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:01:07.802207   97691 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:07.802219   97691 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:07.802232   97691 main.go:141] libmachine: Running pre-create checks...
	I0304 18:01:07.802242   97691 main.go:141] libmachine: (bridge-612000) Calling .PreCreateCheck
	I0304 18:01:07.802318   97691 main.go:141] libmachine: (bridge-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:07.802459   97691 main.go:141] libmachine: (bridge-612000) Calling .GetConfigRaw
	I0304 18:01:07.811843   97691 main.go:141] libmachine: Creating machine...
	I0304 18:01:07.811867   97691 main.go:141] libmachine: (bridge-612000) Calling .Create
	I0304 18:01:07.812051   97691 main.go:141] libmachine: (bridge-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:07.812283   97691 main.go:141] libmachine: (bridge-612000) DBG | I0304 18:01:07.812007   97701 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:07.812399   97691 main.go:141] libmachine: (bridge-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:01:08.016114   97691 main.go:141] libmachine: (bridge-612000) DBG | I0304 18:01:08.016015   97701 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/bridge-612000/id_rsa...
	I0304 18:01:08.068424   97691 main.go:141] libmachine: (bridge-612000) DBG | I0304 18:01:08.068347   97701 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/bridge-612000/bridge-612000.rawdisk...
	I0304 18:01:08.068434   97691 main.go:141] libmachine: (bridge-612000) DBG | Writing magic tar header
	I0304 18:01:08.068442   97691 main.go:141] libmachine: (bridge-612000) DBG | Writing SSH key tar header
	I0304 18:01:08.071643   97691 main.go:141] libmachine: (bridge-612000) DBG | I0304 18:01:08.071497   97701 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/bridge-612000 ...
	I0304 18:01:08.441312   97691 main.go:141] libmachine: (bridge-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:08.441332   97691 main.go:141] libmachine: (bridge-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/bridge-612000/hyperkit.pid
	I0304 18:01:08.441342   97691 main.go:141] libmachine: (bridge-612000) DBG | Using UUID b6aa4882-6f04-4d4e-b54d-24a1b08aaddc
	I0304 18:01:08.479213   97691 main.go:141] libmachine: (bridge-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:01:08.479295   97691 client.go:171] duration metric: took 677.277217ms to LocalClient.Create
	I0304 18:01:10.481537   97691 start.go:128] duration metric: took 2.732698269s to createHost
	I0304 18:01:10.481568   97691 start.go:83] releasing machines lock for "bridge-612000", held for 2.732863184s
	W0304 18:01:10.481606   97691 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 18:01:10.482200   97691 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:10.482243   97691 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:10.492131   97691 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64958
	I0304 18:01:10.492702   97691 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:10.493084   97691 main.go:141] libmachine: Using API Version  1
	I0304 18:01:10.493094   97691 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:10.493348   97691 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:10.493771   97691 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:10.493810   97691 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:10.502160   97691 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64960
	I0304 18:01:10.502517   97691 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:10.502838   97691 main.go:141] libmachine: Using API Version  1
	I0304 18:01:10.502849   97691 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:10.503049   97691 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:10.503152   97691 main.go:141] libmachine: (bridge-612000) Calling .GetState
	I0304 18:01:10.503249   97691 main.go:141] libmachine: (bridge-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:10.503260   97691 main.go:141] libmachine: (bridge-612000) DBG | hyperkit pid from json: 0
	I0304 18:01:10.503269   97691 main.go:141] libmachine: (bridge-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/bridge-612000/hyperkit.json: no such file or directory
	I0304 18:01:10.503319   97691 main.go:141] libmachine: (bridge-612000) Calling .DriverName
	I0304 18:01:10.548851   97691 out.go:177] * Deleting "bridge-612000" in hyperkit ...
	I0304 18:01:10.572852   97691 main.go:141] libmachine: (bridge-612000) Calling .Remove
	I0304 18:01:10.573196   97691 main.go:141] libmachine: (bridge-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:10.573214   97691 main.go:141] libmachine: (bridge-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:10.573232   97691 main.go:141] libmachine: (bridge-612000) DBG | hyperkit pid from json: 0
	I0304 18:01:10.573253   97691 main.go:141] libmachine: (bridge-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/bridge-612000/hyperkit.json: no such file or directory
	W0304 18:01:10.592297   97691 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:10.592312   97691 start.go:728] Will try again in 5 seconds ...
	I0304 18:01:15.593469   97691 start.go:360] acquireMachinesLock for bridge-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:01:15.593609   97691 start.go:364] duration metric: took 110.765µs to acquireMachinesLock for "bridge-612000"
	I0304 18:01:15.593651   97691 start.go:93] Provisioning new machine with config: &{Name:bridge-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:bridge-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:01:15.593765   97691 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:01:15.703112   97691 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:01:15.703381   97691 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:15.703459   97691 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:15.713024   97691 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:64964
	I0304 18:01:15.713384   97691 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:15.713734   97691 main.go:141] libmachine: Using API Version  1
	I0304 18:01:15.713753   97691 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:15.713969   97691 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:15.714072   97691 main.go:141] libmachine: (bridge-612000) Calling .GetMachineName
	I0304 18:01:15.714157   97691 main.go:141] libmachine: (bridge-612000) Calling .DriverName
	I0304 18:01:15.714271   97691 start.go:159] libmachine.API.Create for "bridge-612000" (driver="hyperkit")
	I0304 18:01:15.714290   97691 client.go:168] LocalClient.Create starting
	I0304 18:01:15.714318   97691 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:01:15.714353   97691 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:15.714366   97691 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:15.714410   97691 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:01:15.714436   97691 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:15.714452   97691 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:15.714466   97691 main.go:141] libmachine: Running pre-create checks...
	I0304 18:01:15.714471   97691 main.go:141] libmachine: (bridge-612000) Calling .PreCreateCheck
	I0304 18:01:15.714548   97691 main.go:141] libmachine: (bridge-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:15.714585   97691 main.go:141] libmachine: (bridge-612000) Calling .GetConfigRaw
	I0304 18:01:15.724517   97691 main.go:141] libmachine: Creating machine...
	I0304 18:01:15.724537   97691 main.go:141] libmachine: (bridge-612000) Calling .Create
	I0304 18:01:15.724723   97691 main.go:141] libmachine: (bridge-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:15.724940   97691 main.go:141] libmachine: (bridge-612000) DBG | I0304 18:01:15.724688   97712 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:15.725080   97691 main.go:141] libmachine: (bridge-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:01:15.905200   97691 main.go:141] libmachine: (bridge-612000) DBG | I0304 18:01:15.905140   97712 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/bridge-612000/id_rsa...
	I0304 18:01:15.958724   97691 main.go:141] libmachine: (bridge-612000) DBG | I0304 18:01:15.958666   97712 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/bridge-612000/bridge-612000.rawdisk...
	I0304 18:01:15.958748   97691 main.go:141] libmachine: (bridge-612000) DBG | Writing magic tar header
	I0304 18:01:15.958758   97691 main.go:141] libmachine: (bridge-612000) DBG | Writing SSH key tar header
	I0304 18:01:15.960726   97691 main.go:141] libmachine: (bridge-612000) DBG | I0304 18:01:15.960675   97712 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/bridge-612000 ...
	I0304 18:01:16.357619   97691 main.go:141] libmachine: (bridge-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:16.357637   97691 main.go:141] libmachine: (bridge-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/bridge-612000/hyperkit.pid
	I0304 18:01:16.357671   97691 main.go:141] libmachine: (bridge-612000) DBG | Using UUID e2833c22-41b9-41d4-a246-024d58c8f077
	I0304 18:01:16.506568   97691 main.go:141] libmachine: (bridge-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:01:16.506647   97691 client.go:171] duration metric: took 792.341834ms to LocalClient.Create
	I0304 18:01:18.508747   97691 start.go:128] duration metric: took 2.914937493s to createHost
	I0304 18:01:18.508764   97691 start.go:83] releasing machines lock for "bridge-612000", held for 2.915111053s
	W0304 18:01:18.508821   97691 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p bridge-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p bridge-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:18.550853   97691 out.go:177] 
	W0304 18:01:18.572033   97691 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:01:18.572120   97691 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:01:18.572139   97691 out.go:239] * Related issues:
	* Related issues:
	W0304 18:01:18.572166   97691 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:01:18.572188   97691 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:01:18.593100   97691 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/bridge/Start (11.42s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Start (11.84s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p kubenet-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubenet-612000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=hyperkit : exit status 60 (11.833697863s)

                                                
                                                
-- stdout --
	* [kubenet-612000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "kubenet-612000" primary control-plane node in "kubenet-612000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "kubenet-612000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:01:22.374614   97922 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:01:22.375948   97922 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:22.375960   97922 out.go:304] Setting ErrFile to fd 2...
	I0304 18:01:22.375970   97922 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:22.376560   97922 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:01:22.379012   97922 out.go:298] Setting JSON to false
	I0304 18:01:22.402232   97922 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25251,"bootTime":1709578831,"procs":549,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:01:22.402347   97922 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:01:22.423754   97922 out.go:177] * [kubenet-612000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:01:22.487799   97922 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:01:22.466113   97922 notify.go:220] Checking for updates...
	I0304 18:01:22.571582   97922 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:01:22.613865   97922 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:01:22.634505   97922 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:01:22.655801   97922 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:22.676815   97922 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:01:22.698595   97922 config.go:182] Loaded profile config "bridge-612000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:01:22.698792   97922 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:01:22.698956   97922 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:01:22.728938   97922 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 18:01:22.770734   97922 start.go:297] selected driver: hyperkit
	I0304 18:01:22.770756   97922 start.go:901] validating driver "hyperkit" against <nil>
	I0304 18:01:22.770775   97922 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:01:22.774641   97922 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:22.774744   97922 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:01:22.782646   97922 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:01:22.786577   97922 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:22.786599   97922 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:01:22.786634   97922 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 18:01:22.786852   97922 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:01:22.786907   97922 cni.go:80] network plugin configured as "kubenet", returning disabled
	I0304 18:01:22.786974   97922 start.go:340] cluster config:
	{Name:kubenet-612000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:kubenet-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSoc
k: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:01:22.787063   97922 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:22.855781   97922 out.go:177] * Starting "kubenet-612000" primary control-plane node in "kubenet-612000" cluster
	I0304 18:01:22.876835   97922 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 18:01:22.876887   97922 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 18:01:22.876906   97922 cache.go:56] Caching tarball of preloaded images
	I0304 18:01:22.877044   97922 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:01:22.877055   97922 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 18:01:22.877151   97922 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/kubenet-612000/config.json ...
	I0304 18:01:22.877170   97922 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/kubenet-612000/config.json: {Name:mk5df7c8106c4f38119261cee3c7468fcb430759 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 18:01:22.877438   97922 start.go:360] acquireMachinesLock for kubenet-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:01:22.877521   97922 start.go:364] duration metric: took 70.768µs to acquireMachinesLock for "kubenet-612000"
	I0304 18:01:22.877547   97922 start.go:93] Provisioning new machine with config: &{Name:kubenet-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kubenet-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:01:22.877604   97922 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:01:22.898641   97922 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:01:22.898827   97922 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:22.898878   97922 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:22.908883   97922 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65078
	I0304 18:01:22.909354   97922 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:22.909920   97922 main.go:141] libmachine: Using API Version  1
	I0304 18:01:22.909946   97922 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:22.910256   97922 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:22.910430   97922 main.go:141] libmachine: (kubenet-612000) Calling .GetMachineName
	I0304 18:01:22.910577   97922 main.go:141] libmachine: (kubenet-612000) Calling .DriverName
	I0304 18:01:22.910749   97922 start.go:159] libmachine.API.Create for "kubenet-612000" (driver="hyperkit")
	I0304 18:01:22.910795   97922 client.go:168] LocalClient.Create starting
	I0304 18:01:22.910839   97922 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:01:22.910901   97922 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:22.910924   97922 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:22.910991   97922 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:01:22.911035   97922 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:22.911053   97922 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:22.911074   97922 main.go:141] libmachine: Running pre-create checks...
	I0304 18:01:22.911087   97922 main.go:141] libmachine: (kubenet-612000) Calling .PreCreateCheck
	I0304 18:01:22.911555   97922 main.go:141] libmachine: (kubenet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:22.911774   97922 main.go:141] libmachine: (kubenet-612000) Calling .GetConfigRaw
	I0304 18:01:22.912331   97922 main.go:141] libmachine: Creating machine...
	I0304 18:01:22.912341   97922 main.go:141] libmachine: (kubenet-612000) Calling .Create
	I0304 18:01:22.912453   97922 main.go:141] libmachine: (kubenet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:22.912571   97922 main.go:141] libmachine: (kubenet-612000) DBG | I0304 18:01:22.912419   97938 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:22.912633   97922 main.go:141] libmachine: (kubenet-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:01:23.296234   97922 main.go:141] libmachine: (kubenet-612000) DBG | I0304 18:01:23.296131   97938 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubenet-612000/id_rsa...
	I0304 18:01:23.421324   97922 main.go:141] libmachine: (kubenet-612000) DBG | I0304 18:01:23.421206   97938 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubenet-612000/kubenet-612000.rawdisk...
	I0304 18:01:23.421350   97922 main.go:141] libmachine: (kubenet-612000) DBG | Writing magic tar header
	I0304 18:01:23.421377   97922 main.go:141] libmachine: (kubenet-612000) DBG | Writing SSH key tar header
	I0304 18:01:23.421756   97922 main.go:141] libmachine: (kubenet-612000) DBG | I0304 18:01:23.421716   97938 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubenet-612000 ...
	I0304 18:01:23.876784   97922 main.go:141] libmachine: (kubenet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:23.876806   97922 main.go:141] libmachine: (kubenet-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubenet-612000/hyperkit.pid
	I0304 18:01:23.876852   97922 main.go:141] libmachine: (kubenet-612000) DBG | Using UUID 71151283-7615-422b-a1bd-69c9c30ee0f3
	I0304 18:01:23.916362   97922 main.go:141] libmachine: (kubenet-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:01:23.916484   97922 client.go:171] duration metric: took 1.005664741s to LocalClient.Create
	I0304 18:01:25.917027   97922 start.go:128] duration metric: took 3.039361252s to createHost
	I0304 18:01:25.917059   97922 start.go:83] releasing machines lock for "kubenet-612000", held for 3.039496652s
	W0304 18:01:25.917081   97922 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 18:01:25.917565   97922 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:25.917599   97922 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:25.925939   97922 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65116
	I0304 18:01:25.926325   97922 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:25.926717   97922 main.go:141] libmachine: Using API Version  1
	I0304 18:01:25.926732   97922 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:25.926970   97922 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:25.927325   97922 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:25.927348   97922 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:25.935341   97922 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65118
	I0304 18:01:25.935684   97922 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:25.936070   97922 main.go:141] libmachine: Using API Version  1
	I0304 18:01:25.936088   97922 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:25.936265   97922 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:25.936360   97922 main.go:141] libmachine: (kubenet-612000) Calling .GetState
	I0304 18:01:25.936441   97922 main.go:141] libmachine: (kubenet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:25.936471   97922 main.go:141] libmachine: (kubenet-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubenet-612000/hyperkit.json: no such file or directory
	I0304 18:01:25.936478   97922 main.go:141] libmachine: (kubenet-612000) DBG | hyperkit pid from json: 0
	I0304 18:01:25.936514   97922 main.go:141] libmachine: (kubenet-612000) Calling .DriverName
	I0304 18:01:25.980687   97922 out.go:177] * Deleting "kubenet-612000" in hyperkit ...
	I0304 18:01:26.001611   97922 main.go:141] libmachine: (kubenet-612000) Calling .Remove
	I0304 18:01:26.001878   97922 main.go:141] libmachine: (kubenet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:26.001892   97922 main.go:141] libmachine: (kubenet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:26.001901   97922 main.go:141] libmachine: (kubenet-612000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubenet-612000/hyperkit.json: no such file or directory
	I0304 18:01:26.001915   97922 main.go:141] libmachine: (kubenet-612000) DBG | hyperkit pid from json: 0
	W0304 18:01:26.018967   97922 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:26.018983   97922 start.go:728] Will try again in 5 seconds ...
	I0304 18:01:31.019444   97922 start.go:360] acquireMachinesLock for kubenet-612000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:01:31.019642   97922 start.go:364] duration metric: took 165.003µs to acquireMachinesLock for "kubenet-612000"
	I0304 18:01:31.019686   97922 start.go:93] Provisioning new machine with config: &{Name:kubenet-612000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kubenet-612000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:01:31.019807   97922 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:01:31.041397   97922 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0304 18:01:31.041562   97922 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:31.041620   97922 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:31.051165   97922 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65126
	I0304 18:01:31.051538   97922 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:31.051868   97922 main.go:141] libmachine: Using API Version  1
	I0304 18:01:31.051910   97922 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:31.052142   97922 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:31.052276   97922 main.go:141] libmachine: (kubenet-612000) Calling .GetMachineName
	I0304 18:01:31.052373   97922 main.go:141] libmachine: (kubenet-612000) Calling .DriverName
	I0304 18:01:31.052490   97922 start.go:159] libmachine.API.Create for "kubenet-612000" (driver="hyperkit")
	I0304 18:01:31.052509   97922 client.go:168] LocalClient.Create starting
	I0304 18:01:31.052537   97922 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:01:31.052586   97922 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:31.052597   97922 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:31.052641   97922 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:01:31.052676   97922 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:31.052695   97922 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:31.052707   97922 main.go:141] libmachine: Running pre-create checks...
	I0304 18:01:31.052712   97922 main.go:141] libmachine: (kubenet-612000) Calling .PreCreateCheck
	I0304 18:01:31.052795   97922 main.go:141] libmachine: (kubenet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:31.052831   97922 main.go:141] libmachine: (kubenet-612000) Calling .GetConfigRaw
	I0304 18:01:31.053408   97922 main.go:141] libmachine: Creating machine...
	I0304 18:01:31.053415   97922 main.go:141] libmachine: (kubenet-612000) Calling .Create
	I0304 18:01:31.053497   97922 main.go:141] libmachine: (kubenet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:31.053622   97922 main.go:141] libmachine: (kubenet-612000) DBG | I0304 18:01:31.053484   98009 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:31.053671   97922 main.go:141] libmachine: (kubenet-612000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:01:31.228944   97922 main.go:141] libmachine: (kubenet-612000) DBG | I0304 18:01:31.228870   98009 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubenet-612000/id_rsa...
	I0304 18:01:31.543253   97922 main.go:141] libmachine: (kubenet-612000) DBG | I0304 18:01:31.543155   98009 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubenet-612000/kubenet-612000.rawdisk...
	I0304 18:01:31.543270   97922 main.go:141] libmachine: (kubenet-612000) DBG | Writing magic tar header
	I0304 18:01:31.543280   97922 main.go:141] libmachine: (kubenet-612000) DBG | Writing SSH key tar header
	I0304 18:01:31.544017   97922 main.go:141] libmachine: (kubenet-612000) DBG | I0304 18:01:31.543925   98009 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubenet-612000 ...
	I0304 18:01:31.905698   97922 main.go:141] libmachine: (kubenet-612000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:31.905720   97922 main.go:141] libmachine: (kubenet-612000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/kubenet-612000/hyperkit.pid
	I0304 18:01:31.905769   97922 main.go:141] libmachine: (kubenet-612000) DBG | Using UUID 2e2296a6-b825-4288-a3ed-94d64536ec52
	I0304 18:01:31.944438   97922 main.go:141] libmachine: (kubenet-612000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:01:31.944518   97922 client.go:171] duration metric: took 891.992981ms to LocalClient.Create
	I0304 18:01:33.944787   97922 start.go:128] duration metric: took 2.924932663s to createHost
	I0304 18:01:33.944817   97922 start.go:83] releasing machines lock for "kubenet-612000", held for 2.925127287s
	W0304 18:01:33.944959   97922 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubenet-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubenet-612000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:34.009330   97922 out.go:177] 
	W0304 18:01:34.031400   97922 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:01:34.031467   97922 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:01:34.031504   97922 out.go:239] * Related issues:
	* Related issues:
	W0304 18:01:34.031530   97922 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:01:34.031551   97922 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:01:34.053374   97922 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/kubenet/Start (11.84s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (12.04s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p old-k8s-version-444000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-444000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0: exit status 60 (11.96605293s)

                                                
                                                
-- stdout --
	* [old-k8s-version-444000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "old-k8s-version-444000" primary control-plane node in "old-k8s-version-444000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "old-k8s-version-444000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:01:25.399812   97992 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:01:25.399974   97992 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:25.399980   97992 out.go:304] Setting ErrFile to fd 2...
	I0304 18:01:25.399983   97992 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:25.400148   97992 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:01:25.401694   97992 out.go:298] Setting JSON to false
	I0304 18:01:25.425112   97992 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25254,"bootTime":1709578831,"procs":566,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:01:25.425218   97992 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:01:25.448536   97992 out.go:177] * [old-k8s-version-444000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:01:25.512647   97992 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:01:25.491008   97992 notify.go:220] Checking for updates...
	I0304 18:01:25.554623   97992 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:01:25.596572   97992 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:01:25.617660   97992 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:01:25.638640   97992 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:25.659553   97992 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:01:25.681631   97992 config.go:182] Loaded profile config "kubenet-612000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:01:25.681824   97992 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:01:25.681987   97992 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:01:25.711648   97992 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 18:01:25.753680   97992 start.go:297] selected driver: hyperkit
	I0304 18:01:25.753713   97992 start.go:901] validating driver "hyperkit" against <nil>
	I0304 18:01:25.753736   97992 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:01:25.757652   97992 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:25.757765   97992 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:01:25.766555   97992 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:01:25.770679   97992 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:25.770711   97992 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:01:25.770752   97992 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 18:01:25.770962   97992 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:01:25.771015   97992 cni.go:84] Creating CNI manager for ""
	I0304 18:01:25.771032   97992 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0304 18:01:25.771100   97992 start.go:340] cluster config:
	{Name:old-k8s-version-444000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-444000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loc
al ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSH
AuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:01:25.771184   97992 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:25.813570   97992 out.go:177] * Starting "old-k8s-version-444000" primary control-plane node in "old-k8s-version-444000" cluster
	I0304 18:01:25.834651   97992 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0304 18:01:25.834713   97992 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0304 18:01:25.834733   97992 cache.go:56] Caching tarball of preloaded images
	I0304 18:01:25.834892   97992 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:01:25.834905   97992 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0304 18:01:25.835018   97992 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/old-k8s-version-444000/config.json ...
	I0304 18:01:25.835045   97992 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/old-k8s-version-444000/config.json: {Name:mk2452742e54388a5cab48c36dfd1e486c3207d3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 18:01:25.835518   97992 start.go:360] acquireMachinesLock for old-k8s-version-444000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:01:25.917150   97992 start.go:364] duration metric: took 81.588977ms to acquireMachinesLock for "old-k8s-version-444000"
	I0304 18:01:25.917211   97992 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-444000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-444000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:01:25.917287   97992 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:01:25.938745   97992 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 18:01:25.938941   97992 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:25.938984   97992 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:25.946814   97992 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65120
	I0304 18:01:25.947187   97992 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:25.947591   97992 main.go:141] libmachine: Using API Version  1
	I0304 18:01:25.947603   97992 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:25.947801   97992 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:25.947906   97992 main.go:141] libmachine: (old-k8s-version-444000) Calling .GetMachineName
	I0304 18:01:25.947993   97992 main.go:141] libmachine: (old-k8s-version-444000) Calling .DriverName
	I0304 18:01:25.948094   97992 start.go:159] libmachine.API.Create for "old-k8s-version-444000" (driver="hyperkit")
	I0304 18:01:25.948152   97992 client.go:168] LocalClient.Create starting
	I0304 18:01:25.948183   97992 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:01:25.948228   97992 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:25.948246   97992 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:25.948300   97992 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:01:25.948338   97992 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:25.948346   97992 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:25.948357   97992 main.go:141] libmachine: Running pre-create checks...
	I0304 18:01:25.948366   97992 main.go:141] libmachine: (old-k8s-version-444000) Calling .PreCreateCheck
	I0304 18:01:25.948456   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:25.948643   97992 main.go:141] libmachine: (old-k8s-version-444000) Calling .GetConfigRaw
	I0304 18:01:25.981328   97992 main.go:141] libmachine: Creating machine...
	I0304 18:01:25.981352   97992 main.go:141] libmachine: (old-k8s-version-444000) Calling .Create
	I0304 18:01:25.981627   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:25.981865   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | I0304 18:01:25.981581   98004 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:25.982037   97992 main.go:141] libmachine: (old-k8s-version-444000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:01:26.201207   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | I0304 18:01:26.201106   98004 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000/id_rsa...
	I0304 18:01:26.319931   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | I0304 18:01:26.319837   98004 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000/old-k8s-version-444000.rawdisk...
	I0304 18:01:26.319943   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | Writing magic tar header
	I0304 18:01:26.319966   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | Writing SSH key tar header
	I0304 18:01:26.320910   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | I0304 18:01:26.320794   98004 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000 ...
	I0304 18:01:26.760196   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:26.760210   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000/hyperkit.pid
	I0304 18:01:26.760222   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | Using UUID 30fb3a55-61a5-43ab-a890-e369aa37e549
	I0304 18:01:26.825599   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:01:26.825685   97992 client.go:171] duration metric: took 877.512566ms to LocalClient.Create
	I0304 18:01:28.827989   97992 start.go:128] duration metric: took 2.910646715s to createHost
	I0304 18:01:28.828026   97992 start.go:83] releasing machines lock for "old-k8s-version-444000", held for 2.910828571s
	W0304 18:01:28.828091   97992 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 18:01:28.828689   97992 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:28.828740   97992 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:28.838511   97992 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65122
	I0304 18:01:28.839076   97992 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:28.839539   97992 main.go:141] libmachine: Using API Version  1
	I0304 18:01:28.839548   97992 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:28.839871   97992 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:28.840263   97992 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:28.840310   97992 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:28.848565   97992 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65124
	I0304 18:01:28.849023   97992 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:28.849446   97992 main.go:141] libmachine: Using API Version  1
	I0304 18:01:28.849461   97992 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:28.849715   97992 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:28.849815   97992 main.go:141] libmachine: (old-k8s-version-444000) Calling .GetState
	I0304 18:01:28.849895   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:28.849917   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | hyperkit pid from json: 0
	I0304 18:01:28.849932   97992 main.go:141] libmachine: (old-k8s-version-444000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000/hyperkit.json: no such file or directory
	I0304 18:01:28.849961   97992 main.go:141] libmachine: (old-k8s-version-444000) Calling .DriverName
	I0304 18:01:28.893387   97992 out.go:177] * Deleting "old-k8s-version-444000" in hyperkit ...
	I0304 18:01:28.915294   97992 main.go:141] libmachine: (old-k8s-version-444000) Calling .Remove
	I0304 18:01:28.915578   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:28.915599   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:28.915618   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | hyperkit pid from json: 0
	I0304 18:01:28.915654   97992 main.go:141] libmachine: (old-k8s-version-444000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000/hyperkit.json: no such file or directory
	W0304 18:01:28.932753   97992 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:28.932766   97992 start.go:728] Will try again in 5 seconds ...
	I0304 18:01:33.934050   97992 start.go:360] acquireMachinesLock for old-k8s-version-444000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:01:33.944903   97992 start.go:364] duration metric: took 10.812301ms to acquireMachinesLock for "old-k8s-version-444000"
	I0304 18:01:33.944962   97992 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-444000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-444000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:01:33.945089   97992 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:01:34.009330   97992 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 18:01:34.009469   97992 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:34.009550   97992 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:34.019113   97992 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65128
	I0304 18:01:34.019484   97992 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:34.019848   97992 main.go:141] libmachine: Using API Version  1
	I0304 18:01:34.019862   97992 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:34.020088   97992 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:34.020198   97992 main.go:141] libmachine: (old-k8s-version-444000) Calling .GetMachineName
	I0304 18:01:34.020289   97992 main.go:141] libmachine: (old-k8s-version-444000) Calling .DriverName
	I0304 18:01:34.020386   97992 start.go:159] libmachine.API.Create for "old-k8s-version-444000" (driver="hyperkit")
	I0304 18:01:34.020411   97992 client.go:168] LocalClient.Create starting
	I0304 18:01:34.020437   97992 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:01:34.020472   97992 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:34.020483   97992 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:34.020521   97992 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:01:34.020545   97992 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:34.020558   97992 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:34.020576   97992 main.go:141] libmachine: Running pre-create checks...
	I0304 18:01:34.020581   97992 main.go:141] libmachine: (old-k8s-version-444000) Calling .PreCreateCheck
	I0304 18:01:34.020647   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:34.020671   97992 main.go:141] libmachine: (old-k8s-version-444000) Calling .GetConfigRaw
	I0304 18:01:34.032201   97992 main.go:141] libmachine: Creating machine...
	I0304 18:01:34.032225   97992 main.go:141] libmachine: (old-k8s-version-444000) Calling .Create
	I0304 18:01:34.032457   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:34.032717   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | I0304 18:01:34.032438   98015 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:34.032821   97992 main.go:141] libmachine: (old-k8s-version-444000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:01:34.321782   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | I0304 18:01:34.321695   98015 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000/id_rsa...
	I0304 18:01:34.496614   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | I0304 18:01:34.496540   98015 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000/old-k8s-version-444000.rawdisk...
	I0304 18:01:34.496628   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | Writing magic tar header
	I0304 18:01:34.496638   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | Writing SSH key tar header
	I0304 18:01:34.497315   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | I0304 18:01:34.497268   98015 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000 ...
	I0304 18:01:34.909334   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:34.909350   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000/hyperkit.pid
	I0304 18:01:34.909446   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | Using UUID c45c32c3-1c2e-4957-851f-d59ff50ef719
	I0304 18:01:35.095249   97992 main.go:141] libmachine: (old-k8s-version-444000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:01:35.095328   97992 client.go:171] duration metric: took 1.074898694s to LocalClient.Create
	I0304 18:01:37.095621   97992 start.go:128] duration metric: took 3.150482681s to createHost
	I0304 18:01:37.095637   97992 start.go:83] releasing machines lock for "old-k8s-version-444000", held for 3.15067984s
	W0304 18:01:37.095744   97992 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-444000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-444000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:37.137771   97992 out.go:177] 
	W0304 18:01:37.159125   97992 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:01:37.159203   97992 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:01:37.159241   97992 out.go:239] * Related issues:
	* Related issues:
	W0304 18:01:37.159272   97992 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:01:37.159294   97992 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:01:37.201942   97992 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-444000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000: exit status 7 (75.3617ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-444000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (12.04s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (0.22s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-444000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context old-k8s-version-444000 create -f testdata/busybox.yaml: exit status 1 (37.529434ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-444000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context old-k8s-version-444000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000: exit status 7 (100.25989ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-444000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000: exit status 7 (76.751994ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-444000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/DeployApp (0.22s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.4s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p old-k8s-version-444000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-444000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context old-k8s-version-444000 describe deploy/metrics-server -n kube-system: exit status 1 (37.325131ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-444000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context old-k8s-version-444000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000: exit status 7 (74.005889ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-444000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.40s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (11.62s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p no-preload-800000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p no-preload-800000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (11.516807631s)

                                                
                                                
-- stdout --
	* [no-preload-800000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "no-preload-800000" primary control-plane node in "no-preload-800000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "no-preload-800000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:01:40.597993   98186 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:01:40.598250   98186 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:40.598256   98186 out.go:304] Setting ErrFile to fd 2...
	I0304 18:01:40.598259   98186 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:40.598412   98186 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:01:40.599914   98186 out.go:298] Setting JSON to false
	I0304 18:01:40.622566   98186 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25269,"bootTime":1709578831,"procs":539,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:01:40.622673   98186 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:01:40.644398   98186 out.go:177] * [no-preload-800000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:01:40.708965   98186 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:01:40.686942   98186 notify.go:220] Checking for updates...
	I0304 18:01:40.750787   98186 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:01:40.771989   98186 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:01:40.794810   98186 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:01:40.817833   98186 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:40.840722   98186 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:01:40.862167   98186 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:01:40.862276   98186 config.go:182] Loaded profile config "old-k8s-version-444000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0304 18:01:40.862364   98186 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:01:40.890689   98186 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 18:01:40.932769   98186 start.go:297] selected driver: hyperkit
	I0304 18:01:40.932788   98186 start.go:901] validating driver "hyperkit" against <nil>
	I0304 18:01:40.932803   98186 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:01:40.936623   98186 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:40.936740   98186 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:01:40.944644   98186 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:01:40.948641   98186 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:40.948678   98186 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:01:40.948717   98186 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 18:01:40.948932   98186 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:01:40.948993   98186 cni.go:84] Creating CNI manager for ""
	I0304 18:01:40.949019   98186 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 18:01:40.949026   98186 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0304 18:01:40.949093   98186 start.go:340] cluster config:
	{Name:no-preload-800000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-800000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:
SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:01:40.949181   98186 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:40.990720   98186 out.go:177] * Starting "no-preload-800000" primary control-plane node in "no-preload-800000" cluster
	I0304 18:01:41.011660   98186 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0304 18:01:41.011877   98186 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/no-preload-800000/config.json ...
	I0304 18:01:41.011935   98186 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/no-preload-800000/config.json: {Name:mk42a8a8c663644bca6fb1e2e9a123d4ff21f5d6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 18:01:41.011988   98186 cache.go:107] acquiring lock: {Name:mk18f26f1077a5eb1cc486ad25730361d6fe4881 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:41.012080   98186 cache.go:107] acquiring lock: {Name:mk460076777ad58f84e461d93bdde18e610ad288 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:41.012087   98186 cache.go:107] acquiring lock: {Name:mka6797e4645fd0222f41eb0857e1b47609e43dc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:41.011987   98186 cache.go:107] acquiring lock: {Name:mkb69e339230bce54c06e24ec70ec4393a65223e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:41.012010   98186 cache.go:107] acquiring lock: {Name:mk818db6c37cd0d7d4a54da24c1d2217d7454450 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:41.012194   98186 cache.go:107] acquiring lock: {Name:mk51650f910085c726ba9076234e9de20ac0de60 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:41.012238   98186 cache.go:107] acquiring lock: {Name:mk9d91580ee1e52e7496c79e276338a42b308f38 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:41.012391   98186 cache.go:107] acquiring lock: {Name:mke00a4ba9a78937a8460a1db179987c0540a082 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:41.012642   98186 cache.go:115] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0304 18:01:41.012731   98186 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 705.106µs
	I0304 18:01:41.012772   98186 image.go:134] retrieving image: registry.k8s.io/pause:3.9
	I0304 18:01:41.012771   98186 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
	I0304 18:01:41.012821   98186 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
	I0304 18:01:41.012792   98186 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0304 18:01:41.012977   98186 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
	I0304 18:01:41.013027   98186 start.go:360] acquireMachinesLock for no-preload-800000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:01:41.013129   98186 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.10-0
	I0304 18:01:41.013132   98186 start.go:364] duration metric: took 83.318µs to acquireMachinesLock for "no-preload-800000"
	I0304 18:01:41.013153   98186 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.11.1
	I0304 18:01:41.013122   98186 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
	I0304 18:01:41.013180   98186 start.go:93] Provisioning new machine with config: &{Name:no-preload-800000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-800000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptio
ns:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:01:41.013296   98186 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:01:41.055747   98186 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 18:01:41.055983   98186 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:41.056041   98186 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:41.059420   98186 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
	I0304 18:01:41.059433   98186 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.10-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.10-0
	I0304 18:01:41.059432   98186 image.go:177] daemon lookup for registry.k8s.io/pause:3.9: Error response from daemon: No such image: registry.k8s.io/pause:3.9
	I0304 18:01:41.059420   98186 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
	I0304 18:01:41.059416   98186 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.11.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.11.1
	I0304 18:01:41.059474   98186 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
	I0304 18:01:41.059470   98186 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
	I0304 18:01:41.067192   98186 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65232
	I0304 18:01:41.067656   98186 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:41.068152   98186 main.go:141] libmachine: Using API Version  1
	I0304 18:01:41.068171   98186 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:41.068508   98186 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:41.068629   98186 main.go:141] libmachine: (no-preload-800000) Calling .GetMachineName
	I0304 18:01:41.068724   98186 main.go:141] libmachine: (no-preload-800000) Calling .DriverName
	I0304 18:01:41.068836   98186 start.go:159] libmachine.API.Create for "no-preload-800000" (driver="hyperkit")
	I0304 18:01:41.068874   98186 client.go:168] LocalClient.Create starting
	I0304 18:01:41.068920   98186 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:01:41.069009   98186 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:41.069035   98186 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:41.069125   98186 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:01:41.069185   98186 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:41.069203   98186 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:41.069220   98186 main.go:141] libmachine: Running pre-create checks...
	I0304 18:01:41.069235   98186 main.go:141] libmachine: (no-preload-800000) Calling .PreCreateCheck
	I0304 18:01:41.069356   98186 main.go:141] libmachine: (no-preload-800000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:41.069652   98186 main.go:141] libmachine: (no-preload-800000) Calling .GetConfigRaw
	I0304 18:01:41.070293   98186 main.go:141] libmachine: Creating machine...
	I0304 18:01:41.070302   98186 main.go:141] libmachine: (no-preload-800000) Calling .Create
	I0304 18:01:41.070384   98186 main.go:141] libmachine: (no-preload-800000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:41.070528   98186 main.go:141] libmachine: (no-preload-800000) DBG | I0304 18:01:41.070373   98196 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:41.070603   98186 main.go:141] libmachine: (no-preload-800000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:01:41.257509   98186 main.go:141] libmachine: (no-preload-800000) DBG | I0304 18:01:41.257413   98196 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000/id_rsa...
	I0304 18:01:41.421128   98186 main.go:141] libmachine: (no-preload-800000) DBG | I0304 18:01:41.421021   98196 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000/no-preload-800000.rawdisk...
	I0304 18:01:41.421168   98186 main.go:141] libmachine: (no-preload-800000) DBG | Writing magic tar header
	I0304 18:01:41.421202   98186 main.go:141] libmachine: (no-preload-800000) DBG | Writing SSH key tar header
	I0304 18:01:41.421780   98186 main.go:141] libmachine: (no-preload-800000) DBG | I0304 18:01:41.421748   98196 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000 ...
	I0304 18:01:41.451149   98186 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9
	I0304 18:01:41.458489   98186 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2
	I0304 18:01:41.466724   98186 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2
	I0304 18:01:41.494846   98186 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0
	I0304 18:01:41.539728   98186 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2
	I0304 18:01:41.603710   98186 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1
	I0304 18:01:41.631922   98186 cache.go:157] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 exists
	I0304 18:01:41.631937   98186 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9" took 619.854459ms
	I0304 18:01:41.631948   98186 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 succeeded
	I0304 18:01:41.644960   98186 cache.go:162] opening:  /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2
	I0304 18:01:41.812752   98186 main.go:141] libmachine: (no-preload-800000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:41.812776   98186 main.go:141] libmachine: (no-preload-800000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000/hyperkit.pid
	I0304 18:01:41.812791   98186 main.go:141] libmachine: (no-preload-800000) DBG | Using UUID 2ea00dc9-ebe3-4c3b-b9a8-be57e2ac0a55
	I0304 18:01:41.929924   98186 main.go:141] libmachine: (no-preload-800000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:01:41.930022   98186 client.go:171] duration metric: took 861.128779ms to LocalClient.Create
	I0304 18:01:43.930097   98186 start.go:128] duration metric: took 2.916754283s to createHost
	I0304 18:01:43.930110   98186 start.go:83] releasing machines lock for "no-preload-800000", held for 2.916931797s
	W0304 18:01:43.930141   98186 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 18:01:43.930431   98186 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:43.930454   98186 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:43.938912   98186 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65259
	I0304 18:01:43.939301   98186 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:43.939722   98186 main.go:141] libmachine: Using API Version  1
	I0304 18:01:43.939747   98186 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:43.939974   98186 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:43.940342   98186 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:43.940369   98186 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:43.953844   98186 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65262
	I0304 18:01:43.954214   98186 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:43.954561   98186 main.go:141] libmachine: Using API Version  1
	I0304 18:01:43.954575   98186 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:43.954760   98186 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:43.954854   98186 main.go:141] libmachine: (no-preload-800000) Calling .GetState
	I0304 18:01:43.954929   98186 main.go:141] libmachine: (no-preload-800000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:43.954945   98186 main.go:141] libmachine: (no-preload-800000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000/hyperkit.json: no such file or directory
	I0304 18:01:43.954956   98186 main.go:141] libmachine: (no-preload-800000) DBG | hyperkit pid from json: 0
	I0304 18:01:43.954991   98186 main.go:141] libmachine: (no-preload-800000) Calling .DriverName
	I0304 18:01:44.027454   98186 out.go:177] * Deleting "no-preload-800000" in hyperkit ...
	I0304 18:01:44.048650   98186 main.go:141] libmachine: (no-preload-800000) Calling .Remove
	I0304 18:01:44.048836   98186 main.go:141] libmachine: (no-preload-800000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:44.048848   98186 main.go:141] libmachine: (no-preload-800000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:44.048860   98186 main.go:141] libmachine: (no-preload-800000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000/hyperkit.json: no such file or directory
	I0304 18:01:44.048875   98186 main.go:141] libmachine: (no-preload-800000) DBG | hyperkit pid from json: 0
	W0304 18:01:44.068411   98186 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:44.068424   98186 start.go:728] Will try again in 5 seconds ...
	I0304 18:01:45.083837   98186 cache.go:157] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 exists
	I0304 18:01:45.083858   98186 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1" took 4.071541658s
	I0304 18:01:45.083868   98186 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
	I0304 18:01:45.259075   98186 cache.go:157] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 exists
	I0304 18:01:45.259094   98186 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2" took 4.246987045s
	I0304 18:01:45.259104   98186 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 succeeded
	I0304 18:01:46.335938   98186 cache.go:157] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 exists
	I0304 18:01:46.335956   98186 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2" took 5.323913878s
	I0304 18:01:46.335963   98186 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 succeeded
	I0304 18:01:46.577799   98186 cache.go:157] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 exists
	I0304 18:01:46.577814   98186 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2" took 5.565643245s
	I0304 18:01:46.577822   98186 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 succeeded
	I0304 18:01:48.033116   98186 cache.go:157] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 exists
	I0304 18:01:48.033136   98186 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2" took 7.021087267s
	I0304 18:01:48.033152   98186 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 succeeded
	I0304 18:01:49.069337   98186 start.go:360] acquireMachinesLock for no-preload-800000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:01:49.069423   98186 start.go:364] duration metric: took 62.731µs to acquireMachinesLock for "no-preload-800000"
	I0304 18:01:49.069438   98186 start.go:93] Provisioning new machine with config: &{Name:no-preload-800000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-800000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptio
ns:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:01:49.069497   98186 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:01:49.111442   98186 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 18:01:49.111534   98186 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:49.111578   98186 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:49.120144   98186 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65264
	I0304 18:01:49.120518   98186 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:49.120867   98186 main.go:141] libmachine: Using API Version  1
	I0304 18:01:49.120877   98186 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:49.121115   98186 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:49.121244   98186 main.go:141] libmachine: (no-preload-800000) Calling .GetMachineName
	I0304 18:01:49.121338   98186 main.go:141] libmachine: (no-preload-800000) Calling .DriverName
	I0304 18:01:49.121457   98186 start.go:159] libmachine.API.Create for "no-preload-800000" (driver="hyperkit")
	I0304 18:01:49.121474   98186 client.go:168] LocalClient.Create starting
	I0304 18:01:49.121505   98186 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:01:49.121555   98186 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:49.121565   98186 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:49.121609   98186 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:01:49.121646   98186 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:49.121659   98186 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:49.121671   98186 main.go:141] libmachine: Running pre-create checks...
	I0304 18:01:49.121676   98186 main.go:141] libmachine: (no-preload-800000) Calling .PreCreateCheck
	I0304 18:01:49.121751   98186 main.go:141] libmachine: (no-preload-800000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:49.121795   98186 main.go:141] libmachine: (no-preload-800000) Calling .GetConfigRaw
	I0304 18:01:49.122241   98186 main.go:141] libmachine: Creating machine...
	I0304 18:01:49.122249   98186 main.go:141] libmachine: (no-preload-800000) Calling .Create
	I0304 18:01:49.122331   98186 main.go:141] libmachine: (no-preload-800000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:49.122459   98186 main.go:141] libmachine: (no-preload-800000) DBG | I0304 18:01:49.122325   98258 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:49.122511   98186 main.go:141] libmachine: (no-preload-800000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:01:49.296357   98186 main.go:141] libmachine: (no-preload-800000) DBG | I0304 18:01:49.296272   98258 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000/id_rsa...
	I0304 18:01:49.391283   98186 main.go:141] libmachine: (no-preload-800000) DBG | I0304 18:01:49.391249   98258 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000/no-preload-800000.rawdisk...
	I0304 18:01:49.391303   98186 main.go:141] libmachine: (no-preload-800000) DBG | Writing magic tar header
	I0304 18:01:49.391322   98186 main.go:141] libmachine: (no-preload-800000) DBG | Writing SSH key tar header
	I0304 18:01:49.391958   98186 main.go:141] libmachine: (no-preload-800000) DBG | I0304 18:01:49.391925   98258 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000 ...
	I0304 18:01:49.756692   98186 main.go:141] libmachine: (no-preload-800000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:49.756710   98186 main.go:141] libmachine: (no-preload-800000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000/hyperkit.pid
	I0304 18:01:49.756746   98186 main.go:141] libmachine: (no-preload-800000) DBG | Using UUID adb5bbf7-f108-4275-a9e6-24d3bf61d63d
	I0304 18:01:49.792636   98186 main.go:141] libmachine: (no-preload-800000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:01:49.792722   98186 client.go:171] duration metric: took 671.232861ms to LocalClient.Create
	I0304 18:01:50.059921   98186 cache.go:157] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 exists
	I0304 18:01:50.059945   98186 cache.go:96] cache image "registry.k8s.io/etcd:3.5.10-0" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0" took 9.047701748s
	I0304 18:01:50.059954   98186 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.10-0 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 succeeded
	I0304 18:01:50.059970   98186 cache.go:87] Successfully saved all images to host disk.
	I0304 18:01:51.794367   98186 start.go:128] duration metric: took 2.724826997s to createHost
	I0304 18:01:51.794396   98186 start.go:83] releasing machines lock for "no-preload-800000", held for 2.724935579s
	W0304 18:01:51.794538   98186 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p no-preload-800000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p no-preload-800000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:51.816513   98186 out.go:177] 
	W0304 18:01:51.883131   98186 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:01:51.883175   98186 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:01:51.883187   98186 out.go:239] * Related issues:
	* Related issues:
	W0304 18:01:51.883207   98186 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:01:51.883258   98186 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:01:51.946240   98186 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p no-preload-800000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000: exit status 7 (103.073639ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-800000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/FirstStart (11.62s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (10.22s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p old-k8s-version-444000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-444000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0: exit status 60 (10.142774816s)

                                                
                                                
-- stdout --
	* [old-k8s-version-444000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
	* Using the hyperkit driver based on existing profile
	* Starting "old-k8s-version-444000" primary control-plane node in "old-k8s-version-444000" cluster
	* Restarting existing hyperkit VM for "old-k8s-version-444000" ...
	* Restarting existing hyperkit VM for "old-k8s-version-444000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:01:42.117581   98236 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:01:42.118247   98236 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:42.118272   98236 out.go:304] Setting ErrFile to fd 2...
	I0304 18:01:42.118284   98236 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:42.118866   98236 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:01:42.120442   98236 out.go:298] Setting JSON to false
	I0304 18:01:42.143327   98236 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25271,"bootTime":1709578831,"procs":534,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:01:42.143421   98236 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:01:42.164638   98236 out.go:177] * [old-k8s-version-444000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:01:42.227313   98236 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:01:42.206604   98236 notify.go:220] Checking for updates...
	I0304 18:01:42.269217   98236 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:01:42.311342   98236 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:01:42.353300   98236 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:01:42.395324   98236 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:42.437335   98236 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:01:42.458842   98236 config.go:182] Loaded profile config "old-k8s-version-444000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0304 18:01:42.459199   98236 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:42.459246   98236 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:42.467692   98236 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65254
	I0304 18:01:42.468060   98236 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:42.468490   98236 main.go:141] libmachine: Using API Version  1
	I0304 18:01:42.468500   98236 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:42.468724   98236 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:42.468830   98236 main.go:141] libmachine: (old-k8s-version-444000) Calling .DriverName
	I0304 18:01:42.489271   98236 out.go:177] * Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
	I0304 18:01:42.510279   98236 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:01:42.510557   98236 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:42.510581   98236 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:42.518649   98236 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65256
	I0304 18:01:42.518989   98236 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:42.519312   98236 main.go:141] libmachine: Using API Version  1
	I0304 18:01:42.519323   98236 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:42.519536   98236 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:42.519629   98236 main.go:141] libmachine: (old-k8s-version-444000) Calling .DriverName
	I0304 18:01:42.548313   98236 out.go:177] * Using the hyperkit driver based on existing profile
	I0304 18:01:42.590267   98236 start.go:297] selected driver: hyperkit
	I0304 18:01:42.590311   98236 start.go:901] validating driver "hyperkit" against &{Name:old-k8s-version-444000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-444000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 Cert
Expiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:01:42.590456   98236 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:01:42.593526   98236 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:42.593617   98236 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:01:42.601431   98236 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:01:42.605293   98236 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:42.605318   98236 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:01:42.605464   98236 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:01:42.605532   98236 cni.go:84] Creating CNI manager for ""
	I0304 18:01:42.605551   98236 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0304 18:01:42.605610   98236 start.go:340] cluster config:
	{Name:old-k8s-version-444000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-444000 Namespace:defa
ult APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion
:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:01:42.605697   98236 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:42.647275   98236 out.go:177] * Starting "old-k8s-version-444000" primary control-plane node in "old-k8s-version-444000" cluster
	I0304 18:01:42.668221   98236 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0304 18:01:42.668259   98236 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0304 18:01:42.668282   98236 cache.go:56] Caching tarball of preloaded images
	I0304 18:01:42.668385   98236 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:01:42.668394   98236 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0304 18:01:42.668474   98236 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/old-k8s-version-444000/config.json ...
	I0304 18:01:42.668892   98236 start.go:360] acquireMachinesLock for old-k8s-version-444000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:01:43.930153   98236 start.go:364] duration metric: took 1.261231045s to acquireMachinesLock for "old-k8s-version-444000"
	I0304 18:01:43.930209   98236 start.go:96] Skipping create...Using existing machine configuration
	I0304 18:01:43.930221   98236 fix.go:54] fixHost starting: 
	I0304 18:01:43.930454   98236 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:43.930475   98236 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:43.938912   98236 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65258
	I0304 18:01:43.939312   98236 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:43.939719   98236 main.go:141] libmachine: Using API Version  1
	I0304 18:01:43.939737   98236 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:43.939972   98236 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:43.940086   98236 main.go:141] libmachine: (old-k8s-version-444000) Calling .DriverName
	I0304 18:01:43.940169   98236 main.go:141] libmachine: (old-k8s-version-444000) Calling .GetState
	I0304 18:01:43.940257   98236 main.go:141] libmachine: (old-k8s-version-444000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:43.940267   98236 main.go:141] libmachine: (old-k8s-version-444000) DBG | hyperkit pid from json: 0
	I0304 18:01:43.940282   98236 main.go:141] libmachine: (old-k8s-version-444000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000/hyperkit.json: no such file or directory
	I0304 18:01:43.940305   98236 fix.go:112] recreateIfNeeded on old-k8s-version-444000: state=Stopped err=<nil>
	I0304 18:01:43.940322   98236 main.go:141] libmachine: (old-k8s-version-444000) Calling .DriverName
	W0304 18:01:43.940408   98236 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 18:01:43.965532   98236 out.go:177] * Restarting existing hyperkit VM for "old-k8s-version-444000" ...
	I0304 18:01:44.027458   98236 main.go:141] libmachine: (old-k8s-version-444000) Calling .Start
	I0304 18:01:44.027701   98236 main.go:141] libmachine: (old-k8s-version-444000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:44.027738   98236 main.go:141] libmachine: (old-k8s-version-444000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000/hyperkit.pid
	I0304 18:01:44.027799   98236 main.go:141] libmachine: (old-k8s-version-444000) DBG | Using UUID c45c32c3-1c2e-4957-851f-d59ff50ef719
	I0304 18:01:44.095840   98236 main.go:141] libmachine: (old-k8s-version-444000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:01:44.095936   98236 fix.go:56] duration metric: took 165.714371ms for fixHost
	I0304 18:01:44.095947   98236 start.go:83] releasing machines lock for "old-k8s-version-444000", held for 165.756952ms
	W0304 18:01:44.095963   98236 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0304 18:01:44.096012   98236 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:44.096019   98236 start.go:728] Will try again in 5 seconds ...
	I0304 18:01:49.096512   98236 start.go:360] acquireMachinesLock for old-k8s-version-444000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:01:51.794495   98236 start.go:364] duration metric: took 2.69787861s to acquireMachinesLock for "old-k8s-version-444000"
	I0304 18:01:51.794585   98236 start.go:96] Skipping create...Using existing machine configuration
	I0304 18:01:51.794601   98236 fix.go:54] fixHost starting: 
	I0304 18:01:51.795154   98236 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:51.795203   98236 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:51.804966   98236 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65266
	I0304 18:01:51.805486   98236 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:51.805951   98236 main.go:141] libmachine: Using API Version  1
	I0304 18:01:51.805965   98236 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:51.806268   98236 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:51.806458   98236 main.go:141] libmachine: (old-k8s-version-444000) Calling .DriverName
	I0304 18:01:51.806556   98236 main.go:141] libmachine: (old-k8s-version-444000) Calling .GetState
	I0304 18:01:51.806643   98236 main.go:141] libmachine: (old-k8s-version-444000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:51.806674   98236 main.go:141] libmachine: (old-k8s-version-444000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000/hyperkit.json: no such file or directory
	I0304 18:01:51.806690   98236 main.go:141] libmachine: (old-k8s-version-444000) DBG | hyperkit pid from json: 0
	I0304 18:01:51.806691   98236 fix.go:112] recreateIfNeeded on old-k8s-version-444000: state=Stopped err=<nil>
	I0304 18:01:51.806701   98236 main.go:141] libmachine: (old-k8s-version-444000) Calling .DriverName
	W0304 18:01:51.806780   98236 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 18:01:51.861911   98236 out.go:177] * Restarting existing hyperkit VM for "old-k8s-version-444000" ...
	I0304 18:01:51.904061   98236 main.go:141] libmachine: (old-k8s-version-444000) Calling .Start
	I0304 18:01:51.904375   98236 main.go:141] libmachine: (old-k8s-version-444000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:51.904414   98236 main.go:141] libmachine: (old-k8s-version-444000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000/hyperkit.pid
	I0304 18:01:51.904448   98236 main.go:141] libmachine: (old-k8s-version-444000) DBG | Using UUID c45c32c3-1c2e-4957-851f-d59ff50ef719
	I0304 18:01:51.906558   98236 main.go:141] libmachine: (old-k8s-version-444000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:01:51.906643   98236 fix.go:56] duration metric: took 112.040212ms for fixHost
	I0304 18:01:51.906655   98236 start.go:83] releasing machines lock for "old-k8s-version-444000", held for 112.137909ms
	W0304 18:01:51.906722   98236 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-444000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-444000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:52.031388   98236 out.go:177] 
	W0304 18:01:52.075158   98236 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:01:52.075220   98236 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:01:52.075231   98236 out.go:239] * Related issues:
	* Related issues:
	W0304 18:01:52.075254   98236 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:01:52.075281   98236 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:01:52.123089   98236 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p old-k8s-version-444000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000: exit status 7 (76.185235ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-444000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (10.22s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-800000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context no-preload-800000 create -f testdata/busybox.yaml: exit status 1 (37.914642ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-800000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context no-preload-800000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000: exit status 7 (78.725374ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-800000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000: exit status 7 (75.893832ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-800000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/DeployApp (0.19s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.08s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-444000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000: exit status 7 (75.39671ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-444000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.08s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p no-preload-800000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-800000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context no-preload-800000 describe deploy/metrics-server -n kube-system: exit status 1 (36.625724ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-800000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context no-preload-800000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000: exit status 7 (75.464358ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-800000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.32s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-444000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-444000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context old-k8s-version-444000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (38.431562ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-444000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context old-k8s-version-444000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000: exit status 7 (85.227673ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-444000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.12s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p old-k8s-version-444000 image list --format=json
start_stop_delete_test.go:304: v1.20.0 images missing (-want +got):
  []string{
- 	"k8s.gcr.io/coredns:1.7.0",
- 	"k8s.gcr.io/etcd:3.4.13-0",
- 	"k8s.gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"k8s.gcr.io/kube-apiserver:v1.20.0",
- 	"k8s.gcr.io/kube-controller-manager:v1.20.0",
- 	"k8s.gcr.io/kube-proxy:v1.20.0",
- 	"k8s.gcr.io/kube-scheduler:v1.20.0",
- 	"k8s.gcr.io/pause:3.2",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000: exit status 7 (75.333486ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-444000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.20s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (0.37s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p old-k8s-version-444000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p old-k8s-version-444000 --alsologtostderr -v=1: exit status 83 (219.776527ms)

                                                
                                                
-- stdout --
	* The control-plane node old-k8s-version-444000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p old-k8s-version-444000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:01:52.740699   98301 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:01:52.741680   98301 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:52.741689   98301 out.go:304] Setting ErrFile to fd 2...
	I0304 18:01:52.741693   98301 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:52.742019   98301 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:01:52.742351   98301 out.go:298] Setting JSON to false
	I0304 18:01:52.742368   98301 mustload.go:65] Loading cluster: old-k8s-version-444000
	I0304 18:01:52.742637   98301 config.go:182] Loaded profile config "old-k8s-version-444000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0304 18:01:52.742969   98301 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:52.743017   98301 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:52.750801   98301 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65302
	I0304 18:01:52.751237   98301 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:52.751633   98301 main.go:141] libmachine: Using API Version  1
	I0304 18:01:52.751641   98301 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:52.751888   98301 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:52.751995   98301 main.go:141] libmachine: (old-k8s-version-444000) Calling .GetState
	I0304 18:01:52.752083   98301 main.go:141] libmachine: (old-k8s-version-444000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:52.752098   98301 main.go:141] libmachine: (old-k8s-version-444000) DBG | hyperkit pid from json: 0
	I0304 18:01:52.752112   98301 main.go:141] libmachine: (old-k8s-version-444000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/old-k8s-version-444000/hyperkit.json: no such file or directory
	I0304 18:01:52.812580   98301 out.go:177] * The control-plane node old-k8s-version-444000 host is not running: state=Stopped
	I0304 18:01:52.875427   98301 out.go:177]   To start a cluster, run: "minikube start -p old-k8s-version-444000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p old-k8s-version-444000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000: exit status 7 (73.812091ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-444000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000: exit status 7 (72.650744ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-444000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/Pause (0.37s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (11.75s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p embed-certs-917000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p embed-certs-917000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (11.670408324s)

                                                
                                                
-- stdout --
	* [embed-certs-917000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "embed-certs-917000" primary control-plane node in "embed-certs-917000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "embed-certs-917000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:01:53.804999   98339 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:01:53.805575   98339 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:53.805583   98339 out.go:304] Setting ErrFile to fd 2...
	I0304 18:01:53.805629   98339 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:53.805913   98339 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:01:53.807624   98339 out.go:298] Setting JSON to false
	I0304 18:01:53.830265   98339 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25282,"bootTime":1709578831,"procs":513,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:01:53.830379   98339 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:01:53.851784   98339 out.go:177] * [embed-certs-917000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:01:53.914377   98339 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:01:53.893564   98339 notify.go:220] Checking for updates...
	I0304 18:01:53.956576   98339 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:01:53.977317   98339 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:01:54.035387   98339 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:01:54.077656   98339 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:54.119360   98339 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:01:54.141272   98339 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:01:54.141445   98339 config.go:182] Loaded profile config "no-preload-800000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0304 18:01:54.141589   98339 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:01:54.171539   98339 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 18:01:54.212398   98339 start.go:297] selected driver: hyperkit
	I0304 18:01:54.212418   98339 start.go:901] validating driver "hyperkit" against <nil>
	I0304 18:01:54.212433   98339 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:01:54.215586   98339 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:54.215685   98339 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:01:54.223325   98339 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:01:54.227114   98339 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:54.227135   98339 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:01:54.227171   98339 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 18:01:54.227393   98339 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:01:54.227460   98339 cni.go:84] Creating CNI manager for ""
	I0304 18:01:54.227478   98339 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 18:01:54.227485   98339 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0304 18:01:54.227553   98339 start.go:340] cluster config:
	{Name:embed-certs-917000 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-917000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Conta
inerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthS
ock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:01:54.227637   98339 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:54.248661   98339 out.go:177] * Starting "embed-certs-917000" primary control-plane node in "embed-certs-917000" cluster
	I0304 18:01:54.290495   98339 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 18:01:54.290566   98339 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 18:01:54.290616   98339 cache.go:56] Caching tarball of preloaded images
	I0304 18:01:54.290862   98339 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:01:54.290881   98339 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 18:01:54.291030   98339 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/embed-certs-917000/config.json ...
	I0304 18:01:54.291066   98339 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/embed-certs-917000/config.json: {Name:mk3a31a77f69cced970114fd69357b9016e152dd Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 18:01:54.291819   98339 start.go:360] acquireMachinesLock for embed-certs-917000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:01:54.291965   98339 start.go:364] duration metric: took 97.193µs to acquireMachinesLock for "embed-certs-917000"
	I0304 18:01:54.292009   98339 start.go:93] Provisioning new machine with config: &{Name:embed-certs-917000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-917000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou
ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:01:54.292096   98339 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:01:54.313455   98339 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 18:01:54.313659   98339 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:54.313719   98339 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:54.323128   98339 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65319
	I0304 18:01:54.323531   98339 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:54.323979   98339 main.go:141] libmachine: Using API Version  1
	I0304 18:01:54.323996   98339 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:54.324246   98339 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:54.324359   98339 main.go:141] libmachine: (embed-certs-917000) Calling .GetMachineName
	I0304 18:01:54.324452   98339 main.go:141] libmachine: (embed-certs-917000) Calling .DriverName
	I0304 18:01:54.324548   98339 start.go:159] libmachine.API.Create for "embed-certs-917000" (driver="hyperkit")
	I0304 18:01:54.324574   98339 client.go:168] LocalClient.Create starting
	I0304 18:01:54.324615   98339 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:01:54.324664   98339 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:54.324681   98339 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:54.324737   98339 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:01:54.324772   98339 main.go:141] libmachine: Decoding PEM data...
	I0304 18:01:54.324784   98339 main.go:141] libmachine: Parsing certificate...
	I0304 18:01:54.324823   98339 main.go:141] libmachine: Running pre-create checks...
	I0304 18:01:54.324832   98339 main.go:141] libmachine: (embed-certs-917000) Calling .PreCreateCheck
	I0304 18:01:54.324936   98339 main.go:141] libmachine: (embed-certs-917000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:54.325058   98339 main.go:141] libmachine: (embed-certs-917000) Calling .GetConfigRaw
	I0304 18:01:54.334612   98339 main.go:141] libmachine: Creating machine...
	I0304 18:01:54.334633   98339 main.go:141] libmachine: (embed-certs-917000) Calling .Create
	I0304 18:01:54.334834   98339 main.go:141] libmachine: (embed-certs-917000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:54.335053   98339 main.go:141] libmachine: (embed-certs-917000) DBG | I0304 18:01:54.334801   98349 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:54.335148   98339 main.go:141] libmachine: (embed-certs-917000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:01:54.511057   98339 main.go:141] libmachine: (embed-certs-917000) DBG | I0304 18:01:54.510958   98349 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000/id_rsa...
	I0304 18:01:54.599280   98339 main.go:141] libmachine: (embed-certs-917000) DBG | I0304 18:01:54.599206   98349 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000/embed-certs-917000.rawdisk...
	I0304 18:01:54.599291   98339 main.go:141] libmachine: (embed-certs-917000) DBG | Writing magic tar header
	I0304 18:01:54.599300   98339 main.go:141] libmachine: (embed-certs-917000) DBG | Writing SSH key tar header
	I0304 18:01:54.600168   98339 main.go:141] libmachine: (embed-certs-917000) DBG | I0304 18:01:54.600059   98349 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000 ...
	I0304 18:01:54.965272   98339 main.go:141] libmachine: (embed-certs-917000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:54.965303   98339 main.go:141] libmachine: (embed-certs-917000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000/hyperkit.pid
	I0304 18:01:54.965346   98339 main.go:141] libmachine: (embed-certs-917000) DBG | Using UUID 9b0aa3db-d545-410a-ba4d-5112b21bc78c
	I0304 18:01:55.002022   98339 main.go:141] libmachine: (embed-certs-917000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:01:55.002107   98339 client.go:171] duration metric: took 677.517186ms to LocalClient.Create
	I0304 18:01:57.002551   98339 start.go:128] duration metric: took 2.71039122s to createHost
	I0304 18:01:57.002577   98339 start.go:83] releasing machines lock for "embed-certs-917000", held for 2.710569792s
	W0304 18:01:57.002608   98339 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 18:01:57.003044   98339 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:57.003075   98339 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:57.012099   98339 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65340
	I0304 18:01:57.012473   98339 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:57.012827   98339 main.go:141] libmachine: Using API Version  1
	I0304 18:01:57.012835   98339 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:57.013090   98339 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:57.013464   98339 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:57.013486   98339 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:57.021489   98339 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65343
	I0304 18:01:57.021829   98339 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:57.022194   98339 main.go:141] libmachine: Using API Version  1
	I0304 18:01:57.022210   98339 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:57.022437   98339 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:57.022533   98339 main.go:141] libmachine: (embed-certs-917000) Calling .GetState
	I0304 18:01:57.022602   98339 main.go:141] libmachine: (embed-certs-917000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:57.022629   98339 main.go:141] libmachine: (embed-certs-917000) DBG | hyperkit pid from json: 0
	I0304 18:01:57.022647   98339 main.go:141] libmachine: (embed-certs-917000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000/hyperkit.json: no such file or directory
	I0304 18:01:57.022684   98339 main.go:141] libmachine: (embed-certs-917000) Calling .DriverName
	I0304 18:01:57.077968   98339 out.go:177] * Deleting "embed-certs-917000" in hyperkit ...
	I0304 18:01:57.119576   98339 main.go:141] libmachine: (embed-certs-917000) Calling .Remove
	I0304 18:01:57.119725   98339 main.go:141] libmachine: (embed-certs-917000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:57.119734   98339 main.go:141] libmachine: (embed-certs-917000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:57.119747   98339 main.go:141] libmachine: (embed-certs-917000) DBG | hyperkit pid from json: 0
	I0304 18:01:57.119761   98339 main.go:141] libmachine: (embed-certs-917000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000/hyperkit.json: no such file or directory
	W0304 18:01:57.159233   98339 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:57.159247   98339 start.go:728] Will try again in 5 seconds ...
	I0304 18:02:02.159499   98339 start.go:360] acquireMachinesLock for embed-certs-917000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:02:02.217979   98339 start.go:364] duration metric: took 58.446717ms to acquireMachinesLock for "embed-certs-917000"
	I0304 18:02:02.218019   98339 start.go:93] Provisioning new machine with config: &{Name:embed-certs-917000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-917000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou
ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:02:02.218098   98339 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:02:02.303262   98339 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 18:02:02.303390   98339 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:02.303440   98339 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:02.312113   98339 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65347
	I0304 18:02:02.312495   98339 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:02.312860   98339 main.go:141] libmachine: Using API Version  1
	I0304 18:02:02.312875   98339 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:02.313090   98339 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:02.313199   98339 main.go:141] libmachine: (embed-certs-917000) Calling .GetMachineName
	I0304 18:02:02.313290   98339 main.go:141] libmachine: (embed-certs-917000) Calling .DriverName
	I0304 18:02:02.313400   98339 start.go:159] libmachine.API.Create for "embed-certs-917000" (driver="hyperkit")
	I0304 18:02:02.313419   98339 client.go:168] LocalClient.Create starting
	I0304 18:02:02.313444   98339 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:02:02.313492   98339 main.go:141] libmachine: Decoding PEM data...
	I0304 18:02:02.313501   98339 main.go:141] libmachine: Parsing certificate...
	I0304 18:02:02.313542   98339 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:02:02.313577   98339 main.go:141] libmachine: Decoding PEM data...
	I0304 18:02:02.313587   98339 main.go:141] libmachine: Parsing certificate...
	I0304 18:02:02.313601   98339 main.go:141] libmachine: Running pre-create checks...
	I0304 18:02:02.313607   98339 main.go:141] libmachine: (embed-certs-917000) Calling .PreCreateCheck
	I0304 18:02:02.313693   98339 main.go:141] libmachine: (embed-certs-917000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:02.313708   98339 main.go:141] libmachine: (embed-certs-917000) Calling .GetConfigRaw
	I0304 18:02:02.345493   98339 main.go:141] libmachine: Creating machine...
	I0304 18:02:02.345517   98339 main.go:141] libmachine: (embed-certs-917000) Calling .Create
	I0304 18:02:02.345732   98339 main.go:141] libmachine: (embed-certs-917000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:02.345921   98339 main.go:141] libmachine: (embed-certs-917000) DBG | I0304 18:02:02.345711   98383 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:02:02.345962   98339 main.go:141] libmachine: (embed-certs-917000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:02:02.634041   98339 main.go:141] libmachine: (embed-certs-917000) DBG | I0304 18:02:02.633955   98383 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000/id_rsa...
	I0304 18:02:02.791124   98339 main.go:141] libmachine: (embed-certs-917000) DBG | I0304 18:02:02.791043   98383 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000/embed-certs-917000.rawdisk...
	I0304 18:02:02.791138   98339 main.go:141] libmachine: (embed-certs-917000) DBG | Writing magic tar header
	I0304 18:02:02.791161   98339 main.go:141] libmachine: (embed-certs-917000) DBG | Writing SSH key tar header
	I0304 18:02:02.791575   98339 main.go:141] libmachine: (embed-certs-917000) DBG | I0304 18:02:02.791516   98383 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000 ...
	I0304 18:02:03.185582   98339 main.go:141] libmachine: (embed-certs-917000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:03.185601   98339 main.go:141] libmachine: (embed-certs-917000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000/hyperkit.pid
	I0304 18:02:03.185618   98339 main.go:141] libmachine: (embed-certs-917000) DBG | Using UUID ac089a93-66a8-4d76-a38a-e56fa648ca8b
	I0304 18:02:03.224374   98339 main.go:141] libmachine: (embed-certs-917000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:02:03.224453   98339 client.go:171] duration metric: took 911.017793ms to LocalClient.Create
	I0304 18:02:05.225001   98339 start.go:128] duration metric: took 3.006856366s to createHost
	I0304 18:02:05.225025   98339 start.go:83] releasing machines lock for "embed-certs-917000", held for 3.006999065s
	W0304 18:02:05.225157   98339 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p embed-certs-917000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p embed-certs-917000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:02:05.289635   98339 out.go:177] 
	W0304 18:02:05.332400   98339 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:02:05.332454   98339 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:02:05.332470   98339 out.go:239] * Related issues:
	* Related issues:
	W0304 18:02:05.332488   98339 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:02:05.332522   98339 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:02:05.353416   98339 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p embed-certs-917000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000: exit status 7 (76.444634ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/FirstStart (11.75s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (6.08s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p no-preload-800000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p no-preload-800000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (5.99657904s)

                                                
                                                
-- stdout --
	* [no-preload-800000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "no-preload-800000" primary control-plane node in "no-preload-800000" cluster
	* Restarting existing hyperkit VM for "no-preload-800000" ...
	* Restarting existing hyperkit VM for "no-preload-800000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:01:56.512935   98367 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:01:56.513120   98367 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:56.513126   98367 out.go:304] Setting ErrFile to fd 2...
	I0304 18:01:56.513129   98367 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:01:56.513317   98367 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:01:56.514854   98367 out.go:298] Setting JSON to false
	I0304 18:01:56.537039   98367 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25285,"bootTime":1709578831,"procs":510,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:01:56.537134   98367 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:01:56.559176   98367 out.go:177] * [no-preload-800000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:01:56.600986   98367 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:01:56.601056   98367 notify.go:220] Checking for updates...
	I0304 18:01:56.643985   98367 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:01:56.664722   98367 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:01:56.685804   98367 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:01:56.707088   98367 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:01:56.727848   98367 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:01:56.749535   98367 config.go:182] Loaded profile config "no-preload-800000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0304 18:01:56.750202   98367 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:56.750290   98367 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:56.759315   98367 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65335
	I0304 18:01:56.759695   98367 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:56.760092   98367 main.go:141] libmachine: Using API Version  1
	I0304 18:01:56.760105   98367 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:56.760329   98367 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:56.760439   98367 main.go:141] libmachine: (no-preload-800000) Calling .DriverName
	I0304 18:01:56.760630   98367 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:01:56.760867   98367 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:56.760913   98367 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:56.768635   98367 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65337
	I0304 18:01:56.768999   98367 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:56.769338   98367 main.go:141] libmachine: Using API Version  1
	I0304 18:01:56.769347   98367 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:56.769544   98367 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:56.769659   98367 main.go:141] libmachine: (no-preload-800000) Calling .DriverName
	I0304 18:01:56.798047   98367 out.go:177] * Using the hyperkit driver based on existing profile
	I0304 18:01:56.839932   98367 start.go:297] selected driver: hyperkit
	I0304 18:01:56.839961   98367 start.go:901] validating driver "hyperkit" against &{Name:no-preload-800000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-800000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0
CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:01:56.840141   98367 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:01:56.844490   98367 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:56.844574   98367 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:01:56.852381   98367 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:01:56.856212   98367 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:56.856243   98367 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:01:56.856381   98367 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:01:56.856447   98367 cni.go:84] Creating CNI manager for ""
	I0304 18:01:56.856461   98367 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 18:01:56.856511   98367 start.go:340] cluster config:
	{Name:no-preload-800000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-800000 Namespace:default
APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVer
sion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:01:56.856596   98367 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:56.898834   98367 out.go:177] * Starting "no-preload-800000" primary control-plane node in "no-preload-800000" cluster
	I0304 18:01:56.919759   98367 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0304 18:01:56.919914   98367 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/no-preload-800000/config.json ...
	I0304 18:01:56.920007   98367 cache.go:107] acquiring lock: {Name:mkb69e339230bce54c06e24ec70ec4393a65223e Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:56.920016   98367 cache.go:107] acquiring lock: {Name:mk818db6c37cd0d7d4a54da24c1d2217d7454450 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:56.920074   98367 cache.go:107] acquiring lock: {Name:mk51650f910085c726ba9076234e9de20ac0de60 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:56.920120   98367 cache.go:107] acquiring lock: {Name:mk18f26f1077a5eb1cc486ad25730361d6fe4881 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:56.920196   98367 cache.go:115] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0304 18:01:56.920217   98367 cache.go:115] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 exists
	I0304 18:01:56.920223   98367 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 224.369µs
	I0304 18:01:56.920230   98367 cache.go:115] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 exists
	I0304 18:01:56.920203   98367 cache.go:107] acquiring lock: {Name:mka6797e4645fd0222f41eb0857e1b47609e43dc Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:56.920240   98367 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0304 18:01:56.920247   98367 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2" took 198.794µs
	I0304 18:01:56.920232   98367 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2" took 229.949µs
	I0304 18:01:56.920265   98367 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 succeeded
	I0304 18:01:56.920274   98367 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 succeeded
	I0304 18:01:56.920324   98367 cache.go:115] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 exists
	I0304 18:01:56.920301   98367 cache.go:107] acquiring lock: {Name:mk9d91580ee1e52e7496c79e276338a42b308f38 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:56.920342   98367 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2" took 267.309µs
	I0304 18:01:56.920358   98367 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 succeeded
	I0304 18:01:56.920334   98367 cache.go:107] acquiring lock: {Name:mke00a4ba9a78937a8460a1db179987c0540a082 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:56.920377   98367 cache.go:107] acquiring lock: {Name:mk460076777ad58f84e461d93bdde18e610ad288 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:01:56.920411   98367 cache.go:115] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 exists
	I0304 18:01:56.920430   98367 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2" took 297.179µs
	I0304 18:01:56.920444   98367 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 succeeded
	I0304 18:01:56.920483   98367 cache.go:115] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 exists
	I0304 18:01:56.920492   98367 cache.go:96] cache image "registry.k8s.io/etcd:3.5.10-0" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0" took 252.931µs
	I0304 18:01:56.920509   98367 cache.go:80] save to tar file registry.k8s.io/etcd:3.5.10-0 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0 succeeded
	I0304 18:01:56.920521   98367 cache.go:115] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 exists
	I0304 18:01:56.920517   98367 cache.go:115] /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 exists
	I0304 18:01:56.920533   98367 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9" took 207.189µs
	I0304 18:01:56.920538   98367 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1" took 284.015µs
	I0304 18:01:56.920547   98367 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 succeeded
	I0304 18:01:56.920551   98367 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
	I0304 18:01:56.920562   98367 cache.go:87] Successfully saved all images to host disk.
	I0304 18:01:56.920724   98367 start.go:360] acquireMachinesLock for no-preload-800000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:01:57.002696   98367 start.go:364] duration metric: took 81.937644ms to acquireMachinesLock for "no-preload-800000"
	I0304 18:01:57.002760   98367 start.go:96] Skipping create...Using existing machine configuration
	I0304 18:01:57.002777   98367 fix.go:54] fixHost starting: 
	I0304 18:01:57.003072   98367 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:01:57.003124   98367 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:01:57.012087   98367 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65339
	I0304 18:01:57.012484   98367 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:01:57.012834   98367 main.go:141] libmachine: Using API Version  1
	I0304 18:01:57.012843   98367 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:01:57.013110   98367 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:01:57.013223   98367 main.go:141] libmachine: (no-preload-800000) Calling .DriverName
	I0304 18:01:57.013314   98367 main.go:141] libmachine: (no-preload-800000) Calling .GetState
	I0304 18:01:57.013397   98367 main.go:141] libmachine: (no-preload-800000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:57.013422   98367 main.go:141] libmachine: (no-preload-800000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000/hyperkit.json: no such file or directory
	I0304 18:01:57.013429   98367 main.go:141] libmachine: (no-preload-800000) DBG | hyperkit pid from json: 0
	I0304 18:01:57.013453   98367 fix.go:112] recreateIfNeeded on no-preload-800000: state=Stopped err=<nil>
	I0304 18:01:57.013469   98367 main.go:141] libmachine: (no-preload-800000) Calling .DriverName
	W0304 18:01:57.013555   98367 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 18:01:57.035190   98367 out.go:177] * Restarting existing hyperkit VM for "no-preload-800000" ...
	I0304 18:01:57.098959   98367 main.go:141] libmachine: (no-preload-800000) Calling .Start
	I0304 18:01:57.099268   98367 main.go:141] libmachine: (no-preload-800000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:01:57.099308   98367 main.go:141] libmachine: (no-preload-800000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000/hyperkit.pid
	I0304 18:01:57.099435   98367 main.go:141] libmachine: (no-preload-800000) DBG | Using UUID adb5bbf7-f108-4275-a9e6-24d3bf61d63d
	I0304 18:01:57.101861   98367 main.go:141] libmachine: (no-preload-800000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:01:57.101968   98367 fix.go:56] duration metric: took 99.189513ms for fixHost
	I0304 18:01:57.101983   98367 start.go:83] releasing machines lock for "no-preload-800000", held for 99.268256ms
	W0304 18:01:57.102010   98367 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0304 18:01:57.102124   98367 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:01:57.102136   98367 start.go:728] Will try again in 5 seconds ...
	I0304 18:02:02.104142   98367 start.go:360] acquireMachinesLock for no-preload-800000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:02:02.104308   98367 start.go:364] duration metric: took 133.862µs to acquireMachinesLock for "no-preload-800000"
	I0304 18:02:02.104335   98367 start.go:96] Skipping create...Using existing machine configuration
	I0304 18:02:02.104341   98367 fix.go:54] fixHost starting: 
	I0304 18:02:02.104667   98367 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:02.104700   98367 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:02.113360   98367 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65345
	I0304 18:02:02.113810   98367 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:02.114224   98367 main.go:141] libmachine: Using API Version  1
	I0304 18:02:02.114233   98367 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:02.114470   98367 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:02.114592   98367 main.go:141] libmachine: (no-preload-800000) Calling .DriverName
	I0304 18:02:02.114685   98367 main.go:141] libmachine: (no-preload-800000) Calling .GetState
	I0304 18:02:02.114780   98367 main.go:141] libmachine: (no-preload-800000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:02.114806   98367 main.go:141] libmachine: (no-preload-800000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000/hyperkit.json: no such file or directory
	I0304 18:02:02.114824   98367 main.go:141] libmachine: (no-preload-800000) DBG | hyperkit pid from json: 0
	I0304 18:02:02.114854   98367 fix.go:112] recreateIfNeeded on no-preload-800000: state=Stopped err=<nil>
	I0304 18:02:02.114874   98367 main.go:141] libmachine: (no-preload-800000) Calling .DriverName
	W0304 18:02:02.114968   98367 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 18:02:02.136647   98367 out.go:177] * Restarting existing hyperkit VM for "no-preload-800000" ...
	I0304 18:02:02.180151   98367 main.go:141] libmachine: (no-preload-800000) Calling .Start
	I0304 18:02:02.180430   98367 main.go:141] libmachine: (no-preload-800000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:02.180484   98367 main.go:141] libmachine: (no-preload-800000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000/hyperkit.pid
	I0304 18:02:02.180557   98367 main.go:141] libmachine: (no-preload-800000) DBG | Using UUID adb5bbf7-f108-4275-a9e6-24d3bf61d63d
	I0304 18:02:02.217832   98367 main.go:141] libmachine: (no-preload-800000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:02:02.217931   98367 fix.go:56] duration metric: took 113.587926ms for fixHost
	I0304 18:02:02.217938   98367 start.go:83] releasing machines lock for "no-preload-800000", held for 113.618241ms
	W0304 18:02:02.218013   98367 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p no-preload-800000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p no-preload-800000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:02:02.260209   98367 out.go:177] 
	W0304 18:02:02.324244   98367 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:02:02.324301   98367 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:02:02.324313   98367 out.go:239] * Related issues:
	* Related issues:
	W0304 18:02:02.324369   98367 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:02:02.324386   98367 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:02:02.366228   98367 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p no-preload-800000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000: exit status 7 (77.303016ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-800000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/SecondStart (6.08s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.08s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-800000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000: exit status 7 (75.173044ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-800000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.08s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-800000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-800000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context no-preload-800000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (37.792563ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-800000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context no-preload-800000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000: exit status 7 (76.509742ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-800000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.11s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.2s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p no-preload-800000 image list --format=json
start_stop_delete_test.go:304: v1.29.0-rc.2 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.1",
- 	"registry.k8s.io/etcd:3.5.10-0",
- 	"registry.k8s.io/kube-apiserver:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-controller-manager:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-proxy:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-scheduler:v1.29.0-rc.2",
- 	"registry.k8s.io/pause:3.9",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000: exit status 7 (77.483988ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-800000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.20s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (0.3s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p no-preload-800000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p no-preload-800000 --alsologtostderr -v=1: exit status 83 (141.749985ms)

                                                
                                                
-- stdout --
	* The control-plane node no-preload-800000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p no-preload-800000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:02:02.980966   98400 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:02:02.981236   98400 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:02.981242   98400 out.go:304] Setting ErrFile to fd 2...
	I0304 18:02:02.981245   98400 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:02.981413   98400 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:02:02.981729   98400 out.go:298] Setting JSON to false
	I0304 18:02:02.981745   98400 mustload.go:65] Loading cluster: no-preload-800000
	I0304 18:02:02.982059   98400 config.go:182] Loaded profile config "no-preload-800000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0304 18:02:02.982429   98400 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:02.982462   98400 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:02.990394   98400 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65363
	I0304 18:02:02.990861   98400 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:02.991291   98400 main.go:141] libmachine: Using API Version  1
	I0304 18:02:02.991300   98400 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:02.991524   98400 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:02.991630   98400 main.go:141] libmachine: (no-preload-800000) Calling .GetState
	I0304 18:02:02.991720   98400 main.go:141] libmachine: (no-preload-800000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:02.991749   98400 main.go:141] libmachine: (no-preload-800000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/no-preload-800000/hyperkit.json: no such file or directory
	I0304 18:02:02.991759   98400 main.go:141] libmachine: (no-preload-800000) DBG | hyperkit pid from json: 0
	I0304 18:02:03.014373   98400 out.go:177] * The control-plane node no-preload-800000 host is not running: state=Stopped
	I0304 18:02:03.034676   98400 out.go:177]   To start a cluster, run: "minikube start -p no-preload-800000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p no-preload-800000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000: exit status 7 (76.846037ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-800000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000: exit status 7 (79.351598ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-800000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/Pause (0.30s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (12.1s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p default-k8s-diff-port-051000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p default-k8s-diff-port-051000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (11.974232018s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-051000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "default-k8s-diff-port-051000" primary control-plane node in "default-k8s-diff-port-051000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "default-k8s-diff-port-051000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:02:04.386146   98441 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:02:04.386410   98441 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:04.386415   98441 out.go:304] Setting ErrFile to fd 2...
	I0304 18:02:04.386419   98441 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:04.386596   98441 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:02:04.388127   98441 out.go:298] Setting JSON to false
	I0304 18:02:04.410744   98441 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25293,"bootTime":1709578831,"procs":503,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:02:04.410844   98441 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:02:04.432257   98441 out.go:177] * [default-k8s-diff-port-051000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:02:04.474053   98441 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:02:04.474133   98441 notify.go:220] Checking for updates...
	I0304 18:02:04.516097   98441 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:02:04.536888   98441 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:02:04.558136   98441 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:02:04.600042   98441 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:02:04.620945   98441 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:02:04.642966   98441 config.go:182] Loaded profile config "embed-certs-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:02:04.643152   98441 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:02:04.643307   98441 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:02:04.673016   98441 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 18:02:04.714931   98441 start.go:297] selected driver: hyperkit
	I0304 18:02:04.714959   98441 start.go:901] validating driver "hyperkit" against <nil>
	I0304 18:02:04.714978   98441 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:02:04.718938   98441 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:02:04.719048   98441 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:02:04.727002   98441 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:02:04.731051   98441 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:04.731075   98441 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:02:04.731112   98441 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 18:02:04.731330   98441 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:02:04.731397   98441 cni.go:84] Creating CNI manager for ""
	I0304 18:02:04.731414   98441 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 18:02:04.731422   98441 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0304 18:02:04.731487   98441 start.go:340] cluster config:
	{Name:default-k8s-diff-port-051000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-051000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomai
n:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPat
h: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:02:04.731575   98441 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:02:04.753079   98441 out.go:177] * Starting "default-k8s-diff-port-051000" primary control-plane node in "default-k8s-diff-port-051000" cluster
	I0304 18:02:04.774008   98441 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 18:02:04.774079   98441 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 18:02:04.774111   98441 cache.go:56] Caching tarball of preloaded images
	I0304 18:02:04.774306   98441 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:02:04.774324   98441 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 18:02:04.774488   98441 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/default-k8s-diff-port-051000/config.json ...
	I0304 18:02:04.774523   98441 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/default-k8s-diff-port-051000/config.json: {Name:mk4360289a41b52a03218a5869a500e7d65f1a39 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 18:02:04.775227   98441 start.go:360] acquireMachinesLock for default-k8s-diff-port-051000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:02:05.225127   98441 start.go:364] duration metric: took 449.854908ms to acquireMachinesLock for "default-k8s-diff-port-051000"
	I0304 18:02:05.225230   98441 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-051000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-051000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:02:05.225324   98441 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:02:05.311547   98441 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 18:02:05.311710   98441 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:05.311750   98441 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:05.319882   98441 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65376
	I0304 18:02:05.320261   98441 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:05.320676   98441 main.go:141] libmachine: Using API Version  1
	I0304 18:02:05.320688   98441 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:05.320895   98441 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:05.320999   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .GetMachineName
	I0304 18:02:05.321089   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .DriverName
	I0304 18:02:05.321180   98441 start.go:159] libmachine.API.Create for "default-k8s-diff-port-051000" (driver="hyperkit")
	I0304 18:02:05.321203   98441 client.go:168] LocalClient.Create starting
	I0304 18:02:05.321237   98441 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:02:05.321288   98441 main.go:141] libmachine: Decoding PEM data...
	I0304 18:02:05.321306   98441 main.go:141] libmachine: Parsing certificate...
	I0304 18:02:05.321359   98441 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:02:05.321401   98441 main.go:141] libmachine: Decoding PEM data...
	I0304 18:02:05.321410   98441 main.go:141] libmachine: Parsing certificate...
	I0304 18:02:05.321422   98441 main.go:141] libmachine: Running pre-create checks...
	I0304 18:02:05.321432   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .PreCreateCheck
	I0304 18:02:05.321505   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:05.321694   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .GetConfigRaw
	I0304 18:02:05.333039   98441 main.go:141] libmachine: Creating machine...
	I0304 18:02:05.333059   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .Create
	I0304 18:02:05.333244   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:05.333472   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | I0304 18:02:05.333216   98449 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:02:05.333585   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:02:05.599822   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | I0304 18:02:05.599758   98449 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000/id_rsa...
	I0304 18:02:05.667754   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | I0304 18:02:05.667703   98449 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000/default-k8s-diff-port-051000.rawdisk...
	I0304 18:02:05.667774   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | Writing magic tar header
	I0304 18:02:05.667790   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | Writing SSH key tar header
	I0304 18:02:05.668406   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | I0304 18:02:05.668374   98449 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000 ...
	I0304 18:02:06.031810   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:06.031828   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000/hyperkit.pid
	I0304 18:02:06.031842   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | Using UUID ab908af1-281e-432b-8b65-693c83c2af64
	I0304 18:02:06.069562   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:02:06.069658   98441 client.go:171] duration metric: took 748.437736ms to LocalClient.Create
	I0304 18:02:08.072171   98441 start.go:128] duration metric: took 2.844485643s to createHost
	I0304 18:02:08.072196   98441 start.go:83] releasing machines lock for "default-k8s-diff-port-051000", held for 2.844723673s
	W0304 18:02:08.072229   98441 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 18:02:08.072804   98441 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:08.072847   98441 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:08.082237   98441 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65403
	I0304 18:02:08.082613   98441 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:08.082959   98441 main.go:141] libmachine: Using API Version  1
	I0304 18:02:08.082968   98441 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:08.083218   98441 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:08.083577   98441 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:08.083619   98441 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:08.091605   98441 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65405
	I0304 18:02:08.091971   98441 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:08.092374   98441 main.go:141] libmachine: Using API Version  1
	I0304 18:02:08.092388   98441 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:08.092607   98441 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:08.092708   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .GetState
	I0304 18:02:08.092788   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:08.092816   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000/hyperkit.json: no such file or directory
	I0304 18:02:08.092825   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | hyperkit pid from json: 0
	I0304 18:02:08.092863   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .DriverName
	I0304 18:02:08.134580   98441 out.go:177] * Deleting "default-k8s-diff-port-051000" in hyperkit ...
	I0304 18:02:08.155646   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .Remove
	I0304 18:02:08.155969   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:08.155992   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:08.156006   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000/hyperkit.json: no such file or directory
	I0304 18:02:08.156029   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | hyperkit pid from json: 0
	W0304 18:02:08.174440   98441 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:02:08.174464   98441 start.go:728] Will try again in 5 seconds ...
	I0304 18:02:13.181478   98441 start.go:360] acquireMachinesLock for default-k8s-diff-port-051000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:02:13.181653   98441 start.go:364] duration metric: took 126.528µs to acquireMachinesLock for "default-k8s-diff-port-051000"
	I0304 18:02:13.181700   98441 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-051000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-051000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:02:13.181812   98441 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:02:13.226365   98441 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 18:02:13.226538   98441 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:13.226607   98441 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:13.236556   98441 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65423
	I0304 18:02:13.237049   98441 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:13.237402   98441 main.go:141] libmachine: Using API Version  1
	I0304 18:02:13.237417   98441 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:13.237637   98441 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:13.237743   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .GetMachineName
	I0304 18:02:13.237821   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .DriverName
	I0304 18:02:13.237914   98441 start.go:159] libmachine.API.Create for "default-k8s-diff-port-051000" (driver="hyperkit")
	I0304 18:02:13.237931   98441 client.go:168] LocalClient.Create starting
	I0304 18:02:13.237961   98441 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:02:13.238009   98441 main.go:141] libmachine: Decoding PEM data...
	I0304 18:02:13.238019   98441 main.go:141] libmachine: Parsing certificate...
	I0304 18:02:13.238065   98441 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:02:13.238103   98441 main.go:141] libmachine: Decoding PEM data...
	I0304 18:02:13.238116   98441 main.go:141] libmachine: Parsing certificate...
	I0304 18:02:13.238134   98441 main.go:141] libmachine: Running pre-create checks...
	I0304 18:02:13.238139   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .PreCreateCheck
	I0304 18:02:13.238226   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:13.238241   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .GetConfigRaw
	I0304 18:02:13.238763   98441 main.go:141] libmachine: Creating machine...
	I0304 18:02:13.238771   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .Create
	I0304 18:02:13.238844   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:13.238956   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | I0304 18:02:13.238834   98507 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:02:13.239007   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:02:13.414868   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | I0304 18:02:13.414762   98507 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000/id_rsa...
	I0304 18:02:13.708483   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | I0304 18:02:13.708399   98507 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000/default-k8s-diff-port-051000.rawdisk...
	I0304 18:02:13.708502   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | Writing magic tar header
	I0304 18:02:13.708520   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | Writing SSH key tar header
	I0304 18:02:13.709286   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | I0304 18:02:13.709191   98507 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000 ...
	I0304 18:02:14.074156   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:14.074194   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000/hyperkit.pid
	I0304 18:02:14.074237   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | Using UUID 495540ca-cf04-489b-8905-c9de8bd17565
	I0304 18:02:14.111264   98441 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:02:14.111343   98441 client.go:171] duration metric: took 872.604412ms to LocalClient.Create
	I0304 18:02:16.114924   98441 start.go:128] duration metric: took 2.930555074s to createHost
	I0304 18:02:16.114950   98441 start.go:83] releasing machines lock for "default-k8s-diff-port-051000", held for 2.930745958s
	W0304 18:02:16.115069   98441 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-051000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-051000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:02:16.158523   98441 out.go:177] 
	W0304 18:02:16.202719   98441 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:02:16.202789   98441 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:02:16.202891   98441 out.go:239] * Related issues:
	* Related issues:
	W0304 18:02:16.202980   98441 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:02:16.203025   98441 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:02:16.246521   98441 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p default-k8s-diff-port-051000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000: exit status 7 (119.790121ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-051000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (12.10s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-917000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context embed-certs-917000 create -f testdata/busybox.yaml: exit status 1 (40.845228ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-917000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context embed-certs-917000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000: exit status 7 (75.468282ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-917000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000: exit status 7 (74.574191ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/DeployApp (0.19s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.34s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p embed-certs-917000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-917000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context embed-certs-917000 describe deploy/metrics-server -n kube-system: exit status 1 (38.068429ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-917000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context embed-certs-917000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000: exit status 7 (78.466515ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.34s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (8.22s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p embed-certs-917000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p embed-certs-917000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (8.141219217s)

                                                
                                                
-- stdout --
	* [embed-certs-917000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "embed-certs-917000" primary control-plane node in "embed-certs-917000" cluster
	* Restarting existing hyperkit VM for "embed-certs-917000" ...
	* Restarting existing hyperkit VM for "embed-certs-917000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:02:08.485807   98493 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:02:08.485977   98493 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:08.485982   98493 out.go:304] Setting ErrFile to fd 2...
	I0304 18:02:08.485986   98493 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:08.486166   98493 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:02:08.487668   98493 out.go:298] Setting JSON to false
	I0304 18:02:08.510122   98493 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25297,"bootTime":1709578831,"procs":510,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:02:08.510209   98493 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:02:08.531669   98493 out.go:177] * [embed-certs-917000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:02:08.573856   98493 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:02:08.573916   98493 notify.go:220] Checking for updates...
	I0304 18:02:08.616669   98493 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:02:08.658556   98493 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:02:08.679768   98493 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:02:08.721723   98493 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:02:08.763920   98493 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:02:08.785760   98493 config.go:182] Loaded profile config "embed-certs-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:02:08.786405   98493 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:08.786486   98493 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:08.795833   98493 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65417
	I0304 18:02:08.796234   98493 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:08.796672   98493 main.go:141] libmachine: Using API Version  1
	I0304 18:02:08.796687   98493 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:08.796909   98493 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:08.797012   98493 main.go:141] libmachine: (embed-certs-917000) Calling .DriverName
	I0304 18:02:08.797207   98493 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:02:08.797459   98493 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:08.797495   98493 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:08.805275   98493 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65419
	I0304 18:02:08.805617   98493 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:08.805957   98493 main.go:141] libmachine: Using API Version  1
	I0304 18:02:08.805967   98493 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:08.806203   98493 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:08.806301   98493 main.go:141] libmachine: (embed-certs-917000) Calling .DriverName
	I0304 18:02:08.835273   98493 out.go:177] * Using the hyperkit driver based on existing profile
	I0304 18:02:08.877025   98493 start.go:297] selected driver: hyperkit
	I0304 18:02:08.877041   98493 start.go:901] validating driver "hyperkit" against &{Name:embed-certs-917000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-917000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpir
ation:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:02:08.877169   98493 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:02:08.880210   98493 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:02:08.880304   98493 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:02:08.888127   98493 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:02:08.892089   98493 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:08.892112   98493 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:02:08.892264   98493 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:02:08.892323   98493 cni.go:84] Creating CNI manager for ""
	I0304 18:02:08.892339   98493 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 18:02:08.892408   98493 start.go:340] cluster config:
	{Name:embed-certs-917000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-917000 Namespace:default APIS
erverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p20
00.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:02:08.892508   98493 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:02:08.935274   98493 out.go:177] * Starting "embed-certs-917000" primary control-plane node in "embed-certs-917000" cluster
	I0304 18:02:08.956102   98493 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 18:02:08.956145   98493 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 18:02:08.956161   98493 cache.go:56] Caching tarball of preloaded images
	I0304 18:02:08.956265   98493 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:02:08.956275   98493 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 18:02:08.956358   98493 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/embed-certs-917000/config.json ...
	I0304 18:02:08.956859   98493 start.go:360] acquireMachinesLock for embed-certs-917000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:02:08.956915   98493 start.go:364] duration metric: took 42.71µs to acquireMachinesLock for "embed-certs-917000"
	I0304 18:02:08.956935   98493 start.go:96] Skipping create...Using existing machine configuration
	I0304 18:02:08.956945   98493 fix.go:54] fixHost starting: 
	I0304 18:02:08.957178   98493 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:08.957199   98493 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:08.965273   98493 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65421
	I0304 18:02:08.965643   98493 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:08.966024   98493 main.go:141] libmachine: Using API Version  1
	I0304 18:02:08.966037   98493 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:08.966276   98493 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:08.966389   98493 main.go:141] libmachine: (embed-certs-917000) Calling .DriverName
	I0304 18:02:08.966483   98493 main.go:141] libmachine: (embed-certs-917000) Calling .GetState
	I0304 18:02:08.966565   98493 main.go:141] libmachine: (embed-certs-917000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:08.966598   98493 main.go:141] libmachine: (embed-certs-917000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000/hyperkit.json: no such file or directory
	I0304 18:02:08.966607   98493 main.go:141] libmachine: (embed-certs-917000) DBG | hyperkit pid from json: 0
	I0304 18:02:08.966659   98493 fix.go:112] recreateIfNeeded on embed-certs-917000: state=Stopped err=<nil>
	I0304 18:02:08.966684   98493 main.go:141] libmachine: (embed-certs-917000) Calling .DriverName
	W0304 18:02:08.966776   98493 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 18:02:09.009382   98493 out.go:177] * Restarting existing hyperkit VM for "embed-certs-917000" ...
	I0304 18:02:09.030405   98493 main.go:141] libmachine: (embed-certs-917000) Calling .Start
	I0304 18:02:09.030752   98493 main.go:141] libmachine: (embed-certs-917000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:09.030790   98493 main.go:141] libmachine: (embed-certs-917000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000/hyperkit.pid
	I0304 18:02:09.030869   98493 main.go:141] libmachine: (embed-certs-917000) DBG | Using UUID ac089a93-66a8-4d76-a38a-e56fa648ca8b
	I0304 18:02:09.033229   98493 main.go:141] libmachine: (embed-certs-917000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:02:09.033405   98493 fix.go:56] duration metric: took 76.359524ms for fixHost
	I0304 18:02:09.033424   98493 start.go:83] releasing machines lock for "embed-certs-917000", held for 76.40429ms
	W0304 18:02:09.033449   98493 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0304 18:02:09.033573   98493 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:02:09.033585   98493 start.go:728] Will try again in 5 seconds ...
	I0304 18:02:14.038992   98493 start.go:360] acquireMachinesLock for embed-certs-917000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:02:16.115039   98493 start.go:364] duration metric: took 2.074267938s to acquireMachinesLock for "embed-certs-917000"
	I0304 18:02:16.115172   98493 start.go:96] Skipping create...Using existing machine configuration
	I0304 18:02:16.115182   98493 fix.go:54] fixHost starting: 
	I0304 18:02:16.115683   98493 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:16.115732   98493 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:16.125008   98493 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65425
	I0304 18:02:16.125379   98493 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:16.125727   98493 main.go:141] libmachine: Using API Version  1
	I0304 18:02:16.125744   98493 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:16.125968   98493 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:16.126090   98493 main.go:141] libmachine: (embed-certs-917000) Calling .DriverName
	I0304 18:02:16.126174   98493 main.go:141] libmachine: (embed-certs-917000) Calling .GetState
	I0304 18:02:16.126256   98493 main.go:141] libmachine: (embed-certs-917000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:16.126271   98493 main.go:141] libmachine: (embed-certs-917000) DBG | hyperkit pid from json: 0
	I0304 18:02:16.126283   98493 main.go:141] libmachine: (embed-certs-917000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000/hyperkit.json: no such file or directory
	I0304 18:02:16.126316   98493 fix.go:112] recreateIfNeeded on embed-certs-917000: state=Stopped err=<nil>
	I0304 18:02:16.126334   98493 main.go:141] libmachine: (embed-certs-917000) Calling .DriverName
	W0304 18:02:16.126421   98493 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 18:02:16.180668   98493 out.go:177] * Restarting existing hyperkit VM for "embed-certs-917000" ...
	I0304 18:02:16.225343   98493 main.go:141] libmachine: (embed-certs-917000) Calling .Start
	I0304 18:02:16.225537   98493 main.go:141] libmachine: (embed-certs-917000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:16.225568   98493 main.go:141] libmachine: (embed-certs-917000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000/hyperkit.pid
	I0304 18:02:16.225640   98493 main.go:141] libmachine: (embed-certs-917000) DBG | Using UUID ac089a93-66a8-4d76-a38a-e56fa648ca8b
	I0304 18:02:16.351640   98493 main.go:141] libmachine: (embed-certs-917000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:02:16.351713   98493 fix.go:56] duration metric: took 236.34391ms for fixHost
	I0304 18:02:16.351721   98493 start.go:83] releasing machines lock for "embed-certs-917000", held for 236.398488ms
	W0304 18:02:16.351796   98493 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p embed-certs-917000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p embed-certs-917000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:02:16.393576   98493 out.go:177] 
	W0304 18:02:16.432977   98493 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:02:16.433116   98493 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:02:16.433143   98493 out.go:239] * Related issues:
	* Related issues:
	W0304 18:02:16.433200   98493 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:02:16.433236   98493 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:02:16.475478   98493 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p embed-certs-917000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000: exit status 7 (75.832141ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/SecondStart (8.22s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.22s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-051000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-051000 create -f testdata/busybox.yaml: exit status 1 (38.216723ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-051000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context default-k8s-diff-port-051000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000: exit status 7 (103.952529ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-051000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000: exit status 7 (79.035366ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-051000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.22s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-917000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000: exit status 7 (113.077989ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.11s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.36s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p default-k8s-diff-port-051000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-051000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-051000 describe deploy/metrics-server -n kube-system: exit status 1 (36.866024ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-051000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context default-k8s-diff-port-051000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000: exit status 7 (96.523259ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-051000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.36s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.13s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-917000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-917000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context embed-certs-917000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (37.840682ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-917000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context embed-certs-917000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000: exit status 7 (89.22568ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.13s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p embed-certs-917000 image list --format=json
start_stop_delete_test.go:304: v1.28.4 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.4",
- 	"registry.k8s.io/kube-controller-manager:v1.28.4",
- 	"registry.k8s.io/kube-proxy:v1.28.4",
- 	"registry.k8s.io/kube-scheduler:v1.28.4",
- 	"registry.k8s.io/pause:3.9",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000: exit status 7 (74.131958ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.19s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p embed-certs-917000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p embed-certs-917000 --alsologtostderr -v=1: exit status 83 (170.50427ms)

                                                
                                                
-- stdout --
	* The control-plane node embed-certs-917000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p embed-certs-917000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:02:17.143600   98548 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:02:17.157364   98548 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:17.157371   98548 out.go:304] Setting ErrFile to fd 2...
	I0304 18:02:17.157376   98548 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:17.157604   98548 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:02:17.157941   98548 out.go:298] Setting JSON to false
	I0304 18:02:17.157976   98548 mustload.go:65] Loading cluster: embed-certs-917000
	I0304 18:02:17.158263   98548 config.go:182] Loaded profile config "embed-certs-917000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:02:17.158622   98548 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:17.158672   98548 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:17.166441   98548 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65462
	I0304 18:02:17.166880   98548 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:17.167317   98548 main.go:141] libmachine: Using API Version  1
	I0304 18:02:17.167349   98548 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:17.167616   98548 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:17.167735   98548 main.go:141] libmachine: (embed-certs-917000) Calling .GetState
	I0304 18:02:17.167824   98548 main.go:141] libmachine: (embed-certs-917000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:17.167838   98548 main.go:141] libmachine: (embed-certs-917000) DBG | hyperkit pid from json: 0
	I0304 18:02:17.167881   98548 main.go:141] libmachine: (embed-certs-917000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/embed-certs-917000/hyperkit.json: no such file or directory
	I0304 18:02:17.188142   98548 out.go:177] * The control-plane node embed-certs-917000 host is not running: state=Stopped
	I0304 18:02:17.230692   98548 out.go:177]   To start a cluster, run: "minikube start -p embed-certs-917000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p embed-certs-917000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000: exit status 7 (72.48412ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-917000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000: exit status 7 (72.776291ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-917000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/Pause (0.32s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (11.93s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p newest-cni-489000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p newest-cni-489000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (11.849058526s)

                                                
                                                
-- stdout --
	* [newest-cni-489000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "newest-cni-489000" primary control-plane node in "newest-cni-489000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "newest-cni-489000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:02:18.160829   98586 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:02:18.161079   98586 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:18.161084   98586 out.go:304] Setting ErrFile to fd 2...
	I0304 18:02:18.161089   98586 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:18.161284   98586 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:02:18.162878   98586 out.go:298] Setting JSON to false
	I0304 18:02:18.185302   98586 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25307,"bootTime":1709578831,"procs":511,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:02:18.185393   98586 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:02:18.207971   98586 out.go:177] * [newest-cni-489000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:02:18.248773   98586 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:02:18.248926   98586 notify.go:220] Checking for updates...
	I0304 18:02:18.291670   98586 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:02:18.333758   98586 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:02:18.355036   98586 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:02:18.375970   98586 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:02:18.397115   98586 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:02:18.418695   98586 config.go:182] Loaded profile config "default-k8s-diff-port-051000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:02:18.418813   98586 config.go:182] Loaded profile config "multinode-664000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:02:18.418939   98586 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:02:18.447652   98586 out.go:177] * Using the hyperkit driver based on user configuration
	I0304 18:02:18.468989   98586 start.go:297] selected driver: hyperkit
	I0304 18:02:18.469022   98586 start.go:901] validating driver "hyperkit" against <nil>
	I0304 18:02:18.469044   98586 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:02:18.473059   98586 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:02:18.473159   98586 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:02:18.481042   98586 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:02:18.484948   98586 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:18.484979   98586 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:02:18.485013   98586 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	W0304 18:02:18.485042   98586 out.go:239] ! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	I0304 18:02:18.485238   98586 start_flags.go:966] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I0304 18:02:18.485303   98586 cni.go:84] Creating CNI manager for ""
	I0304 18:02:18.485323   98586 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 18:02:18.485330   98586 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0304 18:02:18.485388   98586 start.go:340] cluster config:
	{Name:newest-cni-489000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-489000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetr
ics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:02:18.485473   98586 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:02:18.548057   98586 out.go:177] * Starting "newest-cni-489000" primary control-plane node in "newest-cni-489000" cluster
	I0304 18:02:18.569223   98586 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0304 18:02:18.569316   98586 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0304 18:02:18.569348   98586 cache.go:56] Caching tarball of preloaded images
	I0304 18:02:18.569581   98586 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:02:18.569604   98586 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0304 18:02:18.569771   98586 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/newest-cni-489000/config.json ...
	I0304 18:02:18.569813   98586 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/newest-cni-489000/config.json: {Name:mk855d730c8ddce2fcb4985ca286ad4e28ea02bc Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 18:02:18.570581   98586 start.go:360] acquireMachinesLock for newest-cni-489000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:02:18.570710   98586 start.go:364] duration metric: took 103.519µs to acquireMachinesLock for "newest-cni-489000"
	I0304 18:02:18.570757   98586 start.go:93] Provisioning new machine with config: &{Name:newest-cni-489000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-489000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube
-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:02:18.570871   98586 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:02:18.613001   98586 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 18:02:18.613297   98586 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:18.613365   98586 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:18.622985   98586 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65478
	I0304 18:02:18.623397   98586 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:18.623826   98586 main.go:141] libmachine: Using API Version  1
	I0304 18:02:18.623842   98586 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:18.624077   98586 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:18.624185   98586 main.go:141] libmachine: (newest-cni-489000) Calling .GetMachineName
	I0304 18:02:18.624268   98586 main.go:141] libmachine: (newest-cni-489000) Calling .DriverName
	I0304 18:02:18.624365   98586 start.go:159] libmachine.API.Create for "newest-cni-489000" (driver="hyperkit")
	I0304 18:02:18.624389   98586 client.go:168] LocalClient.Create starting
	I0304 18:02:18.624422   98586 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:02:18.624469   98586 main.go:141] libmachine: Decoding PEM data...
	I0304 18:02:18.624484   98586 main.go:141] libmachine: Parsing certificate...
	I0304 18:02:18.624545   98586 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:02:18.624580   98586 main.go:141] libmachine: Decoding PEM data...
	I0304 18:02:18.624596   98586 main.go:141] libmachine: Parsing certificate...
	I0304 18:02:18.624609   98586 main.go:141] libmachine: Running pre-create checks...
	I0304 18:02:18.624619   98586 main.go:141] libmachine: (newest-cni-489000) Calling .PreCreateCheck
	I0304 18:02:18.624705   98586 main.go:141] libmachine: (newest-cni-489000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:18.624891   98586 main.go:141] libmachine: (newest-cni-489000) Calling .GetConfigRaw
	I0304 18:02:18.625357   98586 main.go:141] libmachine: Creating machine...
	I0304 18:02:18.625365   98586 main.go:141] libmachine: (newest-cni-489000) Calling .Create
	I0304 18:02:18.625439   98586 main.go:141] libmachine: (newest-cni-489000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:18.625555   98586 main.go:141] libmachine: (newest-cni-489000) DBG | I0304 18:02:18.625426   98596 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:02:18.625607   98586 main.go:141] libmachine: (newest-cni-489000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:02:18.802016   98586 main.go:141] libmachine: (newest-cni-489000) DBG | I0304 18:02:18.801956   98596 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000/id_rsa...
	I0304 18:02:19.036043   98586 main.go:141] libmachine: (newest-cni-489000) DBG | I0304 18:02:19.035945   98596 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000/newest-cni-489000.rawdisk...
	I0304 18:02:19.036065   98586 main.go:141] libmachine: (newest-cni-489000) DBG | Writing magic tar header
	I0304 18:02:19.036075   98586 main.go:141] libmachine: (newest-cni-489000) DBG | Writing SSH key tar header
	I0304 18:02:19.036661   98586 main.go:141] libmachine: (newest-cni-489000) DBG | I0304 18:02:19.036615   98596 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000 ...
	I0304 18:02:19.488202   98586 main.go:141] libmachine: (newest-cni-489000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:19.488223   98586 main.go:141] libmachine: (newest-cni-489000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000/hyperkit.pid
	I0304 18:02:19.488234   98586 main.go:141] libmachine: (newest-cni-489000) DBG | Using UUID 462a3c27-e7c7-4aae-9d09-1c103192b0a7
	I0304 18:02:19.562310   98586 main.go:141] libmachine: (newest-cni-489000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:02:19.562406   98586 client.go:171] duration metric: took 937.396082ms to LocalClient.Create
	I0304 18:02:21.565095   98586 start.go:128] duration metric: took 2.992364381s to createHost
	I0304 18:02:21.565151   98586 start.go:83] releasing machines lock for "newest-cni-489000", held for 2.992595773s
	W0304 18:02:21.565184   98586 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0304 18:02:21.565761   98586 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:21.565812   98586 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:21.575725   98586 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65495
	I0304 18:02:21.576126   98586 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:21.576465   98586 main.go:141] libmachine: Using API Version  1
	I0304 18:02:21.576474   98586 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:21.576689   98586 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:21.577029   98586 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:21.577053   98586 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:21.585018   98586 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65499
	I0304 18:02:21.585370   98586 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:21.585708   98586 main.go:141] libmachine: Using API Version  1
	I0304 18:02:21.585720   98586 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:21.585940   98586 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:21.586043   98586 main.go:141] libmachine: (newest-cni-489000) Calling .GetState
	I0304 18:02:21.586122   98586 main.go:141] libmachine: (newest-cni-489000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:21.586140   98586 main.go:141] libmachine: (newest-cni-489000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000/hyperkit.json: no such file or directory
	I0304 18:02:21.586155   98586 main.go:141] libmachine: (newest-cni-489000) DBG | hyperkit pid from json: 0
	I0304 18:02:21.586210   98586 main.go:141] libmachine: (newest-cni-489000) Calling .DriverName
	I0304 18:02:21.640500   98586 out.go:177] * Deleting "newest-cni-489000" in hyperkit ...
	I0304 18:02:21.682689   98586 main.go:141] libmachine: (newest-cni-489000) Calling .Remove
	I0304 18:02:21.682991   98586 main.go:141] libmachine: (newest-cni-489000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:21.683015   98586 main.go:141] libmachine: (newest-cni-489000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:21.683049   98586 main.go:141] libmachine: (newest-cni-489000) DBG | hyperkit pid from json: 0
	I0304 18:02:21.683070   98586 main.go:141] libmachine: (newest-cni-489000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000/hyperkit.json: no such file or directory
	W0304 18:02:21.756365   98586 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:02:21.756381   98586 start.go:728] Will try again in 5 seconds ...
	I0304 18:02:26.759168   98586 start.go:360] acquireMachinesLock for newest-cni-489000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:02:26.843070   98586 start.go:364] duration metric: took 83.842768ms to acquireMachinesLock for "newest-cni-489000"
	I0304 18:02:26.843110   98586 start.go:93] Provisioning new machine with config: &{Name:newest-cni-489000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-489000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube
-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0304 18:02:26.843179   98586 start.go:125] createHost starting for "" (driver="hyperkit")
	I0304 18:02:26.928777   98586 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0304 18:02:26.928956   98586 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:26.929008   98586 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:26.938622   98586 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65503
	I0304 18:02:26.938979   98586 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:26.939344   98586 main.go:141] libmachine: Using API Version  1
	I0304 18:02:26.939360   98586 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:26.939592   98586 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:26.939690   98586 main.go:141] libmachine: (newest-cni-489000) Calling .GetMachineName
	I0304 18:02:26.939793   98586 main.go:141] libmachine: (newest-cni-489000) Calling .DriverName
	I0304 18:02:26.939904   98586 start.go:159] libmachine.API.Create for "newest-cni-489000" (driver="hyperkit")
	I0304 18:02:26.939921   98586 client.go:168] LocalClient.Create starting
	I0304 18:02:26.939949   98586 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/ca.pem
	I0304 18:02:26.939997   98586 main.go:141] libmachine: Decoding PEM data...
	I0304 18:02:26.940006   98586 main.go:141] libmachine: Parsing certificate...
	I0304 18:02:26.940042   98586 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/17909-92921/.minikube/certs/cert.pem
	I0304 18:02:26.940083   98586 main.go:141] libmachine: Decoding PEM data...
	I0304 18:02:26.940095   98586 main.go:141] libmachine: Parsing certificate...
	I0304 18:02:26.940112   98586 main.go:141] libmachine: Running pre-create checks...
	I0304 18:02:26.940117   98586 main.go:141] libmachine: (newest-cni-489000) Calling .PreCreateCheck
	I0304 18:02:26.940193   98586 main.go:141] libmachine: (newest-cni-489000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:26.940209   98586 main.go:141] libmachine: (newest-cni-489000) Calling .GetConfigRaw
	I0304 18:02:26.949943   98586 main.go:141] libmachine: Creating machine...
	I0304 18:02:26.949955   98586 main.go:141] libmachine: (newest-cni-489000) Calling .Create
	I0304 18:02:26.950169   98586 main.go:141] libmachine: (newest-cni-489000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:26.950347   98586 main.go:141] libmachine: (newest-cni-489000) DBG | I0304 18:02:26.950105   98628 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:02:26.950427   98586 main.go:141] libmachine: (newest-cni-489000) Downloading /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0304 18:02:27.237324   98586 main.go:141] libmachine: (newest-cni-489000) DBG | I0304 18:02:27.237263   98628 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000/id_rsa...
	I0304 18:02:27.334493   98586 main.go:141] libmachine: (newest-cni-489000) DBG | I0304 18:02:27.334437   98628 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000/newest-cni-489000.rawdisk...
	I0304 18:02:27.334519   98586 main.go:141] libmachine: (newest-cni-489000) DBG | Writing magic tar header
	I0304 18:02:27.334533   98586 main.go:141] libmachine: (newest-cni-489000) DBG | Writing SSH key tar header
	I0304 18:02:27.334901   98586 main.go:141] libmachine: (newest-cni-489000) DBG | I0304 18:02:27.334868   98628 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000 ...
	I0304 18:02:27.745683   98586 main.go:141] libmachine: (newest-cni-489000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:27.745702   98586 main.go:141] libmachine: (newest-cni-489000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000/hyperkit.pid
	I0304 18:02:27.745768   98586 main.go:141] libmachine: (newest-cni-489000) DBG | Using UUID fcab7e6b-82df-4977-bf52-eec32969c448
	I0304 18:02:27.783355   98586 main.go:141] libmachine: (newest-cni-489000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:02:27.783442   98586 client.go:171] duration metric: took 843.190529ms to LocalClient.Create
	I0304 18:02:29.786318   98586 start.go:128] duration metric: took 2.942062218s to createHost
	I0304 18:02:29.786341   98586 start.go:83] releasing machines lock for "newest-cni-489000", held for 2.942191375s
	W0304 18:02:29.786461   98586 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p newest-cni-489000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p newest-cni-489000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:02:29.808005   98586 out.go:177] 
	W0304 18:02:29.828863   98586 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:02:29.828926   98586 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:02:29.828965   98586 out.go:239] * Related issues:
	* Related issues:
	W0304 18:02:29.829004   98586 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:02:29.829032   98586 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:02:29.892887   98586 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p newest-cni-489000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-489000 -n newest-cni-489000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-489000 -n newest-cni-489000: exit status 7 (76.506463ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-489000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/FirstStart (11.93s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (7.6s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p default-k8s-diff-port-051000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4
E0304 18:02:26.259538   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p default-k8s-diff-port-051000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (7.526213345s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-051000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "default-k8s-diff-port-051000" primary control-plane node in "default-k8s-diff-port-051000" cluster
	* Restarting existing hyperkit VM for "default-k8s-diff-port-051000" ...
	* Restarting existing hyperkit VM for "default-k8s-diff-port-051000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:02:19.589558   98608 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:02:19.589731   98608 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:19.589736   98608 out.go:304] Setting ErrFile to fd 2...
	I0304 18:02:19.589739   98608 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:19.589909   98608 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:02:19.591324   98608 out.go:298] Setting JSON to false
	I0304 18:02:19.613920   98608 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25308,"bootTime":1709578831,"procs":511,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:02:19.614009   98608 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:02:19.635033   98608 out.go:177] * [default-k8s-diff-port-051000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:02:19.676986   98608 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:02:19.677032   98608 notify.go:220] Checking for updates...
	I0304 18:02:19.719774   98608 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:02:19.740872   98608 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:02:19.761918   98608 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:02:19.782652   98608 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:02:19.804036   98608 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:02:19.825666   98608 config.go:182] Loaded profile config "default-k8s-diff-port-051000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:02:19.826347   98608 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:19.826444   98608 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:19.835480   98608 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65491
	I0304 18:02:19.835922   98608 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:19.836365   98608 main.go:141] libmachine: Using API Version  1
	I0304 18:02:19.836378   98608 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:19.836632   98608 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:19.836734   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .DriverName
	I0304 18:02:19.836948   98608 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:02:19.837223   98608 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:19.837259   98608 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:19.845072   98608 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65493
	I0304 18:02:19.845447   98608 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:19.845813   98608 main.go:141] libmachine: Using API Version  1
	I0304 18:02:19.845827   98608 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:19.846028   98608 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:19.846131   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .DriverName
	I0304 18:02:19.874952   98608 out.go:177] * Using the hyperkit driver based on existing profile
	I0304 18:02:19.917103   98608 start.go:297] selected driver: hyperkit
	I0304 18:02:19.917129   98608 start.go:901] validating driver "hyperkit" against &{Name:default-k8s-diff-port-051000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-051000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false E
xtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:02:19.917359   98608 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:02:19.921396   98608 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:02:19.921485   98608 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:02:19.929430   98608 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:02:19.933403   98608 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:19.933433   98608 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:02:19.933578   98608 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0304 18:02:19.933643   98608 cni.go:84] Creating CNI manager for ""
	I0304 18:02:19.933658   98608 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 18:02:19.933700   98608 start.go:340] cluster config:
	{Name:default-k8s-diff-port-051000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-051000 N
amespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-hos
t Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:02:19.933805   98608 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:02:19.976053   98608 out.go:177] * Starting "default-k8s-diff-port-051000" primary control-plane node in "default-k8s-diff-port-051000" cluster
	I0304 18:02:19.996934   98608 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 18:02:19.997029   98608 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 18:02:19.997059   98608 cache.go:56] Caching tarball of preloaded images
	I0304 18:02:19.997242   98608 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:02:19.997262   98608 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 18:02:19.997399   98608 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/default-k8s-diff-port-051000/config.json ...
	I0304 18:02:19.998446   98608 start.go:360] acquireMachinesLock for default-k8s-diff-port-051000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:02:21.565263   98608 start.go:364] duration metric: took 1.565868422s to acquireMachinesLock for "default-k8s-diff-port-051000"
	I0304 18:02:21.565358   98608 start.go:96] Skipping create...Using existing machine configuration
	I0304 18:02:21.565378   98608 fix.go:54] fixHost starting: 
	I0304 18:02:21.565849   98608 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:21.565893   98608 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:21.575710   98608 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65496
	I0304 18:02:21.576137   98608 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:21.576497   98608 main.go:141] libmachine: Using API Version  1
	I0304 18:02:21.576514   98608 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:21.576752   98608 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:21.576868   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .DriverName
	I0304 18:02:21.576967   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .GetState
	I0304 18:02:21.577074   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:21.577083   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | hyperkit pid from json: 0
	I0304 18:02:21.577121   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000/hyperkit.json: no such file or directory
	I0304 18:02:21.577151   98608 fix.go:112] recreateIfNeeded on default-k8s-diff-port-051000: state=Stopped err=<nil>
	I0304 18:02:21.577177   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .DriverName
	W0304 18:02:21.577267   98608 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 18:02:21.598656   98608 out.go:177] * Restarting existing hyperkit VM for "default-k8s-diff-port-051000" ...
	I0304 18:02:21.661491   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .Start
	I0304 18:02:21.661777   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:21.661805   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000/hyperkit.pid
	I0304 18:02:21.661918   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | Using UUID 495540ca-cf04-489b-8905-c9de8bd17565
	I0304 18:02:21.664208   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:02:21.664323   98608 fix.go:56] duration metric: took 98.896039ms for fixHost
	I0304 18:02:21.664334   98608 start.go:83] releasing machines lock for "default-k8s-diff-port-051000", held for 98.993697ms
	W0304 18:02:21.664350   98608 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0304 18:02:21.664403   98608 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:02:21.664410   98608 start.go:728] Will try again in 5 seconds ...
	I0304 18:02:26.667965   98608 start.go:360] acquireMachinesLock for default-k8s-diff-port-051000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:02:26.668210   98608 start.go:364] duration metric: took 174.89µs to acquireMachinesLock for "default-k8s-diff-port-051000"
	I0304 18:02:26.668243   98608 start.go:96] Skipping create...Using existing machine configuration
	I0304 18:02:26.668251   98608 fix.go:54] fixHost starting: 
	I0304 18:02:26.668633   98608 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:26.668664   98608 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:26.677582   98608 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65501
	I0304 18:02:26.677944   98608 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:26.678324   98608 main.go:141] libmachine: Using API Version  1
	I0304 18:02:26.678342   98608 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:26.678554   98608 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:26.678661   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .DriverName
	I0304 18:02:26.678754   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .GetState
	I0304 18:02:26.678855   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:26.678874   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000/hyperkit.json: no such file or directory
	I0304 18:02:26.678879   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | hyperkit pid from json: 0
	I0304 18:02:26.678944   98608 fix.go:112] recreateIfNeeded on default-k8s-diff-port-051000: state=Stopped err=<nil>
	I0304 18:02:26.678964   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .DriverName
	W0304 18:02:26.679052   98608 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 18:02:26.739758   98608 out.go:177] * Restarting existing hyperkit VM for "default-k8s-diff-port-051000" ...
	I0304 18:02:26.782492   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .Start
	I0304 18:02:26.782687   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:26.782715   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000/hyperkit.pid
	I0304 18:02:26.782785   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | Using UUID 495540ca-cf04-489b-8905-c9de8bd17565
	I0304 18:02:26.842983   98608 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:02:26.843008   98608 fix.go:56] duration metric: took 174.688118ms for fixHost
	I0304 18:02:26.843017   98608 start.go:83] releasing machines lock for "default-k8s-diff-port-051000", held for 174.724846ms
	W0304 18:02:26.843089   98608 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-051000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-051000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:02:26.885736   98608 out.go:177] 
	W0304 18:02:26.949638   98608 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:02:26.949676   98608 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:02:26.949697   98608 out.go:239] * Related issues:
	* Related issues:
	W0304 18:02:26.949719   98608 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:02:26.949750   98608 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:02:26.991455   98608 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p default-k8s-diff-port-051000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000: exit status 7 (76.759098ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-051000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (7.60s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.08s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-051000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000: exit status 7 (75.715315ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-051000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.08s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.12s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-051000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-051000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-051000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (37.989912ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-051000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context default-k8s-diff-port-051000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000: exit status 7 (76.712589ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-051000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.12s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.19s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p default-k8s-diff-port-051000 image list --format=json
start_stop_delete_test.go:304: v1.28.4 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.4",
- 	"registry.k8s.io/kube-controller-manager:v1.28.4",
- 	"registry.k8s.io/kube-proxy:v1.28.4",
- 	"registry.k8s.io/kube-scheduler:v1.28.4",
- 	"registry.k8s.io/pause:3.9",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000: exit status 7 (75.591444ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-051000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.19s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (0.3s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p default-k8s-diff-port-051000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p default-k8s-diff-port-051000 --alsologtostderr -v=1: exit status 83 (146.847478ms)

                                                
                                                
-- stdout --
	* The control-plane node default-k8s-diff-port-051000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p default-k8s-diff-port-051000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:02:27.582314   98645 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:02:27.582506   98645 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:27.582512   98645 out.go:304] Setting ErrFile to fd 2...
	I0304 18:02:27.582521   98645 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:27.582708   98645 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:02:27.583031   98645 out.go:298] Setting JSON to false
	I0304 18:02:27.583046   98645 mustload.go:65] Loading cluster: default-k8s-diff-port-051000
	I0304 18:02:27.583316   98645 config.go:182] Loaded profile config "default-k8s-diff-port-051000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 18:02:27.583697   98645 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:27.583752   98645 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:27.591668   98645 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:65519
	I0304 18:02:27.592090   98645 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:27.592522   98645 main.go:141] libmachine: Using API Version  1
	I0304 18:02:27.592531   98645 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:27.592723   98645 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:27.592828   98645 main.go:141] libmachine: (default-k8s-diff-port-051000) Calling .GetState
	I0304 18:02:27.592916   98645 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:27.592971   98645 main.go:141] libmachine: (default-k8s-diff-port-051000) DBG | hyperkit pid from json: 0
	I0304 18:02:27.593003   98645 main.go:141] libmachine: (default-k8s-diff-port-051000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/default-k8s-diff-port-051000/hyperkit.json: no such file or directory
	I0304 18:02:27.614394   98645 out.go:177] * The control-plane node default-k8s-diff-port-051000 host is not running: state=Stopped
	I0304 18:02:27.652846   98645 out.go:177]   To start a cluster, run: "minikube start -p default-k8s-diff-port-051000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p default-k8s-diff-port-051000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000: exit status 7 (78.108659ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-051000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000: exit status 7 (78.029307ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-051000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/Pause (0.30s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (5.89s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p newest-cni-489000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p newest-cni-489000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (5.809479357s)

                                                
                                                
-- stdout --
	* [newest-cni-489000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "newest-cni-489000" primary control-plane node in "newest-cni-489000" cluster
	* Restarting existing hyperkit VM for "newest-cni-489000" ...
	* Restarting existing hyperkit VM for "newest-cni-489000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:02:34.141032   98712 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:02:34.141216   98712 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:34.141222   98712 out.go:304] Setting ErrFile to fd 2...
	I0304 18:02:34.141225   98712 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:34.141396   98712 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:02:34.142838   98712 out.go:298] Setting JSON to false
	I0304 18:02:34.165414   98712 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":25323,"bootTime":1709578831,"procs":503,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 18:02:34.165511   98712 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 18:02:34.187156   98712 out.go:177] * [newest-cni-489000] minikube v1.32.0 on Darwin 14.3.1
	I0304 18:02:34.228986   98712 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 18:02:34.229048   98712 notify.go:220] Checking for updates...
	I0304 18:02:34.271856   98712 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 18:02:34.292737   98712 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 18:02:34.313659   98712 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 18:02:34.334691   98712 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 18:02:34.355797   98712 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 18:02:34.377381   98712 config.go:182] Loaded profile config "newest-cni-489000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0304 18:02:34.378095   98712 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:34.378157   98712 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:34.386966   98712 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49177
	I0304 18:02:34.387326   98712 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:34.387762   98712 main.go:141] libmachine: Using API Version  1
	I0304 18:02:34.387771   98712 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:34.388001   98712 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:34.388120   98712 main.go:141] libmachine: (newest-cni-489000) Calling .DriverName
	I0304 18:02:34.388322   98712 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 18:02:34.388559   98712 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:34.388592   98712 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:34.396517   98712 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49179
	I0304 18:02:34.396847   98712 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:34.397202   98712 main.go:141] libmachine: Using API Version  1
	I0304 18:02:34.397221   98712 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:34.397440   98712 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:34.397554   98712 main.go:141] libmachine: (newest-cni-489000) Calling .DriverName
	I0304 18:02:34.425973   98712 out.go:177] * Using the hyperkit driver based on existing profile
	I0304 18:02:34.467644   98712 start.go:297] selected driver: hyperkit
	I0304 18:02:34.467661   98712 start.go:901] validating driver "hyperkit" against &{Name:newest-cni-489000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-489000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> Exp
osedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:02:34.467785   98712 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 18:02:34.470756   98712 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:02:34.470859   98712 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 18:02:34.478697   98712 install.go:137] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0304 18:02:34.482719   98712 install.go:79] stdout: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:34.482754   98712 install.go:81] /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0304 18:02:34.482914   98712 start_flags.go:966] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I0304 18:02:34.482980   98712 cni.go:84] Creating CNI manager for ""
	I0304 18:02:34.482995   98712 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 18:02:34.483035   98712 start.go:340] cluster config:
	{Name:newest-cni-489000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-489000 Namespace:default
APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0
CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 18:02:34.483135   98712 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 18:02:34.524818   98712 out.go:177] * Starting "newest-cni-489000" primary control-plane node in "newest-cni-489000" cluster
	I0304 18:02:34.545870   98712 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0304 18:02:34.545964   98712 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0304 18:02:34.545991   98712 cache.go:56] Caching tarball of preloaded images
	I0304 18:02:34.546180   98712 preload.go:173] Found /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0304 18:02:34.546198   98712 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0304 18:02:34.546351   98712 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/newest-cni-489000/config.json ...
	I0304 18:02:34.547212   98712 start.go:360] acquireMachinesLock for newest-cni-489000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:02:34.547324   98712 start.go:364] duration metric: took 88.405µs to acquireMachinesLock for "newest-cni-489000"
	I0304 18:02:34.547359   98712 start.go:96] Skipping create...Using existing machine configuration
	I0304 18:02:34.547375   98712 fix.go:54] fixHost starting: 
	I0304 18:02:34.547791   98712 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:34.547839   98712 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:34.556406   98712 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49181
	I0304 18:02:34.556784   98712 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:34.557144   98712 main.go:141] libmachine: Using API Version  1
	I0304 18:02:34.557164   98712 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:34.557397   98712 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:34.557515   98712 main.go:141] libmachine: (newest-cni-489000) Calling .DriverName
	I0304 18:02:34.557611   98712 main.go:141] libmachine: (newest-cni-489000) Calling .GetState
	I0304 18:02:34.557692   98712 main.go:141] libmachine: (newest-cni-489000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:34.557703   98712 main.go:141] libmachine: (newest-cni-489000) DBG | hyperkit pid from json: 0
	I0304 18:02:34.557717   98712 main.go:141] libmachine: (newest-cni-489000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000/hyperkit.json: no such file or directory
	I0304 18:02:34.557763   98712 fix.go:112] recreateIfNeeded on newest-cni-489000: state=Stopped err=<nil>
	I0304 18:02:34.557788   98712 main.go:141] libmachine: (newest-cni-489000) Calling .DriverName
	W0304 18:02:34.557872   98712 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 18:02:34.599946   98712 out.go:177] * Restarting existing hyperkit VM for "newest-cni-489000" ...
	I0304 18:02:34.620860   98712 main.go:141] libmachine: (newest-cni-489000) Calling .Start
	I0304 18:02:34.621273   98712 main.go:141] libmachine: (newest-cni-489000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:34.621305   98712 main.go:141] libmachine: (newest-cni-489000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000/hyperkit.pid
	I0304 18:02:34.621406   98712 main.go:141] libmachine: (newest-cni-489000) DBG | Using UUID fcab7e6b-82df-4977-bf52-eec32969c448
	I0304 18:02:34.623750   98712 main.go:141] libmachine: (newest-cni-489000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:02:34.623920   98712 fix.go:56] duration metric: took 76.526144ms for fixHost
	I0304 18:02:34.623935   98712 start.go:83] releasing machines lock for "newest-cni-489000", held for 76.580078ms
	W0304 18:02:34.623960   98712 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0304 18:02:34.624056   98712 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:02:34.624069   98712 start.go:728] Will try again in 5 seconds ...
	I0304 18:02:39.625830   98712 start.go:360] acquireMachinesLock for newest-cni-489000: {Name:mk89ef44c6c8df94327b652e0646464e655f4176 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0304 18:02:39.625973   98712 start.go:364] duration metric: took 115.955µs to acquireMachinesLock for "newest-cni-489000"
	I0304 18:02:39.626009   98712 start.go:96] Skipping create...Using existing machine configuration
	I0304 18:02:39.626030   98712 fix.go:54] fixHost starting: 
	I0304 18:02:39.626356   98712 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:39.626383   98712 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:39.635140   98712 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49183
	I0304 18:02:39.635582   98712 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:39.635961   98712 main.go:141] libmachine: Using API Version  1
	I0304 18:02:39.635972   98712 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:39.636182   98712 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:39.636291   98712 main.go:141] libmachine: (newest-cni-489000) Calling .DriverName
	I0304 18:02:39.636382   98712 main.go:141] libmachine: (newest-cni-489000) Calling .GetState
	I0304 18:02:39.636478   98712 main.go:141] libmachine: (newest-cni-489000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:39.636491   98712 main.go:141] libmachine: (newest-cni-489000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000/hyperkit.json: no such file or directory
	I0304 18:02:39.636496   98712 main.go:141] libmachine: (newest-cni-489000) DBG | hyperkit pid from json: 0
	I0304 18:02:39.636530   98712 fix.go:112] recreateIfNeeded on newest-cni-489000: state=Stopped err=<nil>
	I0304 18:02:39.636550   98712 main.go:141] libmachine: (newest-cni-489000) Calling .DriverName
	W0304 18:02:39.636627   98712 fix.go:138] unexpected machine state, will restart: <nil>
	I0304 18:02:39.658389   98712 out.go:177] * Restarting existing hyperkit VM for "newest-cni-489000" ...
	I0304 18:02:39.680103   98712 main.go:141] libmachine: (newest-cni-489000) Calling .Start
	I0304 18:02:39.680389   98712 main.go:141] libmachine: (newest-cni-489000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:39.680460   98712 main.go:141] libmachine: (newest-cni-489000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000/hyperkit.pid
	I0304 18:02:39.680507   98712 main.go:141] libmachine: (newest-cni-489000) DBG | Using UUID fcab7e6b-82df-4977-bf52-eec32969c448
	I0304 18:02:39.720502   98712 main.go:141] libmachine: (newest-cni-489000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0304 18:02:39.720600   98712 fix.go:56] duration metric: took 94.55244ms for fixHost
	I0304 18:02:39.720609   98712 start.go:83] releasing machines lock for "newest-cni-489000", held for 94.607262ms
	W0304 18:02:39.720669   98712 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p newest-cni-489000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p newest-cni-489000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0304 18:02:39.763048   98712 out.go:177] 
	W0304 18:02:39.784260   98712 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0304 18:02:39.784319   98712 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0304 18:02:39.784333   98712 out.go:239] * Related issues:
	* Related issues:
	W0304 18:02:39.784495   98712 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0304 18:02:39.784563   98712 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0304 18:02:39.827188   98712 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p newest-cni-489000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-489000 -n newest-cni-489000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-489000 -n newest-cni-489000: exit status 7 (76.786273ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-489000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/SecondStart (5.89s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p newest-cni-489000 image list --format=json
start_stop_delete_test.go:304: v1.29.0-rc.2 images missing (-want +got):
  []string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.1",
- 	"registry.k8s.io/etcd:3.5.10-0",
- 	"registry.k8s.io/kube-apiserver:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-controller-manager:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-proxy:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-scheduler:v1.29.0-rc.2",
- 	"registry.k8s.io/pause:3.9",
  }
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-489000 -n newest-cni-489000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-489000 -n newest-cni-489000: exit status 7 (74.645987ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-489000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p newest-cni-489000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p newest-cni-489000 --alsologtostderr -v=1: exit status 83 (140.520709ms)

                                                
                                                
-- stdout --
	* The control-plane node newest-cni-489000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p newest-cni-489000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 18:02:40.213160   98735 out.go:291] Setting OutFile to fd 1 ...
	I0304 18:02:40.213815   98735 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:40.213828   98735 out.go:304] Setting ErrFile to fd 2...
	I0304 18:02:40.213834   98735 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 18:02:40.214297   98735 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 18:02:40.214848   98735 out.go:298] Setting JSON to false
	I0304 18:02:40.214865   98735 mustload.go:65] Loading cluster: newest-cni-489000
	I0304 18:02:40.215123   98735 config.go:182] Loaded profile config "newest-cni-489000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0304 18:02:40.215441   98735 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit
	I0304 18:02:40.215487   98735 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 18:02:40.223171   98735 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49193
	I0304 18:02:40.223601   98735 main.go:141] libmachine: () Calling .GetVersion
	I0304 18:02:40.224027   98735 main.go:141] libmachine: Using API Version  1
	I0304 18:02:40.224036   98735 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 18:02:40.224233   98735 main.go:141] libmachine: () Calling .GetMachineName
	I0304 18:02:40.224334   98735 main.go:141] libmachine: (newest-cni-489000) Calling .GetState
	I0304 18:02:40.224425   98735 main.go:141] libmachine: (newest-cni-489000) DBG | exe=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0304 18:02:40.224445   98735 main.go:141] libmachine: (newest-cni-489000) Error reading pid file: open /Users/jenkins/minikube-integration/17909-92921/.minikube/machines/newest-cni-489000/hyperkit.json: no such file or directory
	I0304 18:02:40.224453   98735 main.go:141] libmachine: (newest-cni-489000) DBG | hyperkit pid from json: 0
	I0304 18:02:40.246191   98735 out.go:177] * The control-plane node newest-cni-489000 host is not running: state=Stopped
	I0304 18:02:40.267229   98735 out.go:177]   To start a cluster, run: "minikube start -p newest-cni-489000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p newest-cni-489000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-489000 -n newest-cni-489000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-489000 -n newest-cni-489000: exit status 7 (75.234515ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-489000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-489000 -n newest-cni-489000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-489000 -n newest-cni-489000: exit status 7 (74.707482ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-489000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/Pause (0.29s)

                                                
                                    

Test pass (101/280)

Order passed test Duration
3 TestDownloadOnly/v1.20.0/json-events 20.31
4 TestDownloadOnly/v1.20.0/preload-exists 0
7 TestDownloadOnly/v1.20.0/kubectl 0
8 TestDownloadOnly/v1.20.0/LogsDuration 0.3
9 TestDownloadOnly/v1.20.0/DeleteAll 0.4
10 TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds 0.38
12 TestDownloadOnly/v1.28.4/json-events 44.58
13 TestDownloadOnly/v1.28.4/preload-exists 0
16 TestDownloadOnly/v1.28.4/kubectl 0
17 TestDownloadOnly/v1.28.4/LogsDuration 0.36
18 TestDownloadOnly/v1.28.4/DeleteAll 0.4
19 TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds 0.38
21 TestDownloadOnly/v1.29.0-rc.2/json-events 19.35
22 TestDownloadOnly/v1.29.0-rc.2/preload-exists 0
25 TestDownloadOnly/v1.29.0-rc.2/kubectl 0
26 TestDownloadOnly/v1.29.0-rc.2/LogsDuration 0.3
27 TestDownloadOnly/v1.29.0-rc.2/DeleteAll 0.4
28 TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds 0.38
30 TestBinaryMirror 1.03
34 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.16
35 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.22
36 TestAddons/Setup 254.97
38 TestAddons/parallel/Registry 14.53
39 TestAddons/parallel/Ingress 20.26
40 TestAddons/parallel/InspektorGadget 10.64
41 TestAddons/parallel/MetricsServer 5.47
42 TestAddons/parallel/HelmTiller 10.44
44 TestAddons/parallel/CSI 57.74
45 TestAddons/parallel/Headlamp 13.32
46 TestAddons/parallel/CloudSpanner 5.38
47 TestAddons/parallel/LocalPath 54.54
48 TestAddons/parallel/NvidiaDevicePlugin 5.34
49 TestAddons/parallel/Yakd 5
52 TestAddons/serial/GCPAuth/Namespaces 0.09
53 TestAddons/StoppedEnableDisable 5.94
61 TestHyperKitDriverInstallOrUpdate 11.87
65 TestErrorSpam/start 1.37
66 TestErrorSpam/status 0.23
67 TestErrorSpam/pause 0.42
68 TestErrorSpam/unpause 0.44
69 TestErrorSpam/stop 10.42
72 TestFunctional/serial/CopySyncFile 0
74 TestFunctional/serial/AuditLog 0
80 TestFunctional/serial/CacheCmd/cache/add_remote 1.77
81 TestFunctional/serial/CacheCmd/cache/add_local 1.31
82 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.09
83 TestFunctional/serial/CacheCmd/cache/list 0.09
86 TestFunctional/serial/CacheCmd/cache/delete 0.18
95 TestFunctional/parallel/ConfigCmd 0.64
97 TestFunctional/parallel/DryRun 1
98 TestFunctional/parallel/InternationalLanguage 0.49
104 TestFunctional/parallel/AddonsCmd 0.28
119 TestFunctional/parallel/License 0.76
120 TestFunctional/parallel/Version/short 0.11
127 TestFunctional/parallel/ImageCommands/Setup 2.42
141 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0.02
148 TestFunctional/parallel/ImageCommands/ImageRemove 0.2
150 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.21
151 TestFunctional/parallel/ProfileCmd/profile_not_create 0.26
152 TestFunctional/parallel/ProfileCmd/profile_list 0.24
153 TestFunctional/parallel/ProfileCmd/profile_json_output 0.23
158 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil 10.02
160 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.14
161 TestFunctional/delete_addon-resizer_images 0.13
162 TestFunctional/delete_my-image_image 0.05
163 TestFunctional/delete_minikube_cached_images 0.05
192 TestJSONOutput/start/Audit 0
198 TestJSONOutput/pause/Audit 0
200 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
201 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
204 TestJSONOutput/unpause/Audit 0
206 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
207 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
209 TestJSONOutput/stop/Command 3.57
210 TestJSONOutput/stop/Audit 0
212 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
213 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
214 TestErrorJSONOutput 0.82
219 TestMainNoArgs 0.09
264 TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current 2.6
265 TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current 6.06
266 TestStoppedBinaryUpgrade/Setup 1.3
279 TestNoKubernetes/serial/StartNoK8sWithVersion 0.43
283 TestNoKubernetes/serial/VerifyK8sNotRunning 0.14
284 TestNoKubernetes/serial/ProfileList 0.33
285 TestNoKubernetes/serial/Stop 2.76
287 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.14
301 TestStartStop/group/old-k8s-version/serial/Stop 3.67
304 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.39
311 TestStartStop/group/no-preload/serial/Stop 3.45
315 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.32
325 TestStartStop/group/embed-certs/serial/Stop 2.05
326 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.35
333 TestStartStop/group/default-k8s-diff-port/serial/Stop 2.15
337 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.35
343 TestStartStop/group/newest-cni/serial/DeployApp 0
344 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 0.22
345 TestStartStop/group/newest-cni/serial/Stop 3.49
346 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.33
348 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
349 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
x
+
TestDownloadOnly/v1.20.0/json-events (20.31s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-701000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=hyperkit 
aaa_download_only_test.go:81: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-701000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=hyperkit : (20.309363547s)
--- PASS: TestDownloadOnly/v1.20.0/json-events (20.31s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/preload-exists
--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/kubectl
--- PASS: TestDownloadOnly/v1.20.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/LogsDuration (0.3s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-701000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-701000: exit status 85 (297.404097ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-701000 | jenkins | v1.32.0 | 04 Mar 24 17:36 PST |          |
	|         | -p download-only-701000        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=hyperkit              |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/04 17:36:41
	Running on machine: MacOS-Agent-2
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0304 17:36:41.336280   93379 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:36:41.336465   93379 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:36:41.336470   93379 out.go:304] Setting ErrFile to fd 2...
	I0304 17:36:41.336473   93379 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:36:41.336643   93379 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	W0304 17:36:41.336776   93379 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/17909-92921/.minikube/config/config.json: open /Users/jenkins/minikube-integration/17909-92921/.minikube/config/config.json: no such file or directory
	I0304 17:36:41.338580   93379 out.go:298] Setting JSON to true
	I0304 17:36:41.362097   93379 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":23770,"bootTime":1709578831,"procs":499,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:36:41.362213   93379 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:36:41.383839   93379 out.go:97] [download-only-701000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:36:41.405475   93379 out.go:169] MINIKUBE_LOCATION=17909
	I0304 17:36:41.384031   93379 notify.go:220] Checking for updates...
	W0304 17:36:41.384055   93379 preload.go:294] Failed to list preload files: open /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball: no such file or directory
	I0304 17:36:41.426738   93379 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:36:41.448444   93379 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:36:41.471753   93379 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:36:41.493672   93379 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	W0304 17:36:41.535347   93379 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0304 17:36:41.535709   93379 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:36:41.567480   93379 out.go:97] Using the hyperkit driver based on user configuration
	I0304 17:36:41.567553   93379 start.go:297] selected driver: hyperkit
	I0304 17:36:41.567568   93379 start.go:901] validating driver "hyperkit" against <nil>
	I0304 17:36:41.567769   93379 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:36:41.568551   93379 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:36:41.711930   93379 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:36:41.715931   93379 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:36:41.715954   93379 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0304 17:36:41.715984   93379 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 17:36:41.719165   93379 start_flags.go:393] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB
	I0304 17:36:41.719326   93379 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0304 17:36:41.719385   93379 cni.go:84] Creating CNI manager for ""
	I0304 17:36:41.719402   93379 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0304 17:36:41.719470   93379 start.go:340] cluster config:
	{Name:download-only-701000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:6000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-701000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:36:41.719693   93379 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:36:41.740951   93379 out.go:97] Downloading VM boot image ...
	I0304 17:36:41.741029   93379 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso.sha256 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso
	I0304 17:36:46.925762   93379 out.go:97] Starting "download-only-701000" primary control-plane node in "download-only-701000" cluster
	I0304 17:36:46.925799   93379 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0304 17:36:46.988154   93379 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0304 17:36:46.988192   93379 cache.go:56] Caching tarball of preloaded images
	I0304 17:36:46.988510   93379 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0304 17:36:47.009172   93379 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I0304 17:36:47.009193   93379 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...
	I0304 17:36:47.095072   93379 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4?checksum=md5:9a82241e9b8b4ad2b5cca73108f2c7a3 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0304 17:36:54.329627   93379 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...
	I0304 17:36:54.329843   93379 preload.go:255] verifying checksum of /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...
	I0304 17:36:54.886776   93379 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0304 17:36:54.887030   93379 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/download-only-701000/config.json ...
	I0304 17:36:54.887056   93379 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/download-only-701000/config.json: {Name:mk92426cb9b0b7b33270e3e7c203a838ad61290d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 17:36:54.887357   93379 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0304 17:36:54.888523   93379 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/amd64/kubectl.sha256 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/darwin/amd64/v1.20.0/kubectl
	
	
	* The control-plane node download-only-701000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-701000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.30s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAll (0.4s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-amd64 delete --all
--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (0.40s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.38s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-701000
--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.38s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/json-events (44.58s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-041000 --force --alsologtostderr --kubernetes-version=v1.28.4 --container-runtime=docker --driver=hyperkit 
aaa_download_only_test.go:81: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-041000 --force --alsologtostderr --kubernetes-version=v1.28.4 --container-runtime=docker --driver=hyperkit : (44.574820815s)
--- PASS: TestDownloadOnly/v1.28.4/json-events (44.58s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/preload-exists
--- PASS: TestDownloadOnly/v1.28.4/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/kubectl
--- PASS: TestDownloadOnly/v1.28.4/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/LogsDuration (0.36s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-041000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-041000: exit status 85 (358.585091ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-701000 | jenkins | v1.32.0 | 04 Mar 24 17:36 PST |                     |
	|         | -p download-only-701000        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |                     |
	|         | --container-runtime=docker     |                      |         |         |                     |                     |
	|         | --driver=hyperkit              |                      |         |         |                     |                     |
	| delete  | --all                          | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:37 PST | 04 Mar 24 17:37 PST |
	| delete  | -p download-only-701000        | download-only-701000 | jenkins | v1.32.0 | 04 Mar 24 17:37 PST | 04 Mar 24 17:37 PST |
	| start   | -o=json --download-only        | download-only-041000 | jenkins | v1.32.0 | 04 Mar 24 17:37 PST |                     |
	|         | -p download-only-041000        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.28.4   |                      |         |         |                     |                     |
	|         | --container-runtime=docker     |                      |         |         |                     |                     |
	|         | --driver=hyperkit              |                      |         |         |                     |                     |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/04 17:37:02
	Running on machine: MacOS-Agent-2
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0304 17:37:02.720993   93423 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:37:02.721239   93423 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:37:02.721245   93423 out.go:304] Setting ErrFile to fd 2...
	I0304 17:37:02.721248   93423 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:37:02.721420   93423 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:37:02.722837   93423 out.go:298] Setting JSON to true
	I0304 17:37:02.745155   93423 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":23791,"bootTime":1709578831,"procs":492,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:37:02.745254   93423 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:37:02.768315   93423 out.go:97] [download-only-041000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:37:02.789864   93423 out.go:169] MINIKUBE_LOCATION=17909
	I0304 17:37:02.768531   93423 notify.go:220] Checking for updates...
	I0304 17:37:02.832883   93423 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:37:02.853941   93423 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:37:02.874792   93423 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:37:02.895915   93423 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	W0304 17:37:02.937582   93423 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0304 17:37:02.938101   93423 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:37:02.967822   93423 out.go:97] Using the hyperkit driver based on user configuration
	I0304 17:37:02.967893   93423 start.go:297] selected driver: hyperkit
	I0304 17:37:02.967909   93423 start.go:901] validating driver "hyperkit" against <nil>
	I0304 17:37:02.968109   93423 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:37:02.968369   93423 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:37:02.977705   93423 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:37:02.981621   93423 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:37:02.981654   93423 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0304 17:37:02.981686   93423 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 17:37:02.984408   93423 start_flags.go:393] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB
	I0304 17:37:02.984551   93423 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0304 17:37:02.984610   93423 cni.go:84] Creating CNI manager for ""
	I0304 17:37:02.984628   93423 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 17:37:02.984640   93423 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0304 17:37:02.984709   93423 start.go:340] cluster config:
	{Name:download-only-041000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:6000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:download-only-041000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:37:02.984796   93423 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:37:03.005644   93423 out.go:97] Starting "download-only-041000" primary control-plane node in "download-only-041000" cluster
	I0304 17:37:03.005678   93423 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:37:03.063269   93423 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.4/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:37:03.063326   93423 cache.go:56] Caching tarball of preloaded images
	I0304 17:37:03.063756   93423 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:37:03.085391   93423 out.go:97] Downloading Kubernetes v1.28.4 preload ...
	I0304 17:37:03.085418   93423 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 ...
	I0304 17:37:03.173228   93423 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.4/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4?checksum=md5:7ebdea7754e21f51b865dbfc36b53b7d -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0304 17:37:10.577384   93423 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 ...
	I0304 17:37:10.577583   93423 preload.go:255] verifying checksum of /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 ...
	I0304 17:37:11.163460   93423 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0304 17:37:11.163705   93423 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/download-only-041000/config.json ...
	I0304 17:37:11.163732   93423 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/download-only-041000/config.json: {Name:mkab61fa180bb42fadd0601fd7cef4ec1f1d1ba8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 17:37:11.164031   93423 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0304 17:37:11.164246   93423 download.go:107] Downloading: https://dl.k8s.io/release/v1.28.4/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/darwin/amd64/kubectl.sha256 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/darwin/amd64/v1.28.4/kubectl
	
	
	* The control-plane node download-only-041000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-041000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.4/LogsDuration (0.36s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/DeleteAll (0.4s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-amd64 delete --all
--- PASS: TestDownloadOnly/v1.28.4/DeleteAll (0.40s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds (0.38s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-041000
--- PASS: TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds (0.38s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/json-events (19.35s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-626000 --force --alsologtostderr --kubernetes-version=v1.29.0-rc.2 --container-runtime=docker --driver=hyperkit 
aaa_download_only_test.go:81: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-626000 --force --alsologtostderr --kubernetes-version=v1.29.0-rc.2 --container-runtime=docker --driver=hyperkit : (19.344916237s)
--- PASS: TestDownloadOnly/v1.29.0-rc.2/json-events (19.35s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/preload-exists
--- PASS: TestDownloadOnly/v1.29.0-rc.2/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/kubectl
--- PASS: TestDownloadOnly/v1.29.0-rc.2/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/LogsDuration (0.3s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-626000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-626000: exit status 85 (298.224179ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |               Args                |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only           | download-only-701000 | jenkins | v1.32.0 | 04 Mar 24 17:36 PST |                     |
	|         | -p download-only-701000           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0      |                      |         |         |                     |                     |
	|         | --container-runtime=docker        |                      |         |         |                     |                     |
	|         | --driver=hyperkit                 |                      |         |         |                     |                     |
	| delete  | --all                             | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:37 PST | 04 Mar 24 17:37 PST |
	| delete  | -p download-only-701000           | download-only-701000 | jenkins | v1.32.0 | 04 Mar 24 17:37 PST | 04 Mar 24 17:37 PST |
	| start   | -o=json --download-only           | download-only-041000 | jenkins | v1.32.0 | 04 Mar 24 17:37 PST |                     |
	|         | -p download-only-041000           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.28.4      |                      |         |         |                     |                     |
	|         | --container-runtime=docker        |                      |         |         |                     |                     |
	|         | --driver=hyperkit                 |                      |         |         |                     |                     |
	| delete  | --all                             | minikube             | jenkins | v1.32.0 | 04 Mar 24 17:37 PST | 04 Mar 24 17:37 PST |
	| delete  | -p download-only-041000           | download-only-041000 | jenkins | v1.32.0 | 04 Mar 24 17:37 PST | 04 Mar 24 17:37 PST |
	| start   | -o=json --download-only           | download-only-626000 | jenkins | v1.32.0 | 04 Mar 24 17:37 PST |                     |
	|         | -p download-only-626000           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.29.0-rc.2 |                      |         |         |                     |                     |
	|         | --container-runtime=docker        |                      |         |         |                     |                     |
	|         | --driver=hyperkit                 |                      |         |         |                     |                     |
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/04 17:37:48
	Running on machine: MacOS-Agent-2
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0304 17:37:48.431515   93474 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:37:48.431791   93474 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:37:48.431796   93474 out.go:304] Setting ErrFile to fd 2...
	I0304 17:37:48.431800   93474 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:37:48.431970   93474 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:37:48.434327   93474 out.go:298] Setting JSON to true
	I0304 17:37:48.456929   93474 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":23837,"bootTime":1709578831,"procs":476,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:37:48.457029   93474 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:37:48.478276   93474 out.go:97] [download-only-626000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:37:48.478510   93474 notify.go:220] Checking for updates...
	I0304 17:37:48.499392   93474 out.go:169] MINIKUBE_LOCATION=17909
	I0304 17:37:48.520340   93474 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:37:48.542078   93474 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:37:48.563547   93474 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:37:48.584475   93474 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	W0304 17:37:48.627171   93474 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0304 17:37:48.627641   93474 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:37:48.657185   93474 out.go:97] Using the hyperkit driver based on user configuration
	I0304 17:37:48.657251   93474 start.go:297] selected driver: hyperkit
	I0304 17:37:48.657266   93474 start.go:901] validating driver "hyperkit" against <nil>
	I0304 17:37:48.657531   93474 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:37:48.657774   93474 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/17909-92921/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0304 17:37:48.667074   93474 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0304 17:37:48.670989   93474 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:37:48.671012   93474 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0304 17:37:48.671039   93474 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0304 17:37:48.673793   93474 start_flags.go:393] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB
	I0304 17:37:48.673948   93474 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0304 17:37:48.674009   93474 cni.go:84] Creating CNI manager for ""
	I0304 17:37:48.674026   93474 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0304 17:37:48.674036   93474 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0304 17:37:48.674103   93474 start.go:340] cluster config:
	{Name:download-only-626000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:6000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:download-only-626000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l
ocal ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:37:48.674187   93474 iso.go:125] acquiring lock: {Name:mk2de6bf2085f86119cecf9236b4a377d1b548a4 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0304 17:37:48.695099   93474 out.go:97] Starting "download-only-626000" primary control-plane node in "download-only-626000" cluster
	I0304 17:37:48.695134   93474 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0304 17:37:48.746057   93474 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.29.0-rc.2/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0304 17:37:48.746139   93474 cache.go:56] Caching tarball of preloaded images
	I0304 17:37:48.746518   93474 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0304 17:37:48.768188   93474 out.go:97] Downloading Kubernetes v1.29.0-rc.2 preload ...
	I0304 17:37:48.768216   93474 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 ...
	I0304 17:37:48.847889   93474 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.29.0-rc.2/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4?checksum=md5:47acda482c3add5b56147c92b8d7f468 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0304 17:37:59.027655   93474 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 ...
	I0304 17:37:59.027850   93474 preload.go:255] verifying checksum of /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 ...
	I0304 17:37:59.539804   93474 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0304 17:37:59.540039   93474 profile.go:142] Saving config to /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/download-only-626000/config.json ...
	I0304 17:37:59.540062   93474 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/download-only-626000/config.json: {Name:mkdc07d5c7f4c7b574b09d46ad608f7e1c226f37 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0304 17:37:59.540372   93474 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0304 17:37:59.540580   93474 download.go:107] Downloading: https://dl.k8s.io/release/v1.29.0-rc.2/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.29.0-rc.2/bin/darwin/amd64/kubectl.sha256 -> /Users/jenkins/minikube-integration/17909-92921/.minikube/cache/darwin/amd64/v1.29.0-rc.2/kubectl
	
	
	* The control-plane node download-only-626000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-626000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.29.0-rc.2/LogsDuration (0.30s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/DeleteAll (0.4s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-amd64 delete --all
--- PASS: TestDownloadOnly/v1.29.0-rc.2/DeleteAll (0.40s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds (0.38s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-626000
--- PASS: TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds (0.38s)

                                                
                                    
x
+
TestBinaryMirror (1.03s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-darwin-amd64 start --download-only -p binary-mirror-221000 --alsologtostderr --binary-mirror http://127.0.0.1:62827 --driver=hyperkit 
helpers_test.go:175: Cleaning up "binary-mirror-221000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p binary-mirror-221000
--- PASS: TestBinaryMirror (1.03s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.16s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:928: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p addons-374000
addons_test.go:928: (dbg) Non-zero exit: out/minikube-darwin-amd64 addons enable dashboard -p addons-374000: exit status 85 (155.348858ms)

                                                
                                                
-- stdout --
	* Profile "addons-374000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-374000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.16s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.22s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:939: (dbg) Run:  out/minikube-darwin-amd64 addons disable dashboard -p addons-374000
addons_test.go:939: (dbg) Non-zero exit: out/minikube-darwin-amd64 addons disable dashboard -p addons-374000: exit status 85 (217.488708ms)

                                                
                                                
-- stdout --
	* Profile "addons-374000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-374000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.22s)

                                                
                                    
x
+
TestAddons/Setup (254.97s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:109: (dbg) Run:  out/minikube-darwin-amd64 start -p addons-374000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller
addons_test.go:109: (dbg) Done: out/minikube-darwin-amd64 start -p addons-374000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller: (4m14.972490075s)
--- PASS: TestAddons/Setup (254.97s)

                                                
                                    
x
+
TestAddons/parallel/Registry (14.53s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:330: registry stabilized in 13.629153ms
addons_test.go:332: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-scl8p" [14ee989c-446d-440b-9555-53ee8b3a46f9] Running
addons_test.go:332: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.005550478s
addons_test.go:335: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-k7zll" [394578b5-72de-4c14-925f-09ca0c43cdfa] Running
addons_test.go:335: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.004494232s
addons_test.go:340: (dbg) Run:  kubectl --context addons-374000 delete po -l run=registry-test --now
addons_test.go:345: (dbg) Run:  kubectl --context addons-374000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:345: (dbg) Done: kubectl --context addons-374000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (3.860241599s)
addons_test.go:359: (dbg) Run:  out/minikube-darwin-amd64 -p addons-374000 ip
2024/03/04 17:42:40 [DEBUG] GET http://192.169.0.49:5000
addons_test.go:388: (dbg) Run:  out/minikube-darwin-amd64 -p addons-374000 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (14.53s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (20.26s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:207: (dbg) Run:  kubectl --context addons-374000 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:232: (dbg) Run:  kubectl --context addons-374000 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:245: (dbg) Run:  kubectl --context addons-374000 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [570c14ae-1373-4e3a-abb3-9f7723d2e117] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [570c14ae-1373-4e3a-abb3-9f7723d2e117] Running
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 10.003714521s
addons_test.go:262: (dbg) Run:  out/minikube-darwin-amd64 -p addons-374000 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:286: (dbg) Run:  kubectl --context addons-374000 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:291: (dbg) Run:  out/minikube-darwin-amd64 -p addons-374000 ip
addons_test.go:297: (dbg) Run:  nslookup hello-john.test 192.169.0.49
addons_test.go:306: (dbg) Run:  out/minikube-darwin-amd64 -p addons-374000 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:306: (dbg) Done: out/minikube-darwin-amd64 -p addons-374000 addons disable ingress-dns --alsologtostderr -v=1: (1.886025254s)
addons_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 -p addons-374000 addons disable ingress --alsologtostderr -v=1
addons_test.go:311: (dbg) Done: out/minikube-darwin-amd64 -p addons-374000 addons disable ingress --alsologtostderr -v=1: (7.445551595s)
--- PASS: TestAddons/parallel/Ingress (20.26s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.64s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:838: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-fbbs8" [75d660fa-dc7d-458c-b9d9-3b29862d5b15] Running / Ready:ContainersNotReady (containers with unready status: [gadget]) / ContainersReady:ContainersNotReady (containers with unready status: [gadget])
addons_test.go:838: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.002617442s
addons_test.go:841: (dbg) Run:  out/minikube-darwin-amd64 addons disable inspektor-gadget -p addons-374000
addons_test.go:841: (dbg) Done: out/minikube-darwin-amd64 addons disable inspektor-gadget -p addons-374000: (5.638380683s)
--- PASS: TestAddons/parallel/InspektorGadget (10.64s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.47s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:407: metrics-server stabilized in 3.259362ms
addons_test.go:409: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-69cf46c98-lwcfw" [70d22a3f-de6c-4e88-917d-136a8fafbf48] Running
addons_test.go:409: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.004597591s
addons_test.go:415: (dbg) Run:  kubectl --context addons-374000 top pods -n kube-system
addons_test.go:432: (dbg) Run:  out/minikube-darwin-amd64 -p addons-374000 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.47s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (10.44s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:456: tiller-deploy stabilized in 2.74017ms
addons_test.go:458: (dbg) TestAddons/parallel/HelmTiller: waiting 6m0s for pods matching "app=helm" in namespace "kube-system" ...
helpers_test.go:344: "tiller-deploy-7b677967b9-ngkgm" [430781db-28c6-4616-a7d2-cac093bd5c23] Running
addons_test.go:458: (dbg) TestAddons/parallel/HelmTiller: app=helm healthy within 5.005345176s
addons_test.go:473: (dbg) Run:  kubectl --context addons-374000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version
addons_test.go:473: (dbg) Done: kubectl --context addons-374000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version: (5.00608564s)
addons_test.go:490: (dbg) Run:  out/minikube-darwin-amd64 -p addons-374000 addons disable helm-tiller --alsologtostderr -v=1
--- PASS: TestAddons/parallel/HelmTiller (10.44s)

                                                
                                    
x
+
TestAddons/parallel/CSI (57.74s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:561: csi-hostpath-driver pods stabilized in 14.454876ms
addons_test.go:564: (dbg) Run:  kubectl --context addons-374000 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:569: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:574: (dbg) Run:  kubectl --context addons-374000 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:579: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [8e14f246-1fee-4982-95fc-cab16fc80bf7] Pending
helpers_test.go:344: "task-pv-pod" [8e14f246-1fee-4982-95fc-cab16fc80bf7] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [8e14f246-1fee-4982-95fc-cab16fc80bf7] Running
addons_test.go:579: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 13.003400534s
addons_test.go:584: (dbg) Run:  kubectl --context addons-374000 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:589: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-374000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-374000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:594: (dbg) Run:  kubectl --context addons-374000 delete pod task-pv-pod
addons_test.go:600: (dbg) Run:  kubectl --context addons-374000 delete pvc hpvc
addons_test.go:606: (dbg) Run:  kubectl --context addons-374000 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:611: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:616: (dbg) Run:  kubectl --context addons-374000 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:621: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [87aba44e-4694-435c-872b-b03d781dc22c] Pending
helpers_test.go:344: "task-pv-pod-restore" [87aba44e-4694-435c-872b-b03d781dc22c] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [87aba44e-4694-435c-872b-b03d781dc22c] Running
addons_test.go:621: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 8.004644895s
addons_test.go:626: (dbg) Run:  kubectl --context addons-374000 delete pod task-pv-pod-restore
addons_test.go:630: (dbg) Run:  kubectl --context addons-374000 delete pvc hpvc-restore
addons_test.go:634: (dbg) Run:  kubectl --context addons-374000 delete volumesnapshot new-snapshot-demo
addons_test.go:638: (dbg) Run:  out/minikube-darwin-amd64 -p addons-374000 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:638: (dbg) Done: out/minikube-darwin-amd64 -p addons-374000 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.424501629s)
addons_test.go:642: (dbg) Run:  out/minikube-darwin-amd64 -p addons-374000 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (57.74s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (13.32s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:824: (dbg) Run:  out/minikube-darwin-amd64 addons enable headlamp -p addons-374000 --alsologtostderr -v=1
addons_test.go:824: (dbg) Done: out/minikube-darwin-amd64 addons enable headlamp -p addons-374000 --alsologtostderr -v=1: (1.316131283s)
addons_test.go:829: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-7ddfbb94ff-kjsf6" [452dfc30-8ea1-4343-8fc0-9f6e3baf1e3b] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-7ddfbb94ff-kjsf6" [452dfc30-8ea1-4343-8fc0-9f6e3baf1e3b] Running
addons_test.go:829: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 12.005090858s
--- PASS: TestAddons/parallel/Headlamp (13.32s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.38s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:857: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-6548d5df46-7gx6q" [80c5decb-9642-41ff-8765-1275de9cf664] Running
addons_test.go:857: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.004844459s
addons_test.go:860: (dbg) Run:  out/minikube-darwin-amd64 addons disable cloud-spanner -p addons-374000
--- PASS: TestAddons/parallel/CloudSpanner (5.38s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (54.54s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:873: (dbg) Run:  kubectl --context addons-374000 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:879: (dbg) Run:  kubectl --context addons-374000 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:883: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-374000 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:886: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [fb56feb7-db10-40b4-a44b-94673a99f1c6] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [fb56feb7-db10-40b4-a44b-94673a99f1c6] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [fb56feb7-db10-40b4-a44b-94673a99f1c6] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:886: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 5.003362221s
addons_test.go:891: (dbg) Run:  kubectl --context addons-374000 get pvc test-pvc -o=json
addons_test.go:900: (dbg) Run:  out/minikube-darwin-amd64 -p addons-374000 ssh "cat /opt/local-path-provisioner/pvc-1f4f5c07-5fb5-451b-9005-c81ae1cd9500_default_test-pvc/file1"
addons_test.go:912: (dbg) Run:  kubectl --context addons-374000 delete pod test-local-path
addons_test.go:916: (dbg) Run:  kubectl --context addons-374000 delete pvc test-pvc
addons_test.go:920: (dbg) Run:  out/minikube-darwin-amd64 -p addons-374000 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:920: (dbg) Done: out/minikube-darwin-amd64 -p addons-374000 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (42.883707219s)
--- PASS: TestAddons/parallel/LocalPath (54.54s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (5.34s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:952: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-65tc6" [55cb36e3-9161-425a-ac5c-ea8a236b1857] Running
addons_test.go:952: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 5.005129643s
addons_test.go:955: (dbg) Run:  out/minikube-darwin-amd64 addons disable nvidia-device-plugin -p addons-374000
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (5.34s)

                                                
                                    
x
+
TestAddons/parallel/Yakd (5s)

                                                
                                                
=== RUN   TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Yakd
addons_test.go:963: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:344: "yakd-dashboard-9947fc6bf-gpstc" [d23ba889-0b1d-43ae-a62c-7695bff64403] Running
addons_test.go:963: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 5.003695698s
--- PASS: TestAddons/parallel/Yakd (5.00s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.09s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:650: (dbg) Run:  kubectl --context addons-374000 create ns new-namespace
addons_test.go:664: (dbg) Run:  kubectl --context addons-374000 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.09s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (5.94s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:172: (dbg) Run:  out/minikube-darwin-amd64 stop -p addons-374000
addons_test.go:172: (dbg) Done: out/minikube-darwin-amd64 stop -p addons-374000: (5.384183467s)
addons_test.go:176: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p addons-374000
addons_test.go:180: (dbg) Run:  out/minikube-darwin-amd64 addons disable dashboard -p addons-374000
addons_test.go:185: (dbg) Run:  out/minikube-darwin-amd64 addons disable gvisor -p addons-374000
--- PASS: TestAddons/StoppedEnableDisable (5.94s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (11.87s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
=== PAUSE TestHyperKitDriverInstallOrUpdate

                                                
                                                

                                                
                                                
=== CONT  TestHyperKitDriverInstallOrUpdate
* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:

                                                
                                                
$ sudo chown root:wheel /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current2068644527/001/.minikube/bin/docker-machine-driver-hyperkit 
$ sudo chmod u+s /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current2068644527/001/.minikube/bin/docker-machine-driver-hyperkit 

                                                
                                                

                                                
                                                
! Unable to update hyperkit driver: [sudo chown root:wheel /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current2068644527/001/.minikube/bin/docker-machine-driver-hyperkit] requires a password, and --interactive=false
* Starting "minikube" primary control-plane node in "minikube" cluster
* Download complete!
--- PASS: TestHyperKitDriverInstallOrUpdate (11.87s)

                                                
                                    
x
+
TestErrorSpam/start (1.37s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 start --dry-run
--- PASS: TestErrorSpam/start (1.37s)

                                                
                                    
x
+
TestErrorSpam/status (0.23s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 status
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 status: exit status 7 (76.213122ms)

                                                
                                                
-- stdout --
	nospam-720000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 status" failed: exit status 7
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 status
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 status: exit status 7 (74.916991ms)

                                                
                                                
-- stdout --
	nospam-720000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 status" failed: exit status 7
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 status
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 status: exit status 7 (75.560711ms)

                                                
                                                
-- stdout --
	nospam-720000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 status" failed: exit status 7
--- PASS: TestErrorSpam/status (0.23s)

                                                
                                    
x
+
TestErrorSpam/pause (0.42s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 pause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 pause: exit status 83 (139.735848ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-720000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-720000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 pause" failed: exit status 83
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 pause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 pause: exit status 83 (138.647035ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-720000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-720000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 pause" failed: exit status 83
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 pause
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 pause: exit status 83 (139.946063ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-720000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-720000"

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 pause" failed: exit status 83
--- PASS: TestErrorSpam/pause (0.42s)

                                                
                                    
x
+
TestErrorSpam/unpause (0.44s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 unpause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 unpause: exit status 83 (159.536872ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-720000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-720000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 unpause" failed: exit status 83
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 unpause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 unpause: exit status 83 (140.055324ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-720000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-720000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 unpause" failed: exit status 83
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 unpause
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 unpause: exit status 83 (141.170672ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-720000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-720000"

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 unpause" failed: exit status 83
--- PASS: TestErrorSpam/unpause (0.44s)

                                                
                                    
x
+
TestErrorSpam/stop (10.42s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 stop
error_spam_test.go:159: (dbg) Done: out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 stop: (3.32329171s)
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 stop
error_spam_test.go:159: (dbg) Done: out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 stop: (3.091334445s)
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 stop
error_spam_test.go:182: (dbg) Done: out/minikube-darwin-amd64 -p nospam-720000 --log_dir /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/nospam-720000 stop: (4.006085054s)
--- PASS: TestErrorSpam/stop (10.42s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /Users/jenkins/minikube-integration/17909-92921/.minikube/files/etc/test/nested/copy/93377/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (1.77s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 cache add registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (1.77s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.31s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-160000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalserialCacheCmdcacheadd_local2974735470/001
functional_test.go:1085: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 cache add minikube-local-cache-test:functional-160000
functional_test.go:1090: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 cache delete minikube-local-cache-test:functional-160000
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-160000
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.31s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-darwin-amd64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.18s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.64s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 config get cpus: exit status 14 (63.526766ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 config get cpus: exit status 14 (128.68106ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.64s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (1s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-160000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit 
functional_test.go:970: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-160000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit : exit status 23 (523.189998ms)

                                                
                                                
-- stdout --
	* [functional-160000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:46:24.666692   94749 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:46:24.666883   94749 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:46:24.666888   94749 out.go:304] Setting ErrFile to fd 2...
	I0304 17:46:24.666892   94749 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:46:24.667073   94749 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:46:24.668505   94749 out.go:298] Setting JSON to false
	I0304 17:46:24.690762   94749 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24353,"bootTime":1709578831,"procs":493,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:46:24.690853   94749 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:46:24.713031   94749 out.go:177] * [functional-160000] minikube v1.32.0 on Darwin 14.3.1
	I0304 17:46:24.755697   94749 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:46:24.755747   94749 notify.go:220] Checking for updates...
	I0304 17:46:24.798327   94749 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:46:24.840336   94749 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:46:24.861641   94749 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:46:24.882484   94749 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:46:24.903560   94749 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:46:24.925159   94749 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:46:24.925872   94749 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:46:24.925955   94749 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:46:24.935277   94749 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63540
	I0304 17:46:24.935668   94749 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:46:24.936081   94749 main.go:141] libmachine: Using API Version  1
	I0304 17:46:24.936094   94749 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:46:24.936308   94749 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:46:24.936423   94749 main.go:141] libmachine: (functional-160000) Calling .DriverName
	I0304 17:46:24.936618   94749 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:46:24.936856   94749 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:46:24.936879   94749 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:46:24.944729   94749 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63542
	I0304 17:46:24.945044   94749 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:46:24.945366   94749 main.go:141] libmachine: Using API Version  1
	I0304 17:46:24.945377   94749 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:46:24.945623   94749 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:46:24.945736   94749 main.go:141] libmachine: (functional-160000) Calling .DriverName
	I0304 17:46:24.974695   94749 out.go:177] * Using the hyperkit driver based on existing profile
	I0304 17:46:25.016433   94749 start.go:297] selected driver: hyperkit
	I0304 17:46:25.016458   94749 start.go:901] validating driver "hyperkit" against &{Name:functional-160000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-160000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PV
ersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:46:25.016666   94749 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:46:25.041531   94749 out.go:177] 
	W0304 17:46:25.062602   94749 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0304 17:46:25.083324   94749 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-160000 --dry-run --alsologtostderr -v=1 --driver=hyperkit 
--- PASS: TestFunctional/parallel/DryRun (1.00s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.49s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-160000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit 
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-160000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit : exit status 23 (491.912414ms)

                                                
                                                
-- stdout --
	* [functional-160000] minikube v1.32.0 sur Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote hyperkit basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0304 17:46:25.662805   94767 out.go:291] Setting OutFile to fd 1 ...
	I0304 17:46:25.662958   94767 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:46:25.662963   94767 out.go:304] Setting ErrFile to fd 2...
	I0304 17:46:25.662968   94767 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0304 17:46:25.663151   94767 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/17909-92921/.minikube/bin
	I0304 17:46:25.664827   94767 out.go:298] Setting JSON to false
	I0304 17:46:25.687605   94767 start.go:129] hostinfo: {"hostname":"MacOS-Agent-2.local","uptime":24354,"bootTime":1709578831,"procs":496,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"2965c349-98a5-5970-aaa9-9eedd3ae5959"}
	W0304 17:46:25.687698   94767 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0304 17:46:25.709084   94767 out.go:177] * [functional-160000] minikube v1.32.0 sur Darwin 14.3.1
	I0304 17:46:25.771792   94767 out.go:177]   - MINIKUBE_LOCATION=17909
	I0304 17:46:25.750770   94767 notify.go:220] Checking for updates...
	I0304 17:46:25.792571   94767 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	I0304 17:46:25.813883   94767 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0304 17:46:25.834690   94767 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0304 17:46:25.855779   94767 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	I0304 17:46:25.876857   94767 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0304 17:46:25.898461   94767 config.go:182] Loaded profile config "functional-160000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0304 17:46:25.899207   94767 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:46:25.899312   94767 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:46:25.908173   94767 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63550
	I0304 17:46:25.908567   94767 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:46:25.909013   94767 main.go:141] libmachine: Using API Version  1
	I0304 17:46:25.909023   94767 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:46:25.909279   94767 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:46:25.909400   94767 main.go:141] libmachine: (functional-160000) Calling .DriverName
	I0304 17:46:25.909598   94767 driver.go:392] Setting default libvirt URI to qemu:///system
	I0304 17:46:25.909854   94767 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0304 17:46:25.909877   94767 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0304 17:46:25.917564   94767 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:63552
	I0304 17:46:25.917887   94767 main.go:141] libmachine: () Calling .GetVersion
	I0304 17:46:25.918206   94767 main.go:141] libmachine: Using API Version  1
	I0304 17:46:25.918227   94767 main.go:141] libmachine: () Calling .SetConfigRaw
	I0304 17:46:25.918404   94767 main.go:141] libmachine: () Calling .GetMachineName
	I0304 17:46:25.918503   94767 main.go:141] libmachine: (functional-160000) Calling .DriverName
	I0304 17:46:25.946519   94767 out.go:177] * Utilisation du pilote hyperkit basé sur le profil existant
	I0304 17:46:25.988686   94767 start.go:297] selected driver: hyperkit
	I0304 17:46:25.988714   94767 start.go:901] validating driver "hyperkit" against &{Name:functional-160000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-160000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PV
ersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0304 17:46:25.988890   94767 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0304 17:46:26.013586   94767 out.go:177] 
	W0304 17:46:26.034760   94767 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0304 17:46:26.055819   94767 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.49s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.28s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1686: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 addons list
functional_test.go:1698: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.28s)

                                                
                                    
x
+
TestFunctional/parallel/License (0.76s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-darwin-amd64 license
--- PASS: TestFunctional/parallel/License (0.76s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 version --short
--- PASS: TestFunctional/parallel/Version/short (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (2.42s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (2.339269292s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-160000
--- PASS: TestFunctional/parallel/ImageCommands/Setup (2.42s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-160000 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.02s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image rm gcr.io/google-containers/addon-resizer:functional-160000 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-160000
functional_test.go:423: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 image save --daemon gcr.io/google-containers/addon-resizer:functional-160000 --alsologtostderr
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-160000
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.26s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1266: (dbg) Run:  out/minikube-darwin-amd64 profile lis
functional_test.go:1271: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.26s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.24s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1306: (dbg) Run:  out/minikube-darwin-amd64 profile list
functional_test.go:1311: Took "148.811587ms" to run "out/minikube-darwin-amd64 profile list"
functional_test.go:1320: (dbg) Run:  out/minikube-darwin-amd64 profile list -l
functional_test.go:1325: Took "88.742264ms" to run "out/minikube-darwin-amd64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.24s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1357: (dbg) Run:  out/minikube-darwin-amd64 profile list -o json
functional_test.go:1362: Took "146.582871ms" to run "out/minikube-darwin-amd64 profile list -o json"
functional_test.go:1370: (dbg) Run:  out/minikube-darwin-amd64 profile list -o json --light
functional_test.go:1375: Took "86.584376ms" to run "out/minikube-darwin-amd64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (10.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:351: (dbg) Run:  dscacheutil -q host -a name nginx-svc.default.svc.cluster.local.
E0304 17:47:46.721049   93377 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/17909-92921/.minikube/profiles/addons-374000/client.crt: no such file or directory
functional_test_tunnel_test.go:351: (dbg) Done: dscacheutil -q host -a name nginx-svc.default.svc.cluster.local.: (10.007830271s)
functional_test_tunnel_test.go:359: DNS resolution by dscacheutil for nginx-svc.default.svc.cluster.local. is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (10.02s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-darwin-amd64 -p functional-160000 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.14s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.13s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-160000
--- PASS: TestFunctional/delete_addon-resizer_images (0.13s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.05s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-160000
--- PASS: TestFunctional/delete_my-image_image (0.05s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.05s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-160000
--- PASS: TestFunctional/delete_minikube_cached_images (0.05s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (3.57s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 stop -p json-output-885000 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-darwin-amd64 stop -p json-output-885000 --output=json --user=testUser: (3.566198968s)
--- PASS: TestJSONOutput/stop/Command (3.57s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.82s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-darwin-amd64 start -p json-output-error-594000 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p json-output-error-594000 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (434.298712ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"678f59e5-b26c-4dcc-8873-8f65ccf39d52","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-594000] minikube v1.32.0 on Darwin 14.3.1","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"07f9fc2e-a968-4928-98a3-9698a77a2c28","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=17909"}}
	{"specversion":"1.0","id":"7b896a13-8536-4749-a83e-a0219e9836de","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig"}}
	{"specversion":"1.0","id":"0cb42a8a-e86d-41e9-a570-2e29bbef5884","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-amd64"}}
	{"specversion":"1.0","id":"f750ac27-d105-4d47-a8d1-e760595791a2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"4c22bb73-553d-4982-9617-b08566faf271","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube"}}
	{"specversion":"1.0","id":"fce9501f-c53b-47bd-aa2b-ff86d6e3b2f5","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"7f81ae87-3a99-4f09-9e2b-c1faa7cb864a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on darwin/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-594000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p json-output-error-594000
--- PASS: TestErrorJSONOutput (0.82s)

                                                
                                    
x
+
TestMainNoArgs (0.09s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-darwin-amd64
--- PASS: TestMainNoArgs (0.09s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (2.6s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current
* minikube v1.32.0 on darwin
- MINIKUBE_LOCATION=17909
- KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current551425009/001
* Using the hyperkit driver based on user configuration
* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:

                                                
                                                
$ sudo chown root:wheel /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current551425009/001/.minikube/bin/docker-machine-driver-hyperkit 
$ sudo chmod u+s /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current551425009/001/.minikube/bin/docker-machine-driver-hyperkit 

                                                
                                                

                                                
                                                
! Unable to update hyperkit driver: [sudo chown root:wheel /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current551425009/001/.minikube/bin/docker-machine-driver-hyperkit] requires a password, and --interactive=false
* Starting "minikube" primary control-plane node in "minikube" cluster
* Download complete!
--- PASS: TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (2.60s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (6.06s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current
* minikube v1.32.0 on darwin
- MINIKUBE_LOCATION=17909
- KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current2068644527/001
* Using the hyperkit driver based on user configuration
* Downloading driver docker-machine-driver-hyperkit:
--- PASS: TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (6.06s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (1.3s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (1.30s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.43s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-466000 --no-kubernetes --kubernetes-version=1.20 --driver=hyperkit 
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-466000 --no-kubernetes --kubernetes-version=1.20 --driver=hyperkit : exit status 14 (428.075759ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-466000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=17909
	  - KUBECONFIG=/Users/jenkins/minikube-integration/17909-92921/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/17909-92921/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.43s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.14s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-amd64 ssh -p NoKubernetes-466000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p NoKubernetes-466000 "sudo systemctl is-active --quiet service kubelet": exit status 83 (139.59963ms)

                                                
                                                
-- stdout --
	* The control-plane node NoKubernetes-466000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p NoKubernetes-466000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.14s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (0.33s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-darwin-amd64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-darwin-amd64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (0.33s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (2.76s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-darwin-amd64 stop -p NoKubernetes-466000
no_kubernetes_test.go:158: (dbg) Done: out/minikube-darwin-amd64 stop -p NoKubernetes-466000: (2.760203591s)
--- PASS: TestNoKubernetes/serial/Stop (2.76s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.14s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-amd64 ssh -p NoKubernetes-466000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p NoKubernetes-466000 "sudo systemctl is-active --quiet service kubelet": exit status 83 (138.621688ms)

                                                
                                                
-- stdout --
	* The control-plane node NoKubernetes-466000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p NoKubernetes-466000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.14s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (3.67s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p old-k8s-version-444000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p old-k8s-version-444000 --alsologtostderr -v=3: (3.6689301s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (3.67s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.39s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-444000 -n old-k8s-version-444000: exit status 7 (76.83486ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p old-k8s-version-444000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.39s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (3.45s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p no-preload-800000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p no-preload-800000 --alsologtostderr -v=3: (3.453835482s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (3.45s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-800000 -n no-preload-800000: exit status 7 (73.214501ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p no-preload-800000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.32s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (2.05s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p embed-certs-917000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p embed-certs-917000 --alsologtostderr -v=3: (2.052135428s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (2.05s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.35s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-917000 -n embed-certs-917000: exit status 7 (89.987204ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p embed-certs-917000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.35s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (2.15s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p default-k8s-diff-port-051000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p default-k8s-diff-port-051000 --alsologtostderr -v=3: (2.151372951s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (2.15s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.35s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-051000 -n default-k8s-diff-port-051000: exit status 7 (76.077946ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p default-k8s-diff-port-051000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.35s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.22s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p newest-cni-489000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.22s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (3.49s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p newest-cni-489000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p newest-cni-489000 --alsologtostderr -v=3: (3.491943546s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (3.49s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.33s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-489000 -n newest-cni-489000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-489000 -n newest-cni-489000: exit status 7 (75.931391ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p newest-cni-489000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.33s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    

Test skip (24/280)

x
+
TestDownloadOnly/v1.20.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.20.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.20.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.4/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.4/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.29.0-rc.2/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.29.0-rc.2/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:220: skipping, only for docker or podman driver
--- SKIP: TestDownloadOnlyKic (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:498: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with docker false darwin amd64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:41: Skip if not linux.
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing docker
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (10.45s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-160000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdany-port862411193/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1709603150989170000" to /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdany-port862411193/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1709603150989170000" to /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdany-port862411193/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1709603150989170000" to /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdany-port862411193/001/test-1709603150989170000
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (220.942075ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (140.437973ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (144.551851ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (140.591382ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (143.216855ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (140.617786ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (139.774205ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:123: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:90: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "sudo umount -f /mount-9p": exit status 83 (138.799679ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:92: "out/minikube-darwin-amd64 -p functional-160000 ssh \"sudo umount -f /mount-9p\"": exit status 83
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-160000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdany-port862411193/001:/mount-9p --alsologtostderr -v=1] ...
--- SKIP: TestFunctional/parallel/MountCmd/any-port (10.45s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (10.67s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-160000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdspecific-port883532618/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (220.419733ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (141.100206ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (139.876658ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (146.813639ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (140.159719ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (140.094563ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (139.138409ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:251: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "sudo umount -f /mount-9p": exit status 83 (138.268112ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:232: "out/minikube-darwin-amd64 -p functional-160000 ssh \"sudo umount -f /mount-9p\"": exit status 83
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-160000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdspecific-port883532618/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- SKIP: TestFunctional/parallel/MountCmd/specific-port (10.67s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (12.51s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-160000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup3584944369/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-160000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup3584944369/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-160000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup3584944369/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T" /mount1: exit status 83 (245.798589ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T" /mount1: exit status 83 (139.13225ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T" /mount1: exit status 83 (141.672357ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T" /mount1: exit status 83 (142.193983ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T" /mount1: exit status 83 (140.824112ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T" /mount1: exit status 83 (141.889978ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-160000 ssh "findmnt -T" /mount1: exit status 83 (161.187232ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-160000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-160000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:340: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-160000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup3584944369/001:/mount1 --alsologtostderr -v=1] ...
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-160000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup3584944369/001:/mount2 --alsologtostderr -v=1] ...
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-160000 /var/folders/vq/yhv778t970xgml0dzm5fdwlr0000gp/T/TestFunctionalparallelMountCmdVerifyCleanup3584944369/001:/mount3 --alsologtostderr -v=1] ...
--- SKIP: TestFunctional/parallel/MountCmd/VerifyCleanup (12.51s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestKicCustomNetwork (0s)

                                                
                                                
=== RUN   TestKicCustomNetwork
kic_custom_network_test.go:34: only runs with docker driver
--- SKIP: TestKicCustomNetwork (0.00s)

                                                
                                    
x
+
TestKicExistingNetwork (0s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:73: only runs with docker driver
--- SKIP: TestKicExistingNetwork (0.00s)

                                                
                                    
x
+
TestKicCustomSubnet (0s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:102: only runs with docker/podman driver
--- SKIP: TestKicCustomSubnet (0.00s)

                                                
                                    
x
+
TestKicStaticIP (0s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:123: only run with docker/podman driver
--- SKIP: TestKicStaticIP (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestInsufficientStorage (0s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:38: only runs with docker driver
--- SKIP: TestInsufficientStorage (0.00s)

                                                
                                    
x
+
TestMissingContainerUpgrade (0s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
version_upgrade_test.go:284: This test is only for Docker
--- SKIP: TestMissingContainerUpgrade (0.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (6.17s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:626: 
----------------------- debugLogs start: cilium-612000 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-612000" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-612000

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-612000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-612000"

                                                
                                                
----------------------- debugLogs end: cilium-612000 [took: 5.78615595s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-612000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cilium-612000
--- SKIP: TestNetworkPlugins/group/cilium (6.17s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.39s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-865000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p disable-driver-mounts-865000
--- SKIP: TestStartStop/group/disable-driver-mounts (0.39s)

                                                
                                    
Copied to clipboard