Test Report: Hyperkit_macOS 18320

                    
                      135c3c98ed62ac5bccf3530555abd368cdd0fde3:2024-03-07:33456
                    
                

Test fail (155/280)

Order failed test Duration
31 TestOffline 12.78
54 TestCertOptions 13.97
55 TestCertExpiration 204.46
56 TestDockerFlags 15.14
57 TestForceSystemdFlag 11.7
58 TestForceSystemdEnv 18.06
64 TestErrorSpam/setup 11.25
73 TestFunctional/serial/StartWithProxy 11.29
75 TestFunctional/serial/SoftStart 5.86
76 TestFunctional/serial/KubeContext 0.11
77 TestFunctional/serial/KubectlGetPods 0.11
84 TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node 0.14
85 TestFunctional/serial/CacheCmd/cache/cache_reload 0.55
87 TestFunctional/serial/MinikubeKubectlCmd 0.55
88 TestFunctional/serial/MinikubeKubectlCmdDirectly 0.72
89 TestFunctional/serial/ExtraConfig 5.88
90 TestFunctional/serial/ComponentHealth 0.11
91 TestFunctional/serial/LogsCmd 0.32
92 TestFunctional/serial/LogsFileCmd 0.29
93 TestFunctional/serial/InvalidService 0.04
96 TestFunctional/parallel/DashboardCmd 0.33
99 TestFunctional/parallel/StatusCmd 0.29
103 TestFunctional/parallel/ServiceCmdConnect 0.22
105 TestFunctional/parallel/PersistentVolumeClaim 0.07
107 TestFunctional/parallel/SSHCmd 0.37
108 TestFunctional/parallel/CpCmd 0.96
109 TestFunctional/parallel/MySQL 0.12
110 TestFunctional/parallel/FileSync 0.21
111 TestFunctional/parallel/CertSync 1.04
115 TestFunctional/parallel/NodeLabels 0.13
117 TestFunctional/parallel/NonActiveRuntimeDisabled 0.16
121 TestFunctional/parallel/Version/components 0.14
122 TestFunctional/parallel/ImageCommands/ImageListShort 0.1
123 TestFunctional/parallel/ImageCommands/ImageListTable 0.11
124 TestFunctional/parallel/ImageCommands/ImageListJson 0.1
125 TestFunctional/parallel/ImageCommands/ImageListYaml 0.1
126 TestFunctional/parallel/ImageCommands/ImageBuild 0.35
128 TestFunctional/parallel/DockerEnv/bash 0.14
129 TestFunctional/parallel/UpdateContextCmd/no_changes 0.14
130 TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster 0.16
131 TestFunctional/parallel/UpdateContextCmd/no_clusters 0.14
132 TestFunctional/parallel/ServiceCmd/DeployApp 0.04
133 TestFunctional/parallel/ServiceCmd/List 0.2
134 TestFunctional/parallel/ServiceCmd/JSONOutput 0.18
135 TestFunctional/parallel/ServiceCmd/HTTPS 0.14
136 TestFunctional/parallel/ServiceCmd/Format 0.16
137 TestFunctional/parallel/ServiceCmd/URL 0.14
139 TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel 0.34
142 TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup 0
143 TestFunctional/parallel/TunnelCmd/serial/AccessDirect 103.76
144 TestFunctional/parallel/ImageCommands/ImageLoadDaemon 1.91
145 TestFunctional/parallel/ImageCommands/ImageReloadDaemon 1.82
146 TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon 7.36
147 TestFunctional/parallel/ImageCommands/ImageSaveToFile 0.1
149 TestFunctional/parallel/ImageCommands/ImageLoadFromFile 0.19
157 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig 15.05
159 TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS 34.38
167 TestMutliControlPlane/serial/StartCluster 11.41
168 TestMutliControlPlane/serial/DeployApp 97.81
169 TestMutliControlPlane/serial/PingHostFromPods 0.17
170 TestMutliControlPlane/serial/AddWorkerNode 0.21
171 TestMutliControlPlane/serial/NodeLabels 0.11
172 TestMutliControlPlane/serial/HAppyAfterClusterStart 0.22
173 TestMutliControlPlane/serial/CopyFile 0.15
174 TestMutliControlPlane/serial/StopSecondaryNode 0.3
175 TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop 0.22
176 TestMutliControlPlane/serial/RestartSecondaryNode 40.86
177 TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart 0.22
178 TestMutliControlPlane/serial/RestartClusterKeepsNodes 9.09
179 TestMutliControlPlane/serial/DeleteSecondaryNode 0.28
180 TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete 0.22
181 TestMutliControlPlane/serial/StopCluster 2.39
182 TestMutliControlPlane/serial/RestartCluster 5.84
183 TestMutliControlPlane/serial/DegradedAfterClusterRestart 0.22
184 TestMutliControlPlane/serial/AddSecondaryNode 0.21
185 TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd 0.22
188 TestImageBuild/serial/Setup 11.21
191 TestJSONOutput/start/Command 11.33
194 TestJSONOutput/start/parallel/DistinctCurrentSteps 0
195 TestJSONOutput/start/parallel/IncreasingCurrentSteps 0
197 TestJSONOutput/pause/Command 0.14
203 TestJSONOutput/unpause/Command 0.14
220 TestMinikubeProfile 12.48
223 TestMountStart/serial/StartWithMountFirst 12.08
226 TestMultiNode/serial/FreshStart2Nodes 11.29
227 TestMultiNode/serial/DeployApp2Nodes 78.21
228 TestMultiNode/serial/PingHostFrom2Pods 0.2
229 TestMultiNode/serial/AddNode 0.21
230 TestMultiNode/serial/MultiNodeLabels 0.11
231 TestMultiNode/serial/ProfileList 0.22
232 TestMultiNode/serial/CopyFile 0.15
233 TestMultiNode/serial/StopNode 0.37
234 TestMultiNode/serial/StartAfterStop 42.69
235 TestMultiNode/serial/RestartKeepsNodes 10.08
236 TestMultiNode/serial/DeleteNode 0.28
237 TestMultiNode/serial/StopMultiNode 4.26
238 TestMultiNode/serial/RestartMultiNode 5.98
239 TestMultiNode/serial/ValidateNameConflict 23.03
243 TestPreload 11.34
245 TestScheduledStopUnix 11.53
246 TestSkaffold 18.47
249 TestRunningBinaryUpgrade 67.72
251 TestKubernetesUpgrade 21.28
267 TestStoppedBinaryUpgrade/Upgrade 25.51
268 TestStoppedBinaryUpgrade/MinikubeLogs 0.32
270 TestPause/serial/Start 11.29
280 TestNoKubernetes/serial/StartWithK8s 11.35
281 TestNoKubernetes/serial/StartWithStopK8s 6.25
282 TestNoKubernetes/serial/Start 6.29
286 TestNoKubernetes/serial/StartNoArgs 6.31
288 TestNetworkPlugins/group/auto/Start 11.59
289 TestNetworkPlugins/group/kindnet/Start 12
290 TestNetworkPlugins/group/calico/Start 11.59
291 TestNetworkPlugins/group/custom-flannel/Start 11.81
292 TestNetworkPlugins/group/false/Start 11.65
293 TestNetworkPlugins/group/enable-default-cni/Start 12.11
294 TestNetworkPlugins/group/flannel/Start 11.38
295 TestNetworkPlugins/group/bridge/Start 11.73
296 TestNetworkPlugins/group/kubenet/Start 11.64
298 TestStartStop/group/old-k8s-version/serial/FirstStart 11.91
300 TestStartStop/group/no-preload/serial/FirstStart 11.35
301 TestStartStop/group/old-k8s-version/serial/DeployApp 0.18
302 TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive 0.32
305 TestStartStop/group/no-preload/serial/DeployApp 0.23
306 TestStartStop/group/old-k8s-version/serial/SecondStart 6.17
307 TestStartStop/group/no-preload/serial/EnableAddonWhileActive 0.53
310 TestStartStop/group/no-preload/serial/SecondStart 6.99
311 TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop 0.07
312 TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop 0.11
313 TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages 0.18
314 TestStartStop/group/old-k8s-version/serial/Pause 0.28
316 TestStartStop/group/embed-certs/serial/FirstStart 11.65
317 TestStartStop/group/no-preload/serial/UserAppExistsAfterStop 0.07
318 TestStartStop/group/no-preload/serial/AddonExistsAfterStop 0.11
319 TestStartStop/group/no-preload/serial/VerifyKubernetesImages 0.18
320 TestStartStop/group/no-preload/serial/Pause 0.28
322 TestStartStop/group/default-k8s-diff-port/serial/FirstStart 11.41
323 TestStartStop/group/embed-certs/serial/DeployApp 0.18
324 TestStartStop/group/embed-certs/serial/EnableAddonWhileActive 0.32
327 TestStartStop/group/embed-certs/serial/SecondStart 6.54
328 TestStartStop/group/default-k8s-diff-port/serial/DeployApp 0.18
329 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive 0.32
332 TestStartStop/group/default-k8s-diff-port/serial/SecondStart 6.09
333 TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop 0.07
334 TestStartStop/group/embed-certs/serial/AddonExistsAfterStop 0.11
335 TestStartStop/group/embed-certs/serial/VerifyKubernetesImages 0.18
336 TestStartStop/group/embed-certs/serial/Pause 0.28
338 TestStartStop/group/newest-cni/serial/FirstStart 11.46
339 TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop 0.07
340 TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop 0.11
341 TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages 0.18
342 TestStartStop/group/default-k8s-diff-port/serial/Pause 0.29
347 TestStartStop/group/newest-cni/serial/SecondStart 5.91
350 TestStartStop/group/newest-cni/serial/VerifyKubernetesImages 0.18
351 TestStartStop/group/newest-cni/serial/Pause 0.29
x
+
TestOffline (12.78s)

                                                
                                                
=== RUN   TestOffline
=== PAUSE TestOffline

                                                
                                                

                                                
                                                
=== CONT  TestOffline
aab_offline_test.go:55: (dbg) Run:  out/minikube-darwin-amd64 start -p offline-docker-900000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit 
aab_offline_test.go:55: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p offline-docker-900000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit : exit status 60 (12.438661525s)

                                                
                                                
-- stdout --
	* [offline-docker-900000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "offline-docker-900000" primary control-plane node in "offline-docker-900000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "offline-docker-900000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:08:05.820931    4300 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:08:05.821211    4300 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:08:05.821216    4300 out.go:304] Setting ErrFile to fd 2...
	I0307 14:08:05.821220    4300 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:08:05.821395    4300 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:08:05.822953    4300 out.go:298] Setting JSON to false
	I0307 14:08:05.846216    4300 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2256,"bootTime":1709847029,"procs":489,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:08:05.846320    4300 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:08:05.868458    4300 out.go:177] * [offline-docker-900000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:08:05.910950    4300 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:08:05.910973    4300 notify.go:220] Checking for updates...
	I0307 14:08:05.952794    4300 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:08:05.973892    4300 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:08:05.994895    4300 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:08:06.015815    4300 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:08:06.036940    4300 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:08:06.058399    4300 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:08:06.058487    4300 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:08:06.086844    4300 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:08:06.128749    4300 start.go:297] selected driver: hyperkit
	I0307 14:08:06.128767    4300 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:08:06.128778    4300 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:08:06.131727    4300 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:08:06.131841    4300 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:08:06.139597    4300 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:08:06.143463    4300 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:08:06.143490    4300 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 14:08:06.143527    4300 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:08:06.143738    4300 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:08:06.143807    4300 cni.go:84] Creating CNI manager for ""
	I0307 14:08:06.143824    4300 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:08:06.143832    4300 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 14:08:06.143918    4300 start.go:340] cluster config:
	{Name:offline-docker-900000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-900000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loca
l ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: S
SHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:08:06.144006    4300 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:08:06.185715    4300 out.go:177] * Starting "offline-docker-900000" primary control-plane node in "offline-docker-900000" cluster
	I0307 14:08:06.206932    4300 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:08:06.207008    4300 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:08:06.207094    4300 cache.go:56] Caching tarball of preloaded images
	I0307 14:08:06.207298    4300 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:08:06.207318    4300 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:08:06.207456    4300 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/offline-docker-900000/config.json ...
	I0307 14:08:06.207495    4300 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/offline-docker-900000/config.json: {Name:mkd71f54ce4c194ac647b20c42da9e861e7d63fa Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:08:06.208040    4300 start.go:360] acquireMachinesLock for offline-docker-900000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:08:06.208157    4300 start.go:364] duration metric: took 84.398µs to acquireMachinesLock for "offline-docker-900000"
	I0307 14:08:06.208212    4300 start.go:93] Provisioning new machine with config: &{Name:offline-docker-900000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-900000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:08:06.208349    4300 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:08:06.229738    4300 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 14:08:06.229967    4300 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:08:06.230023    4300 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:06.238342    4300 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50580
	I0307 14:08:06.238676    4300 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:06.239106    4300 main.go:141] libmachine: Using API Version  1
	I0307 14:08:06.239115    4300 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:06.239306    4300 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:06.239399    4300 main.go:141] libmachine: (offline-docker-900000) Calling .GetMachineName
	I0307 14:08:06.239471    4300 main.go:141] libmachine: (offline-docker-900000) Calling .DriverName
	I0307 14:08:06.239574    4300 start.go:159] libmachine.API.Create for "offline-docker-900000" (driver="hyperkit")
	I0307 14:08:06.239596    4300 client.go:168] LocalClient.Create starting
	I0307 14:08:06.239628    4300 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:08:06.239677    4300 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:06.239691    4300 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:06.239761    4300 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:08:06.239803    4300 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:06.239813    4300 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:06.239830    4300 main.go:141] libmachine: Running pre-create checks...
	I0307 14:08:06.239840    4300 main.go:141] libmachine: (offline-docker-900000) Calling .PreCreateCheck
	I0307 14:08:06.239915    4300 main.go:141] libmachine: (offline-docker-900000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:08:06.240105    4300 main.go:141] libmachine: (offline-docker-900000) Calling .GetConfigRaw
	I0307 14:08:06.271942    4300 main.go:141] libmachine: Creating machine...
	I0307 14:08:06.271964    4300 main.go:141] libmachine: (offline-docker-900000) Calling .Create
	I0307 14:08:06.272273    4300 main.go:141] libmachine: (offline-docker-900000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:08:06.272509    4300 main.go:141] libmachine: (offline-docker-900000) DBG | I0307 14:08:06.272252    4320 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:08:06.272558    4300 main.go:141] libmachine: (offline-docker-900000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:08:06.871878    4300 main.go:141] libmachine: (offline-docker-900000) DBG | I0307 14:08:06.871774    4320 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/offline-docker-900000/id_rsa...
	I0307 14:08:06.965952    4300 main.go:141] libmachine: (offline-docker-900000) DBG | I0307 14:08:06.965885    4320 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/offline-docker-900000/offline-docker-900000.rawdisk...
	I0307 14:08:06.965983    4300 main.go:141] libmachine: (offline-docker-900000) DBG | Writing magic tar header
	I0307 14:08:06.966064    4300 main.go:141] libmachine: (offline-docker-900000) DBG | Writing SSH key tar header
	I0307 14:08:06.987570    4300 main.go:141] libmachine: (offline-docker-900000) DBG | I0307 14:08:06.987456    4320 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/offline-docker-900000 ...
	I0307 14:08:07.367435    4300 main.go:141] libmachine: (offline-docker-900000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:08:07.367454    4300 main.go:141] libmachine: (offline-docker-900000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/offline-docker-900000/hyperkit.pid
	I0307 14:08:07.367488    4300 main.go:141] libmachine: (offline-docker-900000) DBG | Using UUID 7e70fb6d-7eef-4de7-acbe-da382bfc3f03
	I0307 14:08:07.536500    4300 main.go:141] libmachine: (offline-docker-900000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:08:07.536585    4300 client.go:171] duration metric: took 1.296969345s to LocalClient.Create
	I0307 14:08:09.536946    4300 start.go:128] duration metric: took 3.328549396s to createHost
	I0307 14:08:09.537010    4300 start.go:83] releasing machines lock for "offline-docker-900000", held for 3.328777735s
	W0307 14:08:09.537043    4300 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:08:09.537629    4300 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:08:09.537673    4300 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:09.546560    4300 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50582
	I0307 14:08:09.546888    4300 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:09.547259    4300 main.go:141] libmachine: Using API Version  1
	I0307 14:08:09.547276    4300 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:09.547473    4300 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:09.547818    4300 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:08:09.547839    4300 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:09.555482    4300 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50584
	I0307 14:08:09.555812    4300 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:09.556141    4300 main.go:141] libmachine: Using API Version  1
	I0307 14:08:09.556151    4300 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:09.556372    4300 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:09.556483    4300 main.go:141] libmachine: (offline-docker-900000) Calling .GetState
	I0307 14:08:09.556570    4300 main.go:141] libmachine: (offline-docker-900000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:08:09.556601    4300 main.go:141] libmachine: (offline-docker-900000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/offline-docker-900000/hyperkit.json: no such file or directory
	I0307 14:08:09.556612    4300 main.go:141] libmachine: (offline-docker-900000) DBG | hyperkit pid from json: 0
	I0307 14:08:09.556628    4300 main.go:141] libmachine: (offline-docker-900000) Calling .DriverName
	I0307 14:08:09.606486    4300 out.go:177] * Deleting "offline-docker-900000" in hyperkit ...
	I0307 14:08:09.627234    4300 main.go:141] libmachine: (offline-docker-900000) Calling .Remove
	I0307 14:08:09.627394    4300 main.go:141] libmachine: (offline-docker-900000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:08:09.627404    4300 main.go:141] libmachine: (offline-docker-900000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:08:09.627416    4300 main.go:141] libmachine: (offline-docker-900000) DBG | hyperkit pid from json: 0
	I0307 14:08:09.627427    4300 main.go:141] libmachine: (offline-docker-900000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/offline-docker-900000/hyperkit.json: no such file or directory
	W0307 14:08:09.720614    4300 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:08:09.720642    4300 start.go:728] Will try again in 5 seconds ...
	I0307 14:08:14.721954    4300 start.go:360] acquireMachinesLock for offline-docker-900000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:08:14.722067    4300 start.go:364] duration metric: took 90.293µs to acquireMachinesLock for "offline-docker-900000"
	I0307 14:08:14.722095    4300 start.go:93] Provisioning new machine with config: &{Name:offline-docker-900000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:offline-docker-900000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions
:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:08:14.722149    4300 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:08:14.768720    4300 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 14:08:14.768920    4300 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:08:14.768952    4300 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:14.777095    4300 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50587
	I0307 14:08:14.777484    4300 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:14.777822    4300 main.go:141] libmachine: Using API Version  1
	I0307 14:08:14.777858    4300 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:14.778095    4300 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:14.778194    4300 main.go:141] libmachine: (offline-docker-900000) Calling .GetMachineName
	I0307 14:08:14.778267    4300 main.go:141] libmachine: (offline-docker-900000) Calling .DriverName
	I0307 14:08:14.778373    4300 start.go:159] libmachine.API.Create for "offline-docker-900000" (driver="hyperkit")
	I0307 14:08:14.778393    4300 client.go:168] LocalClient.Create starting
	I0307 14:08:14.778433    4300 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:08:14.778487    4300 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:14.778498    4300 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:14.778544    4300 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:08:14.778586    4300 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:14.778598    4300 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:14.778616    4300 main.go:141] libmachine: Running pre-create checks...
	I0307 14:08:14.778621    4300 main.go:141] libmachine: (offline-docker-900000) Calling .PreCreateCheck
	I0307 14:08:14.778690    4300 main.go:141] libmachine: (offline-docker-900000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:08:14.778733    4300 main.go:141] libmachine: (offline-docker-900000) Calling .GetConfigRaw
	I0307 14:08:14.779185    4300 main.go:141] libmachine: Creating machine...
	I0307 14:08:14.779193    4300 main.go:141] libmachine: (offline-docker-900000) Calling .Create
	I0307 14:08:14.779258    4300 main.go:141] libmachine: (offline-docker-900000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:08:14.779411    4300 main.go:141] libmachine: (offline-docker-900000) DBG | I0307 14:08:14.779255    4430 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:08:14.779440    4300 main.go:141] libmachine: (offline-docker-900000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:08:15.322509    4300 main.go:141] libmachine: (offline-docker-900000) DBG | I0307 14:08:15.322422    4430 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/offline-docker-900000/id_rsa...
	I0307 14:08:15.454528    4300 main.go:141] libmachine: (offline-docker-900000) DBG | I0307 14:08:15.454427    4430 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/offline-docker-900000/offline-docker-900000.rawdisk...
	I0307 14:08:15.454544    4300 main.go:141] libmachine: (offline-docker-900000) DBG | Writing magic tar header
	I0307 14:08:15.454567    4300 main.go:141] libmachine: (offline-docker-900000) DBG | Writing SSH key tar header
	I0307 14:08:15.455344    4300 main.go:141] libmachine: (offline-docker-900000) DBG | I0307 14:08:15.455290    4430 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/offline-docker-900000 ...
	I0307 14:08:15.965729    4300 main.go:141] libmachine: (offline-docker-900000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:08:15.965748    4300 main.go:141] libmachine: (offline-docker-900000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/offline-docker-900000/hyperkit.pid
	I0307 14:08:15.965801    4300 main.go:141] libmachine: (offline-docker-900000) DBG | Using UUID 2d53292e-1f4e-4d43-bb91-151cc50bc98f
	I0307 14:08:16.007402    4300 main.go:141] libmachine: (offline-docker-900000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:08:16.007474    4300 client.go:171] duration metric: took 1.229065264s to LocalClient.Create
	I0307 14:08:18.007633    4300 start.go:128] duration metric: took 3.285427675s to createHost
	I0307 14:08:18.007652    4300 start.go:83] releasing machines lock for "offline-docker-900000", held for 3.285551993s
	W0307 14:08:18.007876    4300 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p offline-docker-900000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p offline-docker-900000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:08:18.050179    4300 out.go:177] 
	W0307 14:08:18.071561    4300 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:08:18.071640    4300 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:08:18.071651    4300 out.go:239] * Related issues:
	* Related issues:
	W0307 14:08:18.071672    4300 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:08:18.071703    4300 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:08:18.114292    4300 out.go:177] 

                                                
                                                
** /stderr **
aab_offline_test.go:58: out/minikube-darwin-amd64 start -p offline-docker-900000 --alsologtostderr -v=1 --memory=2048 --wait=true --driver=hyperkit  failed: exit status 60
panic.go:626: *** TestOffline FAILED at 2024-03-07 14:08:18.201108 -0800 PST m=+1301.241282129
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p offline-docker-900000 -n offline-docker-900000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p offline-docker-900000 -n offline-docker-900000: exit status 7 (72.578727ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "offline-docker-900000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "offline-docker-900000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p offline-docker-900000
--- FAIL: TestOffline (12.78s)

                                                
                                    
x
+
TestCertOptions (13.97s)

                                                
                                                
=== RUN   TestCertOptions
=== PAUSE TestCertOptions

                                                
                                                

                                                
                                                
=== CONT  TestCertOptions
cert_options_test.go:49: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-options-850000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit 
cert_options_test.go:49: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-options-850000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit : exit status 60 (13.318348394s)

                                                
                                                
-- stdout --
	* [cert-options-850000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "cert-options-850000" primary control-plane node in "cert-options-850000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "cert-options-850000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-options-850000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:51: failed to start minikube with args: "out/minikube-darwin-amd64 start -p cert-options-850000 --memory=2048 --apiserver-ips=127.0.0.1 --apiserver-ips=192.168.15.15 --apiserver-names=localhost --apiserver-names=www.google.com --apiserver-port=8555 --driver=hyperkit " : exit status 60
cert_options_test.go:60: (dbg) Run:  out/minikube-darwin-amd64 -p cert-options-850000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt"
cert_options_test.go:60: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p cert-options-850000 ssh "openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt": exit status 83 (140.033347ms)

                                                
                                                
-- stdout --
	* The control-plane node cert-options-850000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-850000"

                                                
                                                
-- /stdout --
cert_options_test.go:62: failed to read apiserver cert inside minikube. args "out/minikube-darwin-amd64 -p cert-options-850000 ssh \"openssl x509 -text -noout -in /var/lib/minikube/certs/apiserver.crt\"": exit status 83
cert_options_test.go:69: apiserver cert does not include 127.0.0.1 in SAN.
cert_options_test.go:69: apiserver cert does not include 192.168.15.15 in SAN.
cert_options_test.go:69: apiserver cert does not include localhost in SAN.
cert_options_test.go:69: apiserver cert does not include www.google.com in SAN.
cert_options_test.go:88: (dbg) Run:  kubectl --context cert-options-850000 config view
cert_options_test.go:93: Kubeconfig apiserver server port incorrect. Output of 
'kubectl config view' = "\n-- stdout --\n\tapiVersion: v1\n\tclusters: null\n\tcontexts: null\n\tcurrent-context: \"\"\n\tkind: Config\n\tpreferences: {}\n\tusers: null\n\n-- /stdout --"
cert_options_test.go:100: (dbg) Run:  out/minikube-darwin-amd64 ssh -p cert-options-850000 -- "sudo cat /etc/kubernetes/admin.conf"
cert_options_test.go:100: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p cert-options-850000 -- "sudo cat /etc/kubernetes/admin.conf": exit status 83 (135.675751ms)

                                                
                                                
-- stdout --
	* The control-plane node cert-options-850000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-850000"

                                                
                                                
-- /stdout --
cert_options_test.go:102: failed to SSH to minikube with args: "out/minikube-darwin-amd64 ssh -p cert-options-850000 -- \"sudo cat /etc/kubernetes/admin.conf\"" : exit status 83
cert_options_test.go:106: Internal minikube kubeconfig (admin.conf) does not contains the right api port. 
-- stdout --
	* The control-plane node cert-options-850000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p cert-options-850000"

                                                
                                                
-- /stdout --
cert_options_test.go:109: *** TestCertOptions FAILED at 2024-03-07 14:09:07.398121 -0800 PST m=+1350.437950946
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p cert-options-850000 -n cert-options-850000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p cert-options-850000 -n cert-options-850000: exit status 7 (72.2006ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-options-850000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-options-850000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-options-850000
--- FAIL: TestCertOptions (13.97s)

                                                
                                    
x
+
TestCertExpiration (204.46s)

                                                
                                                
=== RUN   TestCertExpiration
=== PAUSE TestCertExpiration

                                                
                                                

                                                
                                                
=== CONT  TestCertExpiration
cert_options_test.go:123: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-897000 --memory=2048 --cert-expiration=3m --driver=hyperkit 
cert_options_test.go:123: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-expiration-897000 --memory=2048 --cert-expiration=3m --driver=hyperkit : exit status 60 (13.933206196s)

                                                
                                                
-- stdout --
	* [cert-expiration-897000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "cert-expiration-897000" primary control-plane node in "cert-expiration-897000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "cert-expiration-897000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-897000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:125: failed to start minikube with args: "out/minikube-darwin-amd64 start -p cert-expiration-897000 --memory=2048 --cert-expiration=3m --driver=hyperkit " : exit status 60
cert_options_test.go:131: (dbg) Run:  out/minikube-darwin-amd64 start -p cert-expiration-897000 --memory=2048 --cert-expiration=8760h --driver=hyperkit 
cert_options_test.go:131: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p cert-expiration-897000 --memory=2048 --cert-expiration=8760h --driver=hyperkit : exit status 60 (10.047304051s)

                                                
                                                
-- stdout --
	* [cert-expiration-897000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "cert-expiration-897000" primary control-plane node in "cert-expiration-897000" cluster
	* Restarting existing hyperkit VM for "cert-expiration-897000" ...
	* Restarting existing hyperkit VM for "cert-expiration-897000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-897000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:133: failed to start minikube after cert expiration: "out/minikube-darwin-amd64 start -p cert-expiration-897000 --memory=2048 --cert-expiration=8760h --driver=hyperkit " : exit status 60
cert_options_test.go:136: minikube start output did not warn about expired certs: 
-- stdout --
	* [cert-expiration-897000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "cert-expiration-897000" primary control-plane node in "cert-expiration-897000" cluster
	* Restarting existing hyperkit VM for "cert-expiration-897000" ...
	* Restarting existing hyperkit VM for "cert-expiration-897000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p cert-expiration-897000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
cert_options_test.go:138: *** TestCertExpiration FAILED at 2024-03-07 14:12:06.48725 -0800 PST m=+1529.525834371
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p cert-expiration-897000 -n cert-expiration-897000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p cert-expiration-897000 -n cert-expiration-897000: exit status 7 (76.555973ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "cert-expiration-897000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "cert-expiration-897000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cert-expiration-897000
--- FAIL: TestCertExpiration (204.46s)

                                                
                                    
x
+
TestDockerFlags (15.14s)

                                                
                                                
=== RUN   TestDockerFlags
=== PAUSE TestDockerFlags

                                                
                                                

                                                
                                                
=== CONT  TestDockerFlags
docker_test.go:51: (dbg) Run:  out/minikube-darwin-amd64 start -p docker-flags-094000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:51: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p docker-flags-094000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (14.415919904s)

                                                
                                                
-- stdout --
	* [docker-flags-094000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "docker-flags-094000" primary control-plane node in "docker-flags-094000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "docker-flags-094000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:08:38.684655    4528 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:08:38.684842    4528 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:08:38.684848    4528 out.go:304] Setting ErrFile to fd 2...
	I0307 14:08:38.684852    4528 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:08:38.685028    4528 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:08:38.686447    4528 out.go:298] Setting JSON to false
	I0307 14:08:38.708650    4528 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2289,"bootTime":1709847029,"procs":497,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:08:38.708742    4528 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:08:38.731175    4528 out.go:177] * [docker-flags-094000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:08:38.773463    4528 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:08:38.773521    4528 notify.go:220] Checking for updates...
	I0307 14:08:38.816457    4528 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:08:38.837704    4528 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:08:38.858521    4528 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:08:38.879290    4528 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:08:38.900380    4528 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:08:38.922217    4528 config.go:182] Loaded profile config "force-systemd-flag-929000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:08:38.922404    4528 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:08:38.922558    4528 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:08:38.951255    4528 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:08:38.972378    4528 start.go:297] selected driver: hyperkit
	I0307 14:08:38.972401    4528 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:08:38.972417    4528 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:08:38.975703    4528 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:08:38.975812    4528 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:08:38.983417    4528 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:08:38.987338    4528 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:38.987360    4528 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:08:38.987397    4528 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:08:38.987592    4528 start_flags.go:942] Waiting for no components: map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false]
	I0307 14:08:38.987653    4528 cni.go:84] Creating CNI manager for ""
	I0307 14:08:38.987670    4528 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:08:38.987678    4528 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 14:08:38.987736    4528 start.go:340] cluster config:
	{Name:docker-flags-094000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:
[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientP
ath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:08:38.987821    4528 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:08:39.030448    4528 out.go:177] * Starting "docker-flags-094000" primary control-plane node in "docker-flags-094000" cluster
	I0307 14:08:39.093352    4528 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:08:39.093405    4528 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:08:39.093451    4528 cache.go:56] Caching tarball of preloaded images
	I0307 14:08:39.093607    4528 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:08:39.093618    4528 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:08:39.093710    4528 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/docker-flags-094000/config.json ...
	I0307 14:08:39.093734    4528 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/docker-flags-094000/config.json: {Name:mk7645bde482b0b1a871182468d3df2bf1d6e94f Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:08:39.094091    4528 start.go:360] acquireMachinesLock for docker-flags-094000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:08:41.756225    4528 start.go:364] duration metric: took 2.662072688s to acquireMachinesLock for "docker-flags-094000"
	I0307 14:08:41.756291    4528 start.go:93] Provisioning new machine with config: &{Name:docker-flags-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSH
Key: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountI
P: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:08:41.756383    4528 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:08:41.843714    4528 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 14:08:41.844004    4528 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:41.844119    4528 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:41.853428    4528 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50665
	I0307 14:08:41.853814    4528 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:41.854305    4528 main.go:141] libmachine: Using API Version  1
	I0307 14:08:41.854317    4528 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:41.854533    4528 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:41.854631    4528 main.go:141] libmachine: (docker-flags-094000) Calling .GetMachineName
	I0307 14:08:41.854709    4528 main.go:141] libmachine: (docker-flags-094000) Calling .DriverName
	I0307 14:08:41.854817    4528 start.go:159] libmachine.API.Create for "docker-flags-094000" (driver="hyperkit")
	I0307 14:08:41.854842    4528 client.go:168] LocalClient.Create starting
	I0307 14:08:41.854875    4528 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:08:41.854912    4528 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:41.854927    4528 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:41.854980    4528 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:08:41.855005    4528 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:41.855016    4528 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:41.855028    4528 main.go:141] libmachine: Running pre-create checks...
	I0307 14:08:41.855037    4528 main.go:141] libmachine: (docker-flags-094000) Calling .PreCreateCheck
	I0307 14:08:41.855111    4528 main.go:141] libmachine: (docker-flags-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:41.855266    4528 main.go:141] libmachine: (docker-flags-094000) Calling .GetConfigRaw
	I0307 14:08:41.887217    4528 main.go:141] libmachine: Creating machine...
	I0307 14:08:41.887248    4528 main.go:141] libmachine: (docker-flags-094000) Calling .Create
	I0307 14:08:41.887479    4528 main.go:141] libmachine: (docker-flags-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:41.887723    4528 main.go:141] libmachine: (docker-flags-094000) DBG | I0307 14:08:41.887452    4538 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:08:41.887828    4528 main.go:141] libmachine: (docker-flags-094000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:08:42.253812    4528 main.go:141] libmachine: (docker-flags-094000) DBG | I0307 14:08:42.253759    4538 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/docker-flags-094000/id_rsa...
	I0307 14:08:42.327214    4528 main.go:141] libmachine: (docker-flags-094000) DBG | I0307 14:08:42.327129    4538 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/docker-flags-094000/docker-flags-094000.rawdisk...
	I0307 14:08:42.327228    4528 main.go:141] libmachine: (docker-flags-094000) DBG | Writing magic tar header
	I0307 14:08:42.327241    4528 main.go:141] libmachine: (docker-flags-094000) DBG | Writing SSH key tar header
	I0307 14:08:42.327570    4528 main.go:141] libmachine: (docker-flags-094000) DBG | I0307 14:08:42.327518    4538 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/docker-flags-094000 ...
	I0307 14:08:42.946989    4528 main.go:141] libmachine: (docker-flags-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:42.947007    4528 main.go:141] libmachine: (docker-flags-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/docker-flags-094000/hyperkit.pid
	I0307 14:08:42.947048    4528 main.go:141] libmachine: (docker-flags-094000) DBG | Using UUID 6411ec9f-68eb-481b-a208-4864c8a3d0af
	I0307 14:08:43.036776    4528 main.go:141] libmachine: (docker-flags-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:08:43.036813    4528 client.go:171] duration metric: took 1.18195236s to LocalClient.Create
	I0307 14:08:45.037861    4528 start.go:128] duration metric: took 3.2814331s to createHost
	I0307 14:08:45.037889    4528 start.go:83] releasing machines lock for "docker-flags-094000", held for 3.281618521s
	W0307 14:08:45.037920    4528 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:08:45.038508    4528 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:45.038569    4528 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:45.047969    4528 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50677
	I0307 14:08:45.048364    4528 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:45.048726    4528 main.go:141] libmachine: Using API Version  1
	I0307 14:08:45.048738    4528 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:45.048970    4528 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:45.049352    4528 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:45.049374    4528 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:45.057018    4528 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50679
	I0307 14:08:45.057338    4528 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:45.057696    4528 main.go:141] libmachine: Using API Version  1
	I0307 14:08:45.057715    4528 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:45.057906    4528 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:45.058017    4528 main.go:141] libmachine: (docker-flags-094000) Calling .GetState
	I0307 14:08:45.058095    4528 main.go:141] libmachine: (docker-flags-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:45.058113    4528 main.go:141] libmachine: (docker-flags-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/docker-flags-094000/hyperkit.json: no such file or directory
	I0307 14:08:45.058138    4528 main.go:141] libmachine: (docker-flags-094000) DBG | hyperkit pid from json: 0
	I0307 14:08:45.058157    4528 main.go:141] libmachine: (docker-flags-094000) Calling .DriverName
	I0307 14:08:45.102699    4528 out.go:177] * Deleting "docker-flags-094000" in hyperkit ...
	I0307 14:08:45.123539    4528 main.go:141] libmachine: (docker-flags-094000) Calling .Remove
	I0307 14:08:45.123783    4528 main.go:141] libmachine: (docker-flags-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:45.123806    4528 main.go:141] libmachine: (docker-flags-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:45.123821    4528 main.go:141] libmachine: (docker-flags-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/docker-flags-094000/hyperkit.json: no such file or directory
	I0307 14:08:45.123850    4528 main.go:141] libmachine: (docker-flags-094000) DBG | hyperkit pid from json: 0
	W0307 14:08:45.143810    4528 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:08:45.143825    4528 start.go:728] Will try again in 5 seconds ...
	I0307 14:08:50.144414    4528 start.go:360] acquireMachinesLock for docker-flags-094000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:08:50.144566    4528 start.go:364] duration metric: took 102.226µs to acquireMachinesLock for "docker-flags-094000"
	I0307 14:08:50.144614    4528 start.go:93] Provisioning new machine with config: &{Name:docker-flags-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[FOO=BAR BAZ=BAT] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[debug icc=true] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSH
Key: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:docker-flags-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:false EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:false apps_running:false default_sa:false extra:false kubelet:false node_ready:false system_pods:false] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountI
P: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:08:50.144710    4528 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:08:50.166814    4528 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 14:08:50.166974    4528 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:50.167020    4528 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:50.176177    4528 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50687
	I0307 14:08:50.176541    4528 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:50.176919    4528 main.go:141] libmachine: Using API Version  1
	I0307 14:08:50.176932    4528 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:50.177156    4528 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:50.177271    4528 main.go:141] libmachine: (docker-flags-094000) Calling .GetMachineName
	I0307 14:08:50.177361    4528 main.go:141] libmachine: (docker-flags-094000) Calling .DriverName
	I0307 14:08:50.177470    4528 start.go:159] libmachine.API.Create for "docker-flags-094000" (driver="hyperkit")
	I0307 14:08:50.177498    4528 client.go:168] LocalClient.Create starting
	I0307 14:08:50.177528    4528 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:08:50.177580    4528 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:50.177591    4528 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:50.177629    4528 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:08:50.177665    4528 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:50.177682    4528 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:50.177701    4528 main.go:141] libmachine: Running pre-create checks...
	I0307 14:08:50.177706    4528 main.go:141] libmachine: (docker-flags-094000) Calling .PreCreateCheck
	I0307 14:08:50.177787    4528 main.go:141] libmachine: (docker-flags-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:50.177811    4528 main.go:141] libmachine: (docker-flags-094000) Calling .GetConfigRaw
	I0307 14:08:50.178376    4528 main.go:141] libmachine: Creating machine...
	I0307 14:08:50.178386    4528 main.go:141] libmachine: (docker-flags-094000) Calling .Create
	I0307 14:08:50.178458    4528 main.go:141] libmachine: (docker-flags-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:50.178585    4528 main.go:141] libmachine: (docker-flags-094000) DBG | I0307 14:08:50.178453    4567 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:08:50.178633    4528 main.go:141] libmachine: (docker-flags-094000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:08:50.351227    4528 main.go:141] libmachine: (docker-flags-094000) DBG | I0307 14:08:50.351158    4567 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/docker-flags-094000/id_rsa...
	I0307 14:08:50.454038    4528 main.go:141] libmachine: (docker-flags-094000) DBG | I0307 14:08:50.453964    4567 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/docker-flags-094000/docker-flags-094000.rawdisk...
	I0307 14:08:50.454050    4528 main.go:141] libmachine: (docker-flags-094000) DBG | Writing magic tar header
	I0307 14:08:50.454074    4528 main.go:141] libmachine: (docker-flags-094000) DBG | Writing SSH key tar header
	I0307 14:08:50.454656    4528 main.go:141] libmachine: (docker-flags-094000) DBG | I0307 14:08:50.454610    4567 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/docker-flags-094000 ...
	I0307 14:08:50.811039    4528 main.go:141] libmachine: (docker-flags-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:50.811059    4528 main.go:141] libmachine: (docker-flags-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/docker-flags-094000/hyperkit.pid
	I0307 14:08:50.811069    4528 main.go:141] libmachine: (docker-flags-094000) DBG | Using UUID 5fa717f9-ab8b-449e-95c6-6342eb3927fe
	I0307 14:08:50.847160    4528 main.go:141] libmachine: (docker-flags-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:08:50.847241    4528 client.go:171] duration metric: took 669.730316ms to LocalClient.Create
	I0307 14:08:52.847559    4528 start.go:128] duration metric: took 2.702818008s to createHost
	I0307 14:08:52.847579    4528 start.go:83] releasing machines lock for "docker-flags-094000", held for 2.702983193s
	W0307 14:08:52.847656    4528 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p docker-flags-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p docker-flags-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:08:52.893131    4528 out.go:177] 
	W0307 14:08:52.915042    4528 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:08:52.915096    4528 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:08:52.915111    4528 out.go:239] * Related issues:
	* Related issues:
	W0307 14:08:52.915128    4528 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:08:52.915159    4528 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:08:52.957886    4528 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:53: failed to start minikube with args: "out/minikube-darwin-amd64 start -p docker-flags-094000 --cache-images=false --memory=2048 --install-addons=false --wait=false --docker-env=FOO=BAR --docker-env=BAZ=BAT --docker-opt=debug --docker-opt=icc=true --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:56: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-094000 ssh "sudo systemctl show docker --property=Environment --no-pager"
docker_test.go:56: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p docker-flags-094000 ssh "sudo systemctl show docker --property=Environment --no-pager": exit status 83 (200.921131ms)

                                                
                                                
-- stdout --
	* The control-plane node docker-flags-094000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p docker-flags-094000"

                                                
                                                
-- /stdout --
docker_test.go:58: failed to 'systemctl show docker' inside minikube. args "out/minikube-darwin-amd64 -p docker-flags-094000 ssh \"sudo systemctl show docker --property=Environment --no-pager\"": exit status 83
docker_test.go:63: expected env key/value "FOO=BAR" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-094000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-094000\"\n"*.
docker_test.go:63: expected env key/value "BAZ=BAT" to be passed to minikube's docker and be included in: *"* The control-plane node docker-flags-094000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-094000\"\n"*.
docker_test.go:67: (dbg) Run:  out/minikube-darwin-amd64 -p docker-flags-094000 ssh "sudo systemctl show docker --property=ExecStart --no-pager"
docker_test.go:67: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p docker-flags-094000 ssh "sudo systemctl show docker --property=ExecStart --no-pager": exit status 83 (171.716906ms)

                                                
                                                
-- stdout --
	* The control-plane node docker-flags-094000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p docker-flags-094000"

                                                
                                                
-- /stdout --
docker_test.go:69: failed on the second 'systemctl show docker' inside minikube. args "out/minikube-darwin-amd64 -p docker-flags-094000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"": exit status 83
docker_test.go:73: expected "out/minikube-darwin-amd64 -p docker-flags-094000 ssh \"sudo systemctl show docker --property=ExecStart --no-pager\"" output to have include *--debug* . output: "* The control-plane node docker-flags-094000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p docker-flags-094000\"\n"
panic.go:626: *** TestDockerFlags FAILED at 2024-03-07 14:08:53.41691 -0800 PST m=+1336.456837331
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p docker-flags-094000 -n docker-flags-094000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p docker-flags-094000 -n docker-flags-094000: exit status 7 (74.490206ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "docker-flags-094000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "docker-flags-094000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p docker-flags-094000
--- FAIL: TestDockerFlags (15.14s)

                                                
                                    
x
+
TestForceSystemdFlag (11.7s)

                                                
                                                
=== RUN   TestForceSystemdFlag
=== PAUSE TestForceSystemdFlag

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdFlag
docker_test.go:91: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-flag-929000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:91: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-flag-929000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (11.171739844s)

                                                
                                                
-- stdout --
	* [force-systemd-flag-929000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "force-systemd-flag-929000" primary control-plane node in "force-systemd-flag-929000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "force-systemd-flag-929000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:08:30.858397    4498 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:08:30.858579    4498 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:08:30.858584    4498 out.go:304] Setting ErrFile to fd 2...
	I0307 14:08:30.858588    4498 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:08:30.858776    4498 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:08:30.860220    4498 out.go:298] Setting JSON to false
	I0307 14:08:30.882617    4498 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2281,"bootTime":1709847029,"procs":490,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:08:30.882708    4498 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:08:30.905443    4498 out.go:177] * [force-systemd-flag-929000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:08:30.947094    4498 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:08:30.947124    4498 notify.go:220] Checking for updates...
	I0307 14:08:30.991046    4498 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:08:31.012281    4498 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:08:31.034322    4498 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:08:31.055229    4498 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:08:31.076167    4498 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:08:31.099705    4498 config.go:182] Loaded profile config "force-systemd-env-254000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:08:31.099843    4498 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:08:31.099957    4498 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:08:31.128956    4498 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:08:31.171227    4498 start.go:297] selected driver: hyperkit
	I0307 14:08:31.171262    4498 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:08:31.171281    4498 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:08:31.175365    4498 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:08:31.175467    4498 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:08:31.183160    4498 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:08:31.186991    4498 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:31.187011    4498 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:08:31.187062    4498 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:08:31.187281    4498 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0307 14:08:31.187336    4498 cni.go:84] Creating CNI manager for ""
	I0307 14:08:31.187353    4498 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:08:31.187359    4498 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 14:08:31.187429    4498 start.go:340] cluster config:
	{Name:force-systemd-flag-929000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-929000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:08:31.187506    4498 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:08:31.229297    4498 out.go:177] * Starting "force-systemd-flag-929000" primary control-plane node in "force-systemd-flag-929000" cluster
	I0307 14:08:31.250276    4498 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:08:31.250380    4498 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:08:31.250461    4498 cache.go:56] Caching tarball of preloaded images
	I0307 14:08:31.250623    4498 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:08:31.250637    4498 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:08:31.250736    4498 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/force-systemd-flag-929000/config.json ...
	I0307 14:08:31.250762    4498 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/force-systemd-flag-929000/config.json: {Name:mk899d6fe3a48c1c7055e796c030e06e18b348d8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:08:31.251420    4498 start.go:360] acquireMachinesLock for force-systemd-flag-929000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:08:31.251518    4498 start.go:364] duration metric: took 70.285µs to acquireMachinesLock for "force-systemd-flag-929000"
	I0307 14:08:31.251551    4498 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-929000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-929000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disable
Optimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:08:31.251606    4498 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:08:31.273208    4498 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 14:08:31.273391    4498 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:31.273435    4498 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:31.281329    4498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50645
	I0307 14:08:31.281712    4498 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:31.282151    4498 main.go:141] libmachine: Using API Version  1
	I0307 14:08:31.282160    4498 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:31.282410    4498 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:31.282519    4498 main.go:141] libmachine: (force-systemd-flag-929000) Calling .GetMachineName
	I0307 14:08:31.282602    4498 main.go:141] libmachine: (force-systemd-flag-929000) Calling .DriverName
	I0307 14:08:31.282697    4498 start.go:159] libmachine.API.Create for "force-systemd-flag-929000" (driver="hyperkit")
	I0307 14:08:31.282724    4498 client.go:168] LocalClient.Create starting
	I0307 14:08:31.282758    4498 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:08:31.282811    4498 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:31.282828    4498 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:31.282911    4498 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:08:31.282948    4498 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:31.282959    4498 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:31.282973    4498 main.go:141] libmachine: Running pre-create checks...
	I0307 14:08:31.282983    4498 main.go:141] libmachine: (force-systemd-flag-929000) Calling .PreCreateCheck
	I0307 14:08:31.283064    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:31.283268    4498 main.go:141] libmachine: (force-systemd-flag-929000) Calling .GetConfigRaw
	I0307 14:08:31.294260    4498 main.go:141] libmachine: Creating machine...
	I0307 14:08:31.294271    4498 main.go:141] libmachine: (force-systemd-flag-929000) Calling .Create
	I0307 14:08:31.294385    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:31.294500    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | I0307 14:08:31.294370    4506 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:08:31.294549    4498 main.go:141] libmachine: (force-systemd-flag-929000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:08:31.466299    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | I0307 14:08:31.466244    4506 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-flag-929000/id_rsa...
	I0307 14:08:31.506849    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | I0307 14:08:31.506779    4506 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-flag-929000/force-systemd-flag-929000.rawdisk...
	I0307 14:08:31.506860    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | Writing magic tar header
	I0307 14:08:31.506869    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | Writing SSH key tar header
	I0307 14:08:31.507358    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | I0307 14:08:31.507309    4506 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-flag-929000 ...
	I0307 14:08:31.862284    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:31.862305    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-flag-929000/hyperkit.pid
	I0307 14:08:31.862330    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | Using UUID 43923e5b-12f3-4ca6-95c1-e4b2db45842f
	I0307 14:08:31.897935    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:08:31.898030    4498 client.go:171] duration metric: took 615.292216ms to LocalClient.Create
	I0307 14:08:33.898356    4498 start.go:128] duration metric: took 2.646715815s to createHost
	I0307 14:08:33.898375    4498 start.go:83] releasing machines lock for "force-systemd-flag-929000", held for 2.646829249s
	W0307 14:08:33.898397    4498 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:08:33.898810    4498 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:33.898842    4498 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:33.907152    4498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50647
	I0307 14:08:33.907516    4498 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:33.907850    4498 main.go:141] libmachine: Using API Version  1
	I0307 14:08:33.907865    4498 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:33.908110    4498 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:33.908470    4498 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:33.908492    4498 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:33.916106    4498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50649
	I0307 14:08:33.916435    4498 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:33.916844    4498 main.go:141] libmachine: Using API Version  1
	I0307 14:08:33.916859    4498 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:33.917060    4498 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:33.917172    4498 main.go:141] libmachine: (force-systemd-flag-929000) Calling .GetState
	I0307 14:08:33.917263    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:33.917281    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | hyperkit pid from json: 0
	I0307 14:08:33.917296    4498 main.go:141] libmachine: (force-systemd-flag-929000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-flag-929000/hyperkit.json: no such file or directory
	I0307 14:08:33.917337    4498 main.go:141] libmachine: (force-systemd-flag-929000) Calling .DriverName
	I0307 14:08:33.969732    4498 out.go:177] * Deleting "force-systemd-flag-929000" in hyperkit ...
	I0307 14:08:33.990792    4498 main.go:141] libmachine: (force-systemd-flag-929000) Calling .Remove
	I0307 14:08:33.991083    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:33.991138    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:33.991160    4498 main.go:141] libmachine: (force-systemd-flag-929000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-flag-929000/hyperkit.json: no such file or directory
	I0307 14:08:33.991185    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | hyperkit pid from json: 0
	W0307 14:08:34.007637    4498 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:08:34.007662    4498 start.go:728] Will try again in 5 seconds ...
	I0307 14:08:39.008161    4498 start.go:360] acquireMachinesLock for force-systemd-flag-929000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:08:39.008404    4498 start.go:364] duration metric: took 190.081µs to acquireMachinesLock for "force-systemd-flag-929000"
	I0307 14:08:39.008450    4498 start.go:93] Provisioning new machine with config: &{Name:force-systemd-flag-929000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-flag-929000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: Disable
Optimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:08:39.008561    4498 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:08:39.072513    4498 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 14:08:39.072604    4498 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:39.072641    4498 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:39.080548    4498 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50663
	I0307 14:08:39.080915    4498 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:39.081259    4498 main.go:141] libmachine: Using API Version  1
	I0307 14:08:39.081269    4498 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:39.081498    4498 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:39.081596    4498 main.go:141] libmachine: (force-systemd-flag-929000) Calling .GetMachineName
	I0307 14:08:39.081688    4498 main.go:141] libmachine: (force-systemd-flag-929000) Calling .DriverName
	I0307 14:08:39.081783    4498 start.go:159] libmachine.API.Create for "force-systemd-flag-929000" (driver="hyperkit")
	I0307 14:08:39.081800    4498 client.go:168] LocalClient.Create starting
	I0307 14:08:39.081828    4498 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:08:39.081876    4498 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:39.081889    4498 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:39.081937    4498 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:08:39.081973    4498 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:39.081987    4498 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:39.082000    4498 main.go:141] libmachine: Running pre-create checks...
	I0307 14:08:39.082006    4498 main.go:141] libmachine: (force-systemd-flag-929000) Calling .PreCreateCheck
	I0307 14:08:39.082093    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:39.082103    4498 main.go:141] libmachine: (force-systemd-flag-929000) Calling .GetConfigRaw
	I0307 14:08:39.093615    4498 main.go:141] libmachine: Creating machine...
	I0307 14:08:39.093626    4498 main.go:141] libmachine: (force-systemd-flag-929000) Calling .Create
	I0307 14:08:39.093765    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:39.093930    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | I0307 14:08:39.093730    4536 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:08:39.093996    4498 main.go:141] libmachine: (force-systemd-flag-929000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:08:39.263214    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | I0307 14:08:39.263120    4536 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-flag-929000/id_rsa...
	I0307 14:08:39.360013    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | I0307 14:08:39.359931    4536 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-flag-929000/force-systemd-flag-929000.rawdisk...
	I0307 14:08:39.360024    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | Writing magic tar header
	I0307 14:08:39.360043    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | Writing SSH key tar header
	I0307 14:08:39.360767    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | I0307 14:08:39.360728    4536 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-flag-929000 ...
	I0307 14:08:39.716741    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:39.716759    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-flag-929000/hyperkit.pid
	I0307 14:08:39.716798    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | Using UUID 63b5e475-d00c-4f0a-ad73-2c3aa77eebbc
	I0307 14:08:39.753768    4498 main.go:141] libmachine: (force-systemd-flag-929000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:08:39.753848    4498 client.go:171] duration metric: took 672.036884ms to LocalClient.Create
	I0307 14:08:41.756074    4498 start.go:128] duration metric: took 2.747475895s to createHost
	I0307 14:08:41.756099    4498 start.go:83] releasing machines lock for "force-systemd-flag-929000", held for 2.747660523s
	W0307 14:08:41.756213    4498 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p force-systemd-flag-929000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p force-systemd-flag-929000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:08:41.821934    4498 out.go:177] 
	W0307 14:08:41.864692    4498 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:08:41.864745    4498 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:08:41.864779    4498 out.go:239] * Related issues:
	* Related issues:
	W0307 14:08:41.864802    4498 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:08:41.864832    4498 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:08:41.907617    4498 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:93: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-flag-929000 --memory=2048 --force-systemd --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-flag-929000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p force-systemd-flag-929000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (177.431187ms)

                                                
                                                
-- stdout --
	* The control-plane node force-systemd-flag-929000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p force-systemd-flag-929000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-amd64 -p force-systemd-flag-929000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83
docker_test.go:106: *** TestForceSystemdFlag FAILED at 2024-03-07 14:08:42.151216 -0800 PST m=+1325.191221998
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-flag-929000 -n force-systemd-flag-929000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-flag-929000 -n force-systemd-flag-929000: exit status 7 (74.153497ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-flag-929000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-flag-929000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-flag-929000
--- FAIL: TestForceSystemdFlag (11.70s)

                                                
                                    
x
+
TestForceSystemdEnv (18.06s)

                                                
                                                
=== RUN   TestForceSystemdEnv
=== PAUSE TestForceSystemdEnv

                                                
                                                

                                                
                                                
=== CONT  TestForceSystemdEnv
docker_test.go:155: (dbg) Run:  out/minikube-darwin-amd64 start -p force-systemd-env-254000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit 
docker_test.go:155: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p force-systemd-env-254000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit : exit status 60 (17.580868597s)

                                                
                                                
-- stdout --
	* [force-systemd-env-254000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=true
	* Using the hyperkit driver based on user configuration
	* Downloading driver docker-machine-driver-hyperkit:
	* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:
	
	    $ sudo chown root:wheel /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit 
	    $ sudo chmod u+s /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit 
	
	
	* Starting "force-systemd-env-254000" primary control-plane node in "force-systemd-env-254000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "force-systemd-env-254000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:08:20.629364    4455 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:08:20.629566    4455 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:08:20.629572    4455 out.go:304] Setting ErrFile to fd 2...
	I0307 14:08:20.629576    4455 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:08:20.629756    4455 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:08:20.631155    4455 out.go:298] Setting JSON to false
	I0307 14:08:20.653408    4455 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2271,"bootTime":1709847029,"procs":491,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:08:20.653515    4455 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:08:20.675371    4455 out.go:177] * [force-systemd-env-254000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:08:20.743602    4455 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:08:20.718424    4455 notify.go:220] Checking for updates...
	I0307 14:08:20.786046    4455 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:08:20.807268    4455 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:08:20.828180    4455 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:08:20.849012    4455 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:08:20.870249    4455 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=true
	I0307 14:08:20.892093    4455 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:08:20.892211    4455 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:08:20.921159    4455 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:08:20.964287    4455 start.go:297] selected driver: hyperkit
	I0307 14:08:20.964309    4455 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:08:20.964324    4455 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:08:20.967518    4455 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:08:24.272578    4455 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/testdata/hyperkit-driver-without-version:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	W0307 14:08:24.286062    4455 install.go:62] docker-machine-driver-hyperkit: exit status 1
	I0307 14:08:24.307670    4455 out.go:177] * Downloading driver docker-machine-driver-hyperkit:
	I0307 14:08:24.349787    4455 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64.sha256 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:24.771213    4455 driver.go:46] failed to download arch specific driver: getter: &{Ctx:context.Background Src:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit-amd64.sha256 Dst:/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit.download Pwd: Mode:2 Umask:---------- Detectors:[0xbed1f80 0xbed1f80 0xbed1f80 0xbed1f80 0xbed1f80 0xbed1f80 0xbed1f80] Decompressors:map[bz2:0xc0005927b0 gz:0xc0005927b8 tar:0xc000592740 tar.bz2:0xc000592760 tar.gz:0xc000592770 tar.xz:0xc000592780 tar.zst:0xc0005927a0 tbz2:0xc000592760 tgz:0xc000592770 txz:0xc000592780 tzst:0xc0005927a0 xz:0xc0005927c0 zip:0xc0005927e0 zst:0xc0005927c8] Getters:map[file:0xc0006445d0 http:0xc000652230 https:0xc000652280] Dir:false ProgressListener:<nil> Insecure:false DisableSymlinks:false Options:[]}: invalid checksum: Error downlo
ading checksum file: bad response code: 404. trying to get the common version
	I0307 14:08:24.771285    4455 download.go:107] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.32.0/docker-machine-driver-hyperkit.sha256 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:26.877415    4455 install.go:79] stdout: 
	I0307 14:08:26.901235    4455 out.go:177] * The 'hyperkit' driver requires elevated permissions. The following commands will be executed:
	
	    $ sudo chown root:wheel /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit 
	    $ sudo chmod u+s /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit 
	
	
	I0307 14:08:26.921809    4455 install.go:99] testing: [sudo -n chown root:wheel /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit]
	I0307 14:08:26.938335    4455 install.go:106] running: [sudo chown root:wheel /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit]
	I0307 14:08:26.953585    4455 install.go:99] testing: [sudo -n chmod u+s /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit]
	I0307 14:08:26.967547    4455 install.go:106] running: [sudo chmod u+s /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit]
	I0307 14:08:26.981673    4455 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:08:26.981956    4455 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0307 14:08:26.982003    4455 cni.go:84] Creating CNI manager for ""
	I0307 14:08:26.982024    4455 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:08:26.982031    4455 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 14:08:26.982090    4455 start.go:340] cluster config:
	{Name:force-systemd-env-254000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-254000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluste
r.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:08:26.982175    4455 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:08:27.003997    4455 out.go:177] * Starting "force-systemd-env-254000" primary control-plane node in "force-systemd-env-254000" cluster
	I0307 14:08:27.025756    4455 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:08:27.025789    4455 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:08:27.025810    4455 cache.go:56] Caching tarball of preloaded images
	I0307 14:08:27.025928    4455 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:08:27.025938    4455 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:08:27.026064    4455 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/force-systemd-env-254000/config.json ...
	I0307 14:08:27.026095    4455 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/force-systemd-env-254000/config.json: {Name:mk0febd4315142f5b0810254c77b2a617ac56f0c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:08:27.026422    4455 start.go:360] acquireMachinesLock for force-systemd-env-254000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:08:27.026508    4455 start.go:364] duration metric: took 70.692µs to acquireMachinesLock for "force-systemd-env-254000"
	I0307 14:08:27.026543    4455 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-254000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-254000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOp
timizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:08:27.026612    4455 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:08:27.047742    4455 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 14:08:27.047873    4455 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:27.047920    4455 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:27.377613    4455 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50629
	I0307 14:08:27.377962    4455 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:27.378412    4455 main.go:141] libmachine: Using API Version  1
	I0307 14:08:27.378428    4455 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:27.378634    4455 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:27.378792    4455 main.go:141] libmachine: (force-systemd-env-254000) Calling .GetMachineName
	I0307 14:08:27.378888    4455 main.go:141] libmachine: (force-systemd-env-254000) Calling .DriverName
	I0307 14:08:27.378981    4455 start.go:159] libmachine.API.Create for "force-systemd-env-254000" (driver="hyperkit")
	I0307 14:08:27.379009    4455 client.go:168] LocalClient.Create starting
	I0307 14:08:27.379037    4455 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:08:27.379090    4455 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:27.379108    4455 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:27.379171    4455 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:08:27.379207    4455 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:27.379217    4455 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:27.379235    4455 main.go:141] libmachine: Running pre-create checks...
	I0307 14:08:27.379246    4455 main.go:141] libmachine: (force-systemd-env-254000) Calling .PreCreateCheck
	I0307 14:08:27.379320    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:27.379464    4455 main.go:141] libmachine: (force-systemd-env-254000) Calling .GetConfigRaw
	I0307 14:08:27.379878    4455 main.go:141] libmachine: Creating machine...
	I0307 14:08:27.379887    4455 main.go:141] libmachine: (force-systemd-env-254000) Calling .Create
	I0307 14:08:27.379959    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:27.380067    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | I0307 14:08:27.379947    4485 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:08:27.380115    4455 main.go:141] libmachine: (force-systemd-env-254000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:08:27.552000    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | I0307 14:08:27.551940    4485 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-env-254000/id_rsa...
	I0307 14:08:27.685611    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | I0307 14:08:27.685534    4485 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-env-254000/force-systemd-env-254000.rawdisk...
	I0307 14:08:27.685624    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | Writing magic tar header
	I0307 14:08:27.685634    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | Writing SSH key tar header
	I0307 14:08:27.686243    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | I0307 14:08:27.686205    4485 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-env-254000 ...
	I0307 14:08:28.044693    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:28.044720    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-env-254000/hyperkit.pid
	I0307 14:08:28.044743    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | Using UUID 0367bc51-1089-4634-a90c-903e9f4254e1
	I0307 14:08:28.078369    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:08:28.078461    4455 client.go:171] duration metric: took 699.437911ms to LocalClient.Create
	I0307 14:08:30.079954    4455 start.go:128] duration metric: took 3.053302434s to createHost
	I0307 14:08:30.079970    4455 start.go:83] releasing machines lock for "force-systemd-env-254000", held for 3.05343092s
	W0307 14:08:30.080002    4455 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:08:30.080286    4455 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:30.080310    4455 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:30.088373    4455 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50640
	I0307 14:08:30.088698    4455 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:30.089056    4455 main.go:141] libmachine: Using API Version  1
	I0307 14:08:30.089074    4455 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:30.089271    4455 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:30.089598    4455 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:30.089622    4455 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:30.097714    4455 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50642
	I0307 14:08:30.098034    4455 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:30.098364    4455 main.go:141] libmachine: Using API Version  1
	I0307 14:08:30.098376    4455 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:30.098589    4455 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:30.098682    4455 main.go:141] libmachine: (force-systemd-env-254000) Calling .GetState
	I0307 14:08:30.098759    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:30.098781    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | hyperkit pid from json: 0
	I0307 14:08:30.098795    4455 main.go:141] libmachine: (force-systemd-env-254000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-env-254000/hyperkit.json: no such file or directory
	I0307 14:08:30.098861    4455 main.go:141] libmachine: (force-systemd-env-254000) Calling .DriverName
	I0307 14:08:30.151107    4455 out.go:177] * Deleting "force-systemd-env-254000" in hyperkit ...
	I0307 14:08:30.172160    4455 main.go:141] libmachine: (force-systemd-env-254000) Calling .Remove
	I0307 14:08:30.172297    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:30.172309    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:30.172332    4455 main.go:141] libmachine: (force-systemd-env-254000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-env-254000/hyperkit.json: no such file or directory
	I0307 14:08:30.172344    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | hyperkit pid from json: 0
	W0307 14:08:30.188213    4455 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:08:30.188226    4455 start.go:728] Will try again in 5 seconds ...
	I0307 14:08:35.190380    4455 start.go:360] acquireMachinesLock for force-systemd-env-254000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:08:35.190593    4455 start.go:364] duration metric: took 173.834µs to acquireMachinesLock for "force-systemd-env-254000"
	I0307 14:08:35.190640    4455 start.go:93] Provisioning new machine with config: &{Name:force-systemd-env-254000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2048 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kubernet
esConfig:{KubernetesVersion:v1.28.4 ClusterName:force-systemd-env-254000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOp
timizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:08:35.190732    4455 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:08:35.213608    4455 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	I0307 14:08:35.213811    4455 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:08:35.213856    4455 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:08:35.223341    4455 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50651
	I0307 14:08:35.223715    4455 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:08:35.224068    4455 main.go:141] libmachine: Using API Version  1
	I0307 14:08:35.224087    4455 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:08:35.224323    4455 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:08:35.224448    4455 main.go:141] libmachine: (force-systemd-env-254000) Calling .GetMachineName
	I0307 14:08:35.224536    4455 main.go:141] libmachine: (force-systemd-env-254000) Calling .DriverName
	I0307 14:08:35.224650    4455 start.go:159] libmachine.API.Create for "force-systemd-env-254000" (driver="hyperkit")
	I0307 14:08:35.224673    4455 client.go:168] LocalClient.Create starting
	I0307 14:08:35.224700    4455 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:08:35.224769    4455 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:35.224780    4455 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:35.224826    4455 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:08:35.224862    4455 main.go:141] libmachine: Decoding PEM data...
	I0307 14:08:35.224879    4455 main.go:141] libmachine: Parsing certificate...
	I0307 14:08:35.224892    4455 main.go:141] libmachine: Running pre-create checks...
	I0307 14:08:35.224898    4455 main.go:141] libmachine: (force-systemd-env-254000) Calling .PreCreateCheck
	I0307 14:08:35.224978    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:35.225013    4455 main.go:141] libmachine: (force-systemd-env-254000) Calling .GetConfigRaw
	I0307 14:08:35.225502    4455 main.go:141] libmachine: Creating machine...
	I0307 14:08:35.225509    4455 main.go:141] libmachine: (force-systemd-env-254000) Calling .Create
	I0307 14:08:35.225577    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:35.225693    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | I0307 14:08:35.225568    4512 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:08:35.225763    4455 main.go:141] libmachine: (force-systemd-env-254000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:08:35.395909    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | I0307 14:08:35.395850    4512 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-env-254000/id_rsa...
	I0307 14:08:35.531281    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | I0307 14:08:35.531194    4512 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-env-254000/force-systemd-env-254000.rawdisk...
	I0307 14:08:35.531297    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | Writing magic tar header
	I0307 14:08:35.531307    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | Writing SSH key tar header
	I0307 14:08:35.532090    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | I0307 14:08:35.531994    4512 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-env-254000 ...
	I0307 14:08:35.944620    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:08:35.944638    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/force-systemd-env-254000/hyperkit.pid
	I0307 14:08:35.944673    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | Using UUID a01d942d-eeb1-4770-89ca-a680c65478cd
	I0307 14:08:35.979932    4455 main.go:141] libmachine: (force-systemd-env-254000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:08:35.980010    4455 client.go:171] duration metric: took 755.324317ms to LocalClient.Create
	I0307 14:08:37.980386    4455 start.go:128] duration metric: took 2.789619277s to createHost
	I0307 14:08:37.980417    4455 start.go:83] releasing machines lock for "force-systemd-env-254000", held for 2.789783811s
	W0307 14:08:37.980548    4455 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p force-systemd-env-254000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p force-systemd-env-254000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:08:38.022762    4455 out.go:177] 
	W0307 14:08:38.045209    4455 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:08:38.045291    4455 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:08:38.045339    4455 out.go:239] * Related issues:
	* Related issues:
	W0307 14:08:38.045380    4455 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:08:38.045414    4455 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:08:38.087803    4455 out.go:177] 

                                                
                                                
** /stderr **
docker_test.go:157: failed to start minikube with args: "out/minikube-darwin-amd64 start -p force-systemd-env-254000 --memory=2048 --alsologtostderr -v=5 --driver=hyperkit " : exit status 60
docker_test.go:110: (dbg) Run:  out/minikube-darwin-amd64 -p force-systemd-env-254000 ssh "docker info --format {{.CgroupDriver}}"
docker_test.go:110: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p force-systemd-env-254000 ssh "docker info --format {{.CgroupDriver}}": exit status 83 (138.122157ms)

                                                
                                                
-- stdout --
	* The control-plane node force-systemd-env-254000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p force-systemd-env-254000"

                                                
                                                
-- /stdout --
docker_test.go:112: failed to get docker cgroup driver. args "out/minikube-darwin-amd64 -p force-systemd-env-254000 ssh \"docker info --format {{.CgroupDriver}}\"": exit status 83
docker_test.go:166: *** TestForceSystemdEnv FAILED at 2024-03-07 14:08:38.29272 -0800 PST m=+1321.332752272
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-254000 -n force-systemd-env-254000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p force-systemd-env-254000 -n force-systemd-env-254000: exit status 7 (72.205991ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "force-systemd-env-254000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "force-systemd-env-254000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p force-systemd-env-254000
--- FAIL: TestForceSystemdEnv (18.06s)

                                                
                                    
x
+
TestErrorSpam/setup (11.25s)

                                                
                                                
=== RUN   TestErrorSpam/setup
error_spam_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -p nospam-536000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 --driver=hyperkit 
error_spam_test.go:81: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p nospam-536000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 --driver=hyperkit : exit status 60 (11.254039823s)

                                                
                                                
-- stdout --
	* [nospam-536000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "nospam-536000" primary control-plane node in "nospam-536000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
	* Deleting "nospam-536000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p nospam-536000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
error_spam_test.go:83: "out/minikube-darwin-amd64 start -p nospam-536000 -n=1 --memory=2250 --wait=false --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 --driver=hyperkit " failed: exit status 60
error_spam_test.go:96: unexpected stderr: "! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "* Failed to start hyperkit VM. Running \"minikube delete -p nospam-536000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
error_spam_test.go:96: unexpected stderr: "* Suggestion: "
error_spam_test.go:96: unexpected stderr: "    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing."
error_spam_test.go:96: unexpected stderr: "    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver."
error_spam_test.go:96: unexpected stderr: "* Related issues:"
error_spam_test.go:96: unexpected stderr: "  - https://github.com/kubernetes/minikube/issues/6028"
error_spam_test.go:96: unexpected stderr: "  - https://github.com/kubernetes/minikube/issues/5594"
error_spam_test.go:110: minikube stdout:
* [nospam-536000] minikube v1.32.0 on Darwin 14.3.1
- MINIKUBE_LOCATION=18320
- KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the hyperkit driver based on user configuration
* Starting "nospam-536000" primary control-plane node in "nospam-536000" cluster
* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...
* Deleting "nospam-536000" in hyperkit ...
* Creating hyperkit VM (CPUs=2, Memory=2250MB, Disk=20000MB) ...

                                                
                                                

                                                
                                                
error_spam_test.go:111: minikube stderr:
! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Failed to start hyperkit VM. Running "minikube delete -p nospam-536000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
* Related issues:
- https://github.com/kubernetes/minikube/issues/6028
- https://github.com/kubernetes/minikube/issues/5594
error_spam_test.go:121: missing kubeadm init sub-step "Generating certificates and keys ..."
error_spam_test.go:121: missing kubeadm init sub-step "Booting up control plane ..."
error_spam_test.go:121: missing kubeadm init sub-step "Configuring RBAC rules ..."
--- FAIL: TestErrorSpam/setup (11.25s)

                                                
                                    
x
+
TestFunctional/serial/StartWithProxy (11.29s)

                                                
                                                
=== RUN   TestFunctional/serial/StartWithProxy
functional_test.go:2230: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-550000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit 
functional_test.go:2230: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-550000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit : exit status 60 (11.216672711s)

                                                
                                                
-- stdout --
	* [functional-550000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "functional-550000" primary control-plane node in "functional-550000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	* Deleting "functional-550000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! Local proxy ignored: not passing HTTP_PROXY=localhost:49761 to docker env.
	! Local proxy ignored: not passing HTTP_PROXY=localhost:49761 to docker env.
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! Local proxy ignored: not passing HTTP_PROXY=localhost:49761 to docker env.
	* Failed to start hyperkit VM. Running "minikube delete -p functional-550000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
functional_test.go:2232: failed minikube start. args "out/minikube-darwin-amd64 start -p functional-550000 --memory=4000 --apiserver-port=8441 --wait=all --driver=hyperkit ": exit status 60
functional_test.go:2237: start stdout=* [functional-550000] minikube v1.32.0 on Darwin 14.3.1
- MINIKUBE_LOCATION=18320
- KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
- MINIKUBE_FORCE_SYSTEMD=
* Using the hyperkit driver based on user configuration
* Starting "functional-550000" primary control-plane node in "functional-550000" cluster
* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...
* Deleting "functional-550000" in hyperkit ...
* Creating hyperkit VM (CPUs=2, Memory=4000MB, Disk=20000MB) ...

                                                
                                                

                                                
                                                
, want: *Found network options:*
functional_test.go:2242: start stderr=! Local proxy ignored: not passing HTTP_PROXY=localhost:49761 to docker env.
! Local proxy ignored: not passing HTTP_PROXY=localhost:49761 to docker env.
! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
! Local proxy ignored: not passing HTTP_PROXY=localhost:49761 to docker env.
* Failed to start hyperkit VM. Running "minikube delete -p functional-550000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
* Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
* Related issues:
- https://github.com/kubernetes/minikube/issues/6028
- https://github.com/kubernetes/minikube/issues/5594
, want: *You appear to be using a proxy*
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (74.734141ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/StartWithProxy (11.29s)

                                                
                                    
x
+
TestFunctional/serial/SoftStart (5.86s)

                                                
                                                
=== RUN   TestFunctional/serial/SoftStart
functional_test.go:655: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-550000 --alsologtostderr -v=8
functional_test.go:655: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-550000 --alsologtostderr -v=8: exit status 60 (5.766560597s)

                                                
                                                
-- stdout --
	* [functional-550000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "functional-550000" primary control-plane node in "functional-550000" cluster
	* Restarting existing hyperkit VM for "functional-550000" ...
	* Restarting existing hyperkit VM for "functional-550000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 13:57:30.943724    2646 out.go:291] Setting OutFile to fd 1 ...
	I0307 13:57:30.943898    2646 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:57:30.943902    2646 out.go:304] Setting ErrFile to fd 2...
	I0307 13:57:30.943906    2646 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:57:30.944088    2646 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 13:57:30.945601    2646 out.go:298] Setting JSON to false
	I0307 13:57:30.969367    2646 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1621,"bootTime":1709847029,"procs":502,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 13:57:30.969505    2646 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 13:57:30.991112    2646 out.go:177] * [functional-550000] minikube v1.32.0 on Darwin 14.3.1
	I0307 13:57:31.033831    2646 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 13:57:31.033873    2646 notify.go:220] Checking for updates...
	I0307 13:57:31.077605    2646 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 13:57:31.098535    2646 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 13:57:31.119645    2646 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 13:57:31.161572    2646 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 13:57:31.182429    2646 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 13:57:31.204385    2646 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 13:57:31.204574    2646 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 13:57:31.205239    2646 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:57:31.205317    2646 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 13:57:31.214396    2646 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49779
	I0307 13:57:31.214725    2646 main.go:141] libmachine: () Calling .GetVersion
	I0307 13:57:31.215143    2646 main.go:141] libmachine: Using API Version  1
	I0307 13:57:31.215152    2646 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 13:57:31.215390    2646 main.go:141] libmachine: () Calling .GetMachineName
	I0307 13:57:31.215496    2646 main.go:141] libmachine: (functional-550000) Calling .DriverName
	I0307 13:57:31.243578    2646 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 13:57:31.285756    2646 start.go:297] selected driver: hyperkit
	I0307 13:57:31.285784    2646 start.go:901] validating driver "hyperkit" against &{Name:functional-550000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-550000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 13:57:31.285972    2646 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 13:57:31.286161    2646 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 13:57:31.286336    2646 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 13:57:31.295364    2646 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 13:57:31.299069    2646 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:57:31.299089    2646 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 13:57:31.301695    2646 cni.go:84] Creating CNI manager for ""
	I0307 13:57:31.301719    2646 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 13:57:31.301784    2646 start.go:340] cluster config:
	{Name:functional-550000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-550000 Namespace:default APISe
rverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disa
bleMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 13:57:31.301883    2646 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 13:57:31.343703    2646 out.go:177] * Starting "functional-550000" primary control-plane node in "functional-550000" cluster
	I0307 13:57:31.364762    2646 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 13:57:31.364833    2646 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 13:57:31.364860    2646 cache.go:56] Caching tarball of preloaded images
	I0307 13:57:31.365034    2646 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 13:57:31.365052    2646 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 13:57:31.365201    2646 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/functional-550000/config.json ...
	I0307 13:57:31.366000    2646 start.go:360] acquireMachinesLock for functional-550000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 13:57:31.366101    2646 start.go:364] duration metric: took 77.551µs to acquireMachinesLock for "functional-550000"
	I0307 13:57:31.366136    2646 start.go:96] Skipping create...Using existing machine configuration
	I0307 13:57:31.366153    2646 fix.go:54] fixHost starting: 
	I0307 13:57:31.366570    2646 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:57:31.366607    2646 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 13:57:31.376030    2646 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49781
	I0307 13:57:31.376406    2646 main.go:141] libmachine: () Calling .GetVersion
	I0307 13:57:31.376815    2646 main.go:141] libmachine: Using API Version  1
	I0307 13:57:31.376833    2646 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 13:57:31.377038    2646 main.go:141] libmachine: () Calling .GetMachineName
	I0307 13:57:31.377155    2646 main.go:141] libmachine: (functional-550000) Calling .DriverName
	I0307 13:57:31.377259    2646 main.go:141] libmachine: (functional-550000) Calling .GetState
	I0307 13:57:31.377334    2646 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 13:57:31.377368    2646 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
	I0307 13:57:31.377388    2646 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
	I0307 13:57:31.377407    2646 fix.go:112] recreateIfNeeded on functional-550000: state=Stopped err=<nil>
	I0307 13:57:31.377420    2646 main.go:141] libmachine: (functional-550000) Calling .DriverName
	W0307 13:57:31.377499    2646 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 13:57:31.398785    2646 out.go:177] * Restarting existing hyperkit VM for "functional-550000" ...
	I0307 13:57:31.440816    2646 main.go:141] libmachine: (functional-550000) Calling .Start
	I0307 13:57:31.441085    2646 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 13:57:31.441112    2646 main.go:141] libmachine: (functional-550000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.pid
	I0307 13:57:31.441149    2646 main.go:141] libmachine: (functional-550000) DBG | Using UUID c4e81114-816f-463b-971e-0678710887f5
	I0307 13:57:31.442929    2646 main.go:141] libmachine: (functional-550000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 13:57:31.443051    2646 fix.go:56] duration metric: took 76.899093ms for fixHost
	I0307 13:57:31.443065    2646 start.go:83] releasing machines lock for "functional-550000", held for 76.950695ms
	W0307 13:57:31.443086    2646 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 13:57:31.443157    2646 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 13:57:31.443166    2646 start.go:728] Will try again in 5 seconds ...
	I0307 13:57:36.445424    2646 start.go:360] acquireMachinesLock for functional-550000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 13:57:36.445630    2646 start.go:364] duration metric: took 170.798µs to acquireMachinesLock for "functional-550000"
	I0307 13:57:36.445663    2646 start.go:96] Skipping create...Using existing machine configuration
	I0307 13:57:36.445669    2646 fix.go:54] fixHost starting: 
	I0307 13:57:36.446050    2646 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:57:36.446086    2646 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 13:57:36.454833    2646 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49783
	I0307 13:57:36.455173    2646 main.go:141] libmachine: () Calling .GetVersion
	I0307 13:57:36.455488    2646 main.go:141] libmachine: Using API Version  1
	I0307 13:57:36.455504    2646 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 13:57:36.455737    2646 main.go:141] libmachine: () Calling .GetMachineName
	I0307 13:57:36.455840    2646 main.go:141] libmachine: (functional-550000) Calling .DriverName
	I0307 13:57:36.455925    2646 main.go:141] libmachine: (functional-550000) Calling .GetState
	I0307 13:57:36.456002    2646 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 13:57:36.456029    2646 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
	I0307 13:57:36.456036    2646 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
	I0307 13:57:36.456049    2646 fix.go:112] recreateIfNeeded on functional-550000: state=Stopped err=<nil>
	I0307 13:57:36.456061    2646 main.go:141] libmachine: (functional-550000) Calling .DriverName
	W0307 13:57:36.456138    2646 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 13:57:36.477469    2646 out.go:177] * Restarting existing hyperkit VM for "functional-550000" ...
	I0307 13:57:36.499245    2646 main.go:141] libmachine: (functional-550000) Calling .Start
	I0307 13:57:36.499524    2646 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 13:57:36.499628    2646 main.go:141] libmachine: (functional-550000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.pid
	I0307 13:57:36.499670    2646 main.go:141] libmachine: (functional-550000) DBG | Using UUID c4e81114-816f-463b-971e-0678710887f5
	I0307 13:57:36.501501    2646 main.go:141] libmachine: (functional-550000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 13:57:36.501599    2646 fix.go:56] duration metric: took 55.928078ms for fixHost
	I0307 13:57:36.501609    2646 start.go:83] releasing machines lock for "functional-550000", held for 55.963767ms
	W0307 13:57:36.501704    2646 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-550000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p functional-550000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 13:57:36.544148    2646 out.go:177] 
	W0307 13:57:36.567079    2646 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 13:57:36.567118    2646 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 13:57:36.567127    2646 out.go:239] * Related issues:
	* Related issues:
	W0307 13:57:36.567145    2646 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 13:57:36.567160    2646 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 13:57:36.588345    2646 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:657: failed to soft start minikube. args "out/minikube-darwin-amd64 start -p functional-550000 --alsologtostderr -v=8": exit status 60
functional_test.go:659: soft start took 5.767971586s for "functional-550000" cluster.
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (74.190563ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/SoftStart (5.86s)

                                                
                                    
x
+
TestFunctional/serial/KubeContext (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/KubeContext
functional_test.go:677: (dbg) Run:  kubectl config current-context
functional_test.go:677: (dbg) Non-zero exit: kubectl config current-context: exit status 1 (36.869531ms)

                                                
                                                
** stderr ** 
	error: current-context is not set

                                                
                                                
** /stderr **
functional_test.go:679: failed to get current-context. args "kubectl config current-context" : exit status 1
functional_test.go:683: expected current-context = "functional-550000", but got *""*
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (72.519415ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/KubeContext (0.11s)

                                                
                                    
x
+
TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/KubectlGetPods
functional_test.go:692: (dbg) Run:  kubectl --context functional-550000 get po -A
functional_test.go:692: (dbg) Non-zero exit: kubectl --context functional-550000 get po -A: exit status 1 (36.457097ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-550000

                                                
                                                
** /stderr **
functional_test.go:694: failed to get kubectl pods: args "kubectl --context functional-550000 get po -A" : exit status 1
functional_test.go:698: expected stderr to be empty but got *"Error in configuration: context was not found for specified context: functional-550000\n"*: args "kubectl --context functional-550000 get po -A"
functional_test.go:701: expected stdout to include *kube-system* but got *""*. args: "kubectl --context functional-550000 get po -A"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (72.729373ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/KubectlGetPods (0.11s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.14s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node
functional_test.go:1120: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh sudo crictl images
functional_test.go:1120: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh sudo crictl images: exit status 83 (139.660107ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1122: failed to get images by "out/minikube-darwin-amd64 -p functional-550000 ssh sudo crictl images" ssh exit status 83
functional_test.go:1126: expected sha for pause:3.3 "0184c1613d929" to be in the output but got *
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --*
--- FAIL: TestFunctional/serial/CacheCmd/cache/verify_cache_inside_node (0.14s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/cache_reload (0.55s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/cache_reload
functional_test.go:1143: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh sudo docker rmi registry.k8s.io/pause:latest
functional_test.go:1143: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh sudo docker rmi registry.k8s.io/pause:latest: exit status 83 (136.114348ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1146: failed to manually delete image "out/minikube-darwin-amd64 -p functional-550000 ssh sudo docker rmi registry.k8s.io/pause:latest" : exit status 83
functional_test.go:1149: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1149: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 83 (158.602432ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1154: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 cache reload
functional_test.go:1159: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh sudo crictl inspecti registry.k8s.io/pause:latest
functional_test.go:1159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh sudo crictl inspecti registry.k8s.io/pause:latest: exit status 83 (159.638844ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1161: expected "out/minikube-darwin-amd64 -p functional-550000 ssh sudo crictl inspecti registry.k8s.io/pause:latest" to run successfully but got error: exit status 83
--- FAIL: TestFunctional/serial/CacheCmd/cache/cache_reload (0.55s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmd (0.55s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmd
functional_test.go:712: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 kubectl -- --context functional-550000 get pods
functional_test.go:712: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 kubectl -- --context functional-550000 get pods: exit status 1 (475.001266ms)

                                                
                                                
** stderr ** 
	Error in configuration: 
	* context was not found for specified context: functional-550000
	* no server found for cluster "functional-550000"

                                                
                                                
** /stderr **
functional_test.go:715: failed to get pods. args "out/minikube-darwin-amd64 -p functional-550000 kubectl -- --context functional-550000 get pods": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (72.801263ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/MinikubeKubectlCmd (0.55s)

                                                
                                    
x
+
TestFunctional/serial/MinikubeKubectlCmdDirectly (0.72s)

                                                
                                                
=== RUN   TestFunctional/serial/MinikubeKubectlCmdDirectly
functional_test.go:737: (dbg) Run:  out/kubectl --context functional-550000 get pods
functional_test.go:737: (dbg) Non-zero exit: out/kubectl --context functional-550000 get pods: exit status 1 (644.880241ms)

                                                
                                                
** stderr ** 
	Error in configuration: 
	* context was not found for specified context: functional-550000
	* no server found for cluster "functional-550000"

                                                
                                                
** /stderr **
functional_test.go:740: failed to run kubectl directly. args "out/kubectl --context functional-550000 get pods": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (72.067577ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/MinikubeKubectlCmdDirectly (0.72s)

                                                
                                    
x
+
TestFunctional/serial/ExtraConfig (5.88s)

                                                
                                                
=== RUN   TestFunctional/serial/ExtraConfig
functional_test.go:753: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-550000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all
functional_test.go:753: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-550000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all: exit status 60 (5.804728882s)

                                                
                                                
-- stdout --
	* [functional-550000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "functional-550000" primary control-plane node in "functional-550000" cluster
	* Restarting existing hyperkit VM for "functional-550000" ...
	* Restarting existing hyperkit VM for "functional-550000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p functional-550000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
functional_test.go:755: failed to restart minikube. args "out/minikube-darwin-amd64 start -p functional-550000 --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision --wait=all": exit status 60
functional_test.go:757: restart took 5.805016132s for "functional-550000" cluster.
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (74.317867ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/ExtraConfig (5.88s)

                                                
                                    
x
+
TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                                
=== RUN   TestFunctional/serial/ComponentHealth
functional_test.go:806: (dbg) Run:  kubectl --context functional-550000 get po -l tier=control-plane -n kube-system -o=json
functional_test.go:806: (dbg) Non-zero exit: kubectl --context functional-550000 get po -l tier=control-plane -n kube-system -o=json: exit status 1 (37.126787ms)

                                                
                                                
** stderr ** 
	error: context "functional-550000" does not exist

                                                
                                                
** /stderr **
functional_test.go:808: failed to get components. args "kubectl --context functional-550000 get po -l tier=control-plane -n kube-system -o=json": exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (73.512925ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/serial/ComponentHealth (0.11s)

                                                
                                    
x
+
TestFunctional/serial/LogsCmd (0.32s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsCmd
functional_test.go:1232: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 logs
functional_test.go:1232: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 logs: exit status 83 (315.11226ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| delete  | -p download-only-609000                                                                     | download-only-609000 | jenkins | v1.32.0 | 07 Mar 24 13:49 PST | 07 Mar 24 13:49 PST |
	| start   | --download-only -p                                                                          | binary-mirror-671000 | jenkins | v1.32.0 | 07 Mar 24 13:49 PST |                     |
	|         | binary-mirror-671000                                                                        |                      |         |         |                     |                     |
	|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |
	|         | --binary-mirror                                                                             |                      |         |         |                     |                     |
	|         | http://127.0.0.1:49358                                                                      |                      |         |         |                     |                     |
	|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
	| delete  | -p binary-mirror-671000                                                                     | binary-mirror-671000 | jenkins | v1.32.0 | 07 Mar 24 13:49 PST | 07 Mar 24 13:49 PST |
	| addons  | enable dashboard -p                                                                         | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:49 PST |                     |
	|         | addons-925000                                                                               |                      |         |         |                     |                     |
	| addons  | disable dashboard -p                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:49 PST |                     |
	|         | addons-925000                                                                               |                      |         |         |                     |                     |
	| start   | -p addons-925000 --wait=true                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:49 PST | 07 Mar 24 13:54 PST |
	|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |
	|         | --addons=registry                                                                           |                      |         |         |                     |                     |
	|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |
	|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |
	|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |
	|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |
	|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |
	|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |
	|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |
	|         | --addons=nvidia-device-plugin                                                               |                      |         |         |                     |                     |
	|         | --addons=yakd --driver=hyperkit                                                             |                      |         |         |                     |                     |
	|         |  --addons=ingress                                                                           |                      |         |         |                     |                     |
	|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |
	|         | --addons=helm-tiller                                                                        |                      |         |         |                     |                     |
	| ip      | addons-925000 ip                                                                            | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
	| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
	|         | registry --alsologtostderr                                                                  |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| addons  | addons-925000 addons                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
	|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | disable nvidia-device-plugin                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
	|         | -p addons-925000                                                                            |                      |         |         |                     |                     |
	| addons  | addons-925000 addons                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
	|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| ssh     | addons-925000 ssh cat                                                                       | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
	|         | /opt/local-path-provisioner/pvc-5e04d413-792c-4b45-b71c-dbe48849ede3_default_test-pvc/file1 |                      |         |         |                     |                     |
	| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:56 PST |
	|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | disable cloud-spanner -p                                                                    | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
	|         | addons-925000                                                                               |                      |         |         |                     |                     |
	| addons  | enable headlamp                                                                             | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
	|         | -p addons-925000                                                                            |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | addons-925000 addons                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
	|         | disable metrics-server                                                                      |                      |         |         |                     |                     |
	|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
	| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
	|         | helm-tiller --alsologtostderr                                                               |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| addons  | disable inspektor-gadget -p                                                                 | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:56 PST |
	|         | addons-925000                                                                               |                      |         |         |                     |                     |
	| ssh     | addons-925000 ssh curl -s                                                                   | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
	|         | http://127.0.0.1/ -H 'Host:                                                                 |                      |         |         |                     |                     |
	|         | nginx.example.com'                                                                          |                      |         |         |                     |                     |
	| ip      | addons-925000 ip                                                                            | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
	| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
	|         | ingress-dns --alsologtostderr                                                               |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
	|         | ingress --alsologtostderr -v=1                                                              |                      |         |         |                     |                     |
	| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
	|         | gcp-auth --alsologtostderr                                                                  |                      |         |         |                     |                     |
	|         | -v=1                                                                                        |                      |         |         |                     |                     |
	| stop    | -p addons-925000                                                                            | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
	| addons  | enable dashboard -p                                                                         | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
	|         | addons-925000                                                                               |                      |         |         |                     |                     |
	| addons  | disable dashboard -p                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
	|         | addons-925000                                                                               |                      |         |         |                     |                     |
	| addons  | disable gvisor -p                                                                           | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
	|         | addons-925000                                                                               |                      |         |         |                     |                     |
	| delete  | -p addons-925000                                                                            | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
	| start   | -p nospam-536000 -n=1 --memory=2250 --wait=false                                            | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST |                     |
	|         | --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                    |                      |         |         |                     |                     |
	|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
	| start   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
	|         | start --dry-run                                                                             |                      |         |         |                     |                     |
	| start   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
	|         | start --dry-run                                                                             |                      |         |         |                     |                     |
	| start   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
	|         | start --dry-run                                                                             |                      |         |         |                     |                     |
	| pause   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
	|         | pause                                                                                       |                      |         |         |                     |                     |
	| pause   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
	|         | pause                                                                                       |                      |         |         |                     |                     |
	| pause   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
	|         | pause                                                                                       |                      |         |         |                     |                     |
	| unpause | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
	|         | unpause                                                                                     |                      |         |         |                     |                     |
	| unpause | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
	|         | unpause                                                                                     |                      |         |         |                     |                     |
	| unpause | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
	|         | unpause                                                                                     |                      |         |         |                     |                     |
	| stop    | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
	|         | stop                                                                                        |                      |         |         |                     |                     |
	| stop    | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
	|         | stop                                                                                        |                      |         |         |                     |                     |
	| stop    | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
	|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
	|         | stop                                                                                        |                      |         |         |                     |                     |
	| delete  | -p nospam-536000                                                                            | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
	| start   | -p functional-550000                                                                        | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | --memory=4000                                                                               |                      |         |         |                     |                     |
	|         | --apiserver-port=8441                                                                       |                      |         |         |                     |                     |
	|         | --wait=all --driver=hyperkit                                                                |                      |         |         |                     |                     |
	| start   | -p functional-550000                                                                        | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | --alsologtostderr -v=8                                                                      |                      |         |         |                     |                     |
	| cache   | functional-550000 cache add                                                                 | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
	|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
	| cache   | functional-550000 cache add                                                                 | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
	|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
	| cache   | functional-550000 cache add                                                                 | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| cache   | functional-550000 cache add                                                                 | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
	|         | minikube-local-cache-test:functional-550000                                                 |                      |         |         |                     |                     |
	| cache   | functional-550000 cache delete                                                              | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
	|         | minikube-local-cache-test:functional-550000                                                 |                      |         |         |                     |                     |
	| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
	|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
	| cache   | list                                                                                        | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
	| ssh     | functional-550000 ssh sudo                                                                  | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | crictl images                                                                               |                      |         |         |                     |                     |
	| ssh     | functional-550000                                                                           | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | ssh sudo docker rmi                                                                         |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| ssh     | functional-550000 ssh                                                                       | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| cache   | functional-550000 cache reload                                                              | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
	| ssh     | functional-550000 ssh                                                                       | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
	|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
	| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
	|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
	| kubectl | functional-550000 kubectl --                                                                | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | --context functional-550000                                                                 |                      |         |         |                     |                     |
	|         | get pods                                                                                    |                      |         |         |                     |                     |
	| start   | -p functional-550000                                                                        | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
	|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision                    |                      |         |         |                     |                     |
	|         | --wait=all                                                                                  |                      |         |         |                     |                     |
	|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/07 13:57:47
	Running on machine: MacOS-Agent-4
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0307 13:57:47.739886    2752 out.go:291] Setting OutFile to fd 1 ...
	I0307 13:57:47.740139    2752 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:57:47.740142    2752 out.go:304] Setting ErrFile to fd 2...
	I0307 13:57:47.740145    2752 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:57:47.740299    2752 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 13:57:47.741681    2752 out.go:298] Setting JSON to false
	I0307 13:57:47.763952    2752 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1638,"bootTime":1709847029,"procs":489,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 13:57:47.764042    2752 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 13:57:47.793156    2752 out.go:177] * [functional-550000] minikube v1.32.0 on Darwin 14.3.1
	I0307 13:57:47.835913    2752 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 13:57:47.835930    2752 notify.go:220] Checking for updates...
	I0307 13:57:47.858039    2752 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 13:57:47.878877    2752 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 13:57:47.920588    2752 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 13:57:47.941412    2752 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 13:57:47.962868    2752 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 13:57:47.984489    2752 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 13:57:47.984619    2752 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 13:57:47.985178    2752 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:57:47.985246    2752 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 13:57:47.994029    2752 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49833
	I0307 13:57:47.994490    2752 main.go:141] libmachine: () Calling .GetVersion
	I0307 13:57:47.994917    2752 main.go:141] libmachine: Using API Version  1
	I0307 13:57:47.994922    2752 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 13:57:47.995129    2752 main.go:141] libmachine: () Calling .GetMachineName
	I0307 13:57:47.995225    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
	I0307 13:57:48.023579    2752 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 13:57:48.065857    2752 start.go:297] selected driver: hyperkit
	I0307 13:57:48.065873    2752 start.go:901] validating driver "hyperkit" against &{Name:functional-550000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-550000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Moun
tPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 13:57:48.066072    2752 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 13:57:48.066265    2752 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 13:57:48.066437    2752 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 13:57:48.075227    2752 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 13:57:48.078937    2752 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:57:48.078955    2752 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 13:57:48.081528    2752 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 13:57:48.081588    2752 cni.go:84] Creating CNI manager for ""
	I0307 13:57:48.081603    2752 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 13:57:48.081665    2752 start.go:340] cluster config:
	{Name:functional-550000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-550000 Namespace:default APISe
rverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 13:57:48.081752    2752 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 13:57:48.123898    2752 out.go:177] * Starting "functional-550000" primary control-plane node in "functional-550000" cluster
	I0307 13:57:48.145841    2752 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 13:57:48.145900    2752 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 13:57:48.145924    2752 cache.go:56] Caching tarball of preloaded images
	I0307 13:57:48.146119    2752 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 13:57:48.146133    2752 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 13:57:48.146283    2752 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/functional-550000/config.json ...
	I0307 13:57:48.147259    2752 start.go:360] acquireMachinesLock for functional-550000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 13:57:48.147401    2752 start.go:364] duration metric: took 123.333µs to acquireMachinesLock for "functional-550000"
	I0307 13:57:48.147435    2752 start.go:96] Skipping create...Using existing machine configuration
	I0307 13:57:48.147447    2752 fix.go:54] fixHost starting: 
	I0307 13:57:48.147848    2752 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:57:48.147879    2752 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 13:57:48.156446    2752 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49835
	I0307 13:57:48.156772    2752 main.go:141] libmachine: () Calling .GetVersion
	I0307 13:57:48.157118    2752 main.go:141] libmachine: Using API Version  1
	I0307 13:57:48.157126    2752 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 13:57:48.157308    2752 main.go:141] libmachine: () Calling .GetMachineName
	I0307 13:57:48.157430    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
	I0307 13:57:48.157521    2752 main.go:141] libmachine: (functional-550000) Calling .GetState
	I0307 13:57:48.157597    2752 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 13:57:48.157615    2752 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
	I0307 13:57:48.157629    2752 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
	I0307 13:57:48.157680    2752 fix.go:112] recreateIfNeeded on functional-550000: state=Stopped err=<nil>
	I0307 13:57:48.157723    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
	W0307 13:57:48.157809    2752 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 13:57:48.199625    2752 out.go:177] * Restarting existing hyperkit VM for "functional-550000" ...
	I0307 13:57:48.220604    2752 main.go:141] libmachine: (functional-550000) Calling .Start
	I0307 13:57:48.220804    2752 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 13:57:48.220824    2752 main.go:141] libmachine: (functional-550000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.pid
	I0307 13:57:48.220875    2752 main.go:141] libmachine: (functional-550000) DBG | Using UUID c4e81114-816f-463b-971e-0678710887f5
	I0307 13:57:48.258926    2752 main.go:141] libmachine: (functional-550000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 13:57:48.259032    2752 fix.go:56] duration metric: took 111.586222ms for fixHost
	I0307 13:57:48.259040    2752 start.go:83] releasing machines lock for "functional-550000", held for 111.631961ms
	W0307 13:57:48.259054    2752 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 13:57:48.259098    2752 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 13:57:48.259107    2752 start.go:728] Will try again in 5 seconds ...
	I0307 13:57:53.260684    2752 start.go:360] acquireMachinesLock for functional-550000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 13:57:53.260795    2752 start.go:364] duration metric: took 95.454µs to acquireMachinesLock for "functional-550000"
	I0307 13:57:53.260816    2752 start.go:96] Skipping create...Using existing machine configuration
	I0307 13:57:53.260820    2752 fix.go:54] fixHost starting: 
	I0307 13:57:53.261144    2752 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:57:53.261168    2752 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 13:57:53.269727    2752 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49838
	I0307 13:57:53.270095    2752 main.go:141] libmachine: () Calling .GetVersion
	I0307 13:57:53.270462    2752 main.go:141] libmachine: Using API Version  1
	I0307 13:57:53.270472    2752 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 13:57:53.270698    2752 main.go:141] libmachine: () Calling .GetMachineName
	I0307 13:57:53.270819    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
	I0307 13:57:53.270901    2752 main.go:141] libmachine: (functional-550000) Calling .GetState
	I0307 13:57:53.270995    2752 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 13:57:53.271019    2752 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
	I0307 13:57:53.271023    2752 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
	I0307 13:57:53.271044    2752 fix.go:112] recreateIfNeeded on functional-550000: state=Stopped err=<nil>
	I0307 13:57:53.271052    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
	W0307 13:57:53.271140    2752 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 13:57:53.292747    2752 out.go:177] * Restarting existing hyperkit VM for "functional-550000" ...
	I0307 13:57:53.334684    2752 main.go:141] libmachine: (functional-550000) Calling .Start
	I0307 13:57:53.334976    2752 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 13:57:53.335017    2752 main.go:141] libmachine: (functional-550000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.pid
	I0307 13:57:53.335074    2752 main.go:141] libmachine: (functional-550000) DBG | Using UUID c4e81114-816f-463b-971e-0678710887f5
	I0307 13:57:53.337011    2752 main.go:141] libmachine: (functional-550000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 13:57:53.337110    2752 fix.go:56] duration metric: took 76.287704ms for fixHost
	I0307 13:57:53.337118    2752 start.go:83] releasing machines lock for "functional-550000", held for 76.315672ms
	W0307 13:57:53.337201    2752 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-550000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 13:57:53.379502    2752 out.go:177] 
	W0307 13:57:53.400748    2752 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 13:57:53.400808    2752 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 13:57:53.400825    2752 out.go:239] * Related issues:
	W0307 13:57:53.400850    2752 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	W0307 13:57:53.400873    2752 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	I0307 13:57:53.422521    2752 out.go:177] 
	
	
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1234: out/minikube-darwin-amd64 -p functional-550000 logs failed: exit status 83
functional_test.go:1224: expected minikube logs to include word: -"Linux"- but got 
***
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| delete  | -p download-only-609000                                                                     | download-only-609000 | jenkins | v1.32.0 | 07 Mar 24 13:49 PST | 07 Mar 24 13:49 PST |
| start   | --download-only -p                                                                          | binary-mirror-671000 | jenkins | v1.32.0 | 07 Mar 24 13:49 PST |                     |
|         | binary-mirror-671000                                                                        |                      |         |         |                     |                     |
|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |
|         | --binary-mirror                                                                             |                      |         |         |                     |                     |
|         | http://127.0.0.1:49358                                                                      |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| delete  | -p binary-mirror-671000                                                                     | binary-mirror-671000 | jenkins | v1.32.0 | 07 Mar 24 13:49 PST | 07 Mar 24 13:49 PST |
| addons  | enable dashboard -p                                                                         | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:49 PST |                     |
|         | addons-925000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:49 PST |                     |
|         | addons-925000                                                                               |                      |         |         |                     |                     |
| start   | -p addons-925000 --wait=true                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:49 PST | 07 Mar 24 13:54 PST |
|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |
|         | --addons=registry                                                                           |                      |         |         |                     |                     |
|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |
|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |
|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |
|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |
|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |
|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |
|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |
|         | --addons=nvidia-device-plugin                                                               |                      |         |         |                     |                     |
|         | --addons=yakd --driver=hyperkit                                                             |                      |         |         |                     |                     |
|         |  --addons=ingress                                                                           |                      |         |         |                     |                     |
|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |
|         | --addons=helm-tiller                                                                        |                      |         |         |                     |                     |
| ip      | addons-925000 ip                                                                            | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | registry --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-925000 addons                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable nvidia-device-plugin                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | -p addons-925000                                                                            |                      |         |         |                     |                     |
| addons  | addons-925000 addons                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| ssh     | addons-925000 ssh cat                                                                       | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | /opt/local-path-provisioner/pvc-5e04d413-792c-4b45-b71c-dbe48849ede3_default_test-pvc/file1 |                      |         |         |                     |                     |
| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:56 PST |
|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable cloud-spanner -p                                                                    | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | addons-925000                                                                               |                      |         |         |                     |                     |
| addons  | enable headlamp                                                                             | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | -p addons-925000                                                                            |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | addons-925000 addons                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | disable metrics-server                                                                      |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | helm-tiller --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | disable inspektor-gadget -p                                                                 | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:56 PST |
|         | addons-925000                                                                               |                      |         |         |                     |                     |
| ssh     | addons-925000 ssh curl -s                                                                   | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
|         | http://127.0.0.1/ -H 'Host:                                                                 |                      |         |         |                     |                     |
|         | nginx.example.com'                                                                          |                      |         |         |                     |                     |
| ip      | addons-925000 ip                                                                            | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
|         | ingress-dns --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
|         | ingress --alsologtostderr -v=1                                                              |                      |         |         |                     |                     |
| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
|         | gcp-auth --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| stop    | -p addons-925000                                                                            | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
| addons  | enable dashboard -p                                                                         | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
|         | addons-925000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
|         | addons-925000                                                                               |                      |         |         |                     |                     |
| addons  | disable gvisor -p                                                                           | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
|         | addons-925000                                                                               |                      |         |         |                     |                     |
| delete  | -p addons-925000                                                                            | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
| start   | -p nospam-536000 -n=1 --memory=2250 --wait=false                                            | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST |                     |
|         | --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                    |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| start   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| pause   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| unpause | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| stop    | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| delete  | -p nospam-536000                                                                            | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
| start   | -p functional-550000                                                                        | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | --memory=4000                                                                               |                      |         |         |                     |                     |
|         | --apiserver-port=8441                                                                       |                      |         |         |                     |                     |
|         | --wait=all --driver=hyperkit                                                                |                      |         |         |                     |                     |
| start   | -p functional-550000                                                                        | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | --alsologtostderr -v=8                                                                      |                      |         |         |                     |                     |
| cache   | functional-550000 cache add                                                                 | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | functional-550000 cache add                                                                 | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | functional-550000 cache add                                                                 | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-550000 cache add                                                                 | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | minikube-local-cache-test:functional-550000                                                 |                      |         |         |                     |                     |
| cache   | functional-550000 cache delete                                                              | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | minikube-local-cache-test:functional-550000                                                 |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | list                                                                                        | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
| ssh     | functional-550000 ssh sudo                                                                  | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | crictl images                                                                               |                      |         |         |                     |                     |
| ssh     | functional-550000                                                                           | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | ssh sudo docker rmi                                                                         |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| ssh     | functional-550000 ssh                                                                       | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-550000 cache reload                                                              | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
| ssh     | functional-550000 ssh                                                                       | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| kubectl | functional-550000 kubectl --                                                                | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | --context functional-550000                                                                 |                      |         |         |                     |                     |
|         | get pods                                                                                    |                      |         |         |                     |                     |
| start   | -p functional-550000                                                                        | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision                    |                      |         |         |                     |                     |
|         | --wait=all                                                                                  |                      |         |         |                     |                     |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

                                                
                                                

                                                
                                                
==> Last Start <==
Log file created at: 2024/03/07 13:57:47
Running on machine: MacOS-Agent-4
Binary: Built with gc go1.22.0 for darwin/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0307 13:57:47.739886    2752 out.go:291] Setting OutFile to fd 1 ...
I0307 13:57:47.740139    2752 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:57:47.740142    2752 out.go:304] Setting ErrFile to fd 2...
I0307 13:57:47.740145    2752 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:57:47.740299    2752 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
I0307 13:57:47.741681    2752 out.go:298] Setting JSON to false
I0307 13:57:47.763952    2752 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1638,"bootTime":1709847029,"procs":489,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
W0307 13:57:47.764042    2752 start.go:137] gopshost.Virtualization returned error: not implemented yet
I0307 13:57:47.793156    2752 out.go:177] * [functional-550000] minikube v1.32.0 on Darwin 14.3.1
I0307 13:57:47.835913    2752 out.go:177]   - MINIKUBE_LOCATION=18320
I0307 13:57:47.835930    2752 notify.go:220] Checking for updates...
I0307 13:57:47.858039    2752 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
I0307 13:57:47.878877    2752 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
I0307 13:57:47.920588    2752 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0307 13:57:47.941412    2752 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
I0307 13:57:47.962868    2752 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
I0307 13:57:47.984489    2752 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 13:57:47.984619    2752 driver.go:392] Setting default libvirt URI to qemu:///system
I0307 13:57:47.985178    2752 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:57:47.985246    2752 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 13:57:47.994029    2752 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49833
I0307 13:57:47.994490    2752 main.go:141] libmachine: () Calling .GetVersion
I0307 13:57:47.994917    2752 main.go:141] libmachine: Using API Version  1
I0307 13:57:47.994922    2752 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 13:57:47.995129    2752 main.go:141] libmachine: () Calling .GetMachineName
I0307 13:57:47.995225    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
I0307 13:57:48.023579    2752 out.go:177] * Using the hyperkit driver based on existing profile
I0307 13:57:48.065857    2752 start.go:297] selected driver: hyperkit
I0307 13:57:48.065873    2752 start.go:901] validating driver "hyperkit" against &{Name:functional-550000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:functional-550000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0307 13:57:48.066072    2752 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0307 13:57:48.066265    2752 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 13:57:48.066437    2752 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I0307 13:57:48.075227    2752 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
I0307 13:57:48.078937    2752 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:57:48.078955    2752 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I0307 13:57:48.081528    2752 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0307 13:57:48.081588    2752 cni.go:84] Creating CNI manager for ""
I0307 13:57:48.081603    2752 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0307 13:57:48.081665    2752 start.go:340] cluster config:
{Name:functional-550000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-550000 Namespace:default APISer
verHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPor
t:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0307 13:57:48.081752    2752 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 13:57:48.123898    2752 out.go:177] * Starting "functional-550000" primary control-plane node in "functional-550000" cluster
I0307 13:57:48.145841    2752 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
I0307 13:57:48.145900    2752 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
I0307 13:57:48.145924    2752 cache.go:56] Caching tarball of preloaded images
I0307 13:57:48.146119    2752 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0307 13:57:48.146133    2752 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
I0307 13:57:48.146283    2752 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/functional-550000/config.json ...
I0307 13:57:48.147259    2752 start.go:360] acquireMachinesLock for functional-550000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0307 13:57:48.147401    2752 start.go:364] duration metric: took 123.333µs to acquireMachinesLock for "functional-550000"
I0307 13:57:48.147435    2752 start.go:96] Skipping create...Using existing machine configuration
I0307 13:57:48.147447    2752 fix.go:54] fixHost starting: 
I0307 13:57:48.147848    2752 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:57:48.147879    2752 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 13:57:48.156446    2752 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49835
I0307 13:57:48.156772    2752 main.go:141] libmachine: () Calling .GetVersion
I0307 13:57:48.157118    2752 main.go:141] libmachine: Using API Version  1
I0307 13:57:48.157126    2752 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 13:57:48.157308    2752 main.go:141] libmachine: () Calling .GetMachineName
I0307 13:57:48.157430    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
I0307 13:57:48.157521    2752 main.go:141] libmachine: (functional-550000) Calling .GetState
I0307 13:57:48.157597    2752 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:57:48.157615    2752 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
I0307 13:57:48.157629    2752 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
I0307 13:57:48.157680    2752 fix.go:112] recreateIfNeeded on functional-550000: state=Stopped err=<nil>
I0307 13:57:48.157723    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
W0307 13:57:48.157809    2752 fix.go:138] unexpected machine state, will restart: <nil>
I0307 13:57:48.199625    2752 out.go:177] * Restarting existing hyperkit VM for "functional-550000" ...
I0307 13:57:48.220604    2752 main.go:141] libmachine: (functional-550000) Calling .Start
I0307 13:57:48.220804    2752 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:57:48.220824    2752 main.go:141] libmachine: (functional-550000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.pid
I0307 13:57:48.220875    2752 main.go:141] libmachine: (functional-550000) DBG | Using UUID c4e81114-816f-463b-971e-0678710887f5
I0307 13:57:48.258926    2752 main.go:141] libmachine: (functional-550000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0307 13:57:48.259032    2752 fix.go:56] duration metric: took 111.586222ms for fixHost
I0307 13:57:48.259040    2752 start.go:83] releasing machines lock for "functional-550000", held for 111.631961ms
W0307 13:57:48.259054    2752 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
W0307 13:57:48.259098    2752 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0307 13:57:48.259107    2752 start.go:728] Will try again in 5 seconds ...
I0307 13:57:53.260684    2752 start.go:360] acquireMachinesLock for functional-550000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0307 13:57:53.260795    2752 start.go:364] duration metric: took 95.454µs to acquireMachinesLock for "functional-550000"
I0307 13:57:53.260816    2752 start.go:96] Skipping create...Using existing machine configuration
I0307 13:57:53.260820    2752 fix.go:54] fixHost starting: 
I0307 13:57:53.261144    2752 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:57:53.261168    2752 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 13:57:53.269727    2752 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49838
I0307 13:57:53.270095    2752 main.go:141] libmachine: () Calling .GetVersion
I0307 13:57:53.270462    2752 main.go:141] libmachine: Using API Version  1
I0307 13:57:53.270472    2752 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 13:57:53.270698    2752 main.go:141] libmachine: () Calling .GetMachineName
I0307 13:57:53.270819    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
I0307 13:57:53.270901    2752 main.go:141] libmachine: (functional-550000) Calling .GetState
I0307 13:57:53.270995    2752 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:57:53.271019    2752 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
I0307 13:57:53.271023    2752 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
I0307 13:57:53.271044    2752 fix.go:112] recreateIfNeeded on functional-550000: state=Stopped err=<nil>
I0307 13:57:53.271052    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
W0307 13:57:53.271140    2752 fix.go:138] unexpected machine state, will restart: <nil>
I0307 13:57:53.292747    2752 out.go:177] * Restarting existing hyperkit VM for "functional-550000" ...
I0307 13:57:53.334684    2752 main.go:141] libmachine: (functional-550000) Calling .Start
I0307 13:57:53.334976    2752 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:57:53.335017    2752 main.go:141] libmachine: (functional-550000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.pid
I0307 13:57:53.335074    2752 main.go:141] libmachine: (functional-550000) DBG | Using UUID c4e81114-816f-463b-971e-0678710887f5
I0307 13:57:53.337011    2752 main.go:141] libmachine: (functional-550000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0307 13:57:53.337110    2752 fix.go:56] duration metric: took 76.287704ms for fixHost
I0307 13:57:53.337118    2752 start.go:83] releasing machines lock for "functional-550000", held for 76.315672ms
W0307 13:57:53.337201    2752 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-550000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0307 13:57:53.379502    2752 out.go:177] 
W0307 13:57:53.400748    2752 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
W0307 13:57:53.400808    2752 out.go:239] * Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
W0307 13:57:53.400825    2752 out.go:239] * Related issues:
W0307 13:57:53.400850    2752 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
W0307 13:57:53.400873    2752 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
I0307 13:57:53.422521    2752 out.go:177] 

                                                
                                                

                                                
                                                
* The control-plane node functional-550000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-550000"
***
--- FAIL: TestFunctional/serial/LogsCmd (0.32s)

                                                
                                    
x
+
TestFunctional/serial/LogsFileCmd (0.29s)

                                                
                                                
=== RUN   TestFunctional/serial/LogsFileCmd
functional_test.go:1246: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 logs --file /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalserialLogsFileCmd503900287/001/logs.txt
functional_test.go:1224: expected minikube logs to include word: -"Linux"- but got 
***
==> Audit <==
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| Command |                                            Args                                             |       Profile        |  User   | Version |     Start Time      |      End Time       |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|
| delete  | -p download-only-609000                                                                     | download-only-609000 | jenkins | v1.32.0 | 07 Mar 24 13:49 PST | 07 Mar 24 13:49 PST |
| start   | --download-only -p                                                                          | binary-mirror-671000 | jenkins | v1.32.0 | 07 Mar 24 13:49 PST |                     |
|         | binary-mirror-671000                                                                        |                      |         |         |                     |                     |
|         | --alsologtostderr                                                                           |                      |         |         |                     |                     |
|         | --binary-mirror                                                                             |                      |         |         |                     |                     |
|         | http://127.0.0.1:49358                                                                      |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| delete  | -p binary-mirror-671000                                                                     | binary-mirror-671000 | jenkins | v1.32.0 | 07 Mar 24 13:49 PST | 07 Mar 24 13:49 PST |
| addons  | enable dashboard -p                                                                         | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:49 PST |                     |
|         | addons-925000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:49 PST |                     |
|         | addons-925000                                                                               |                      |         |         |                     |                     |
| start   | -p addons-925000 --wait=true                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:49 PST | 07 Mar 24 13:54 PST |
|         | --memory=4000 --alsologtostderr                                                             |                      |         |         |                     |                     |
|         | --addons=registry                                                                           |                      |         |         |                     |                     |
|         | --addons=metrics-server                                                                     |                      |         |         |                     |                     |
|         | --addons=volumesnapshots                                                                    |                      |         |         |                     |                     |
|         | --addons=csi-hostpath-driver                                                                |                      |         |         |                     |                     |
|         | --addons=gcp-auth                                                                           |                      |         |         |                     |                     |
|         | --addons=cloud-spanner                                                                      |                      |         |         |                     |                     |
|         | --addons=inspektor-gadget                                                                   |                      |         |         |                     |                     |
|         | --addons=storage-provisioner-rancher                                                        |                      |         |         |                     |                     |
|         | --addons=nvidia-device-plugin                                                               |                      |         |         |                     |                     |
|         | --addons=yakd --driver=hyperkit                                                             |                      |         |         |                     |                     |
|         |  --addons=ingress                                                                           |                      |         |         |                     |                     |
|         | --addons=ingress-dns                                                                        |                      |         |         |                     |                     |
|         | --addons=helm-tiller                                                                        |                      |         |         |                     |                     |
| ip      | addons-925000 ip                                                                            | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | registry --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-925000 addons                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | disable csi-hostpath-driver                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable nvidia-device-plugin                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | -p addons-925000                                                                            |                      |         |         |                     |                     |
| addons  | addons-925000 addons                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | disable volumesnapshots                                                                     |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| ssh     | addons-925000 ssh cat                                                                       | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | /opt/local-path-provisioner/pvc-5e04d413-792c-4b45-b71c-dbe48849ede3_default_test-pvc/file1 |                      |         |         |                     |                     |
| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:56 PST |
|         | storage-provisioner-rancher                                                                 |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | disable cloud-spanner -p                                                                    | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | addons-925000                                                                               |                      |         |         |                     |                     |
| addons  | enable headlamp                                                                             | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | -p addons-925000                                                                            |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | addons-925000 addons                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | disable metrics-server                                                                      |                      |         |         |                     |                     |
|         | --alsologtostderr -v=1                                                                      |                      |         |         |                     |                     |
| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:55 PST |
|         | helm-tiller --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | disable inspektor-gadget -p                                                                 | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:55 PST | 07 Mar 24 13:56 PST |
|         | addons-925000                                                                               |                      |         |         |                     |                     |
| ssh     | addons-925000 ssh curl -s                                                                   | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
|         | http://127.0.0.1/ -H 'Host:                                                                 |                      |         |         |                     |                     |
|         | nginx.example.com'                                                                          |                      |         |         |                     |                     |
| ip      | addons-925000 ip                                                                            | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
|         | ingress-dns --alsologtostderr                                                               |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
|         | ingress --alsologtostderr -v=1                                                              |                      |         |         |                     |                     |
| addons  | addons-925000 addons disable                                                                | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
|         | gcp-auth --alsologtostderr                                                                  |                      |         |         |                     |                     |
|         | -v=1                                                                                        |                      |         |         |                     |                     |
| stop    | -p addons-925000                                                                            | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
| addons  | enable dashboard -p                                                                         | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
|         | addons-925000                                                                               |                      |         |         |                     |                     |
| addons  | disable dashboard -p                                                                        | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
|         | addons-925000                                                                               |                      |         |         |                     |                     |
| addons  | disable gvisor -p                                                                           | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
|         | addons-925000                                                                               |                      |         |         |                     |                     |
| delete  | -p addons-925000                                                                            | addons-925000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST | 07 Mar 24 13:56 PST |
| start   | -p nospam-536000 -n=1 --memory=2250 --wait=false                                            | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:56 PST |                     |
|         | --log_dir=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                    |                      |         |         |                     |                     |
|         | --driver=hyperkit                                                                           |                      |         |         |                     |                     |
| start   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| start   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | start --dry-run                                                                             |                      |         |         |                     |                     |
| pause   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| pause   | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | pause                                                                                       |                      |         |         |                     |                     |
| unpause | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| unpause | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | unpause                                                                                     |                      |         |         |                     |                     |
| stop    | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| stop    | nospam-536000 --log_dir                                                                     | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000                              |                      |         |         |                     |                     |
|         | stop                                                                                        |                      |         |         |                     |                     |
| delete  | -p nospam-536000                                                                            | nospam-536000        | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
| start   | -p functional-550000                                                                        | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | --memory=4000                                                                               |                      |         |         |                     |                     |
|         | --apiserver-port=8441                                                                       |                      |         |         |                     |                     |
|         | --wait=all --driver=hyperkit                                                                |                      |         |         |                     |                     |
| start   | -p functional-550000                                                                        | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | --alsologtostderr -v=8                                                                      |                      |         |         |                     |                     |
| cache   | functional-550000 cache add                                                                 | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | functional-550000 cache add                                                                 | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | functional-550000 cache add                                                                 | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-550000 cache add                                                                 | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | minikube-local-cache-test:functional-550000                                                 |                      |         |         |                     |                     |
| cache   | functional-550000 cache delete                                                              | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | minikube-local-cache-test:functional-550000                                                 |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | registry.k8s.io/pause:3.3                                                                   |                      |         |         |                     |                     |
| cache   | list                                                                                        | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
| ssh     | functional-550000 ssh sudo                                                                  | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | crictl images                                                                               |                      |         |         |                     |                     |
| ssh     | functional-550000                                                                           | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | ssh sudo docker rmi                                                                         |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| ssh     | functional-550000 ssh                                                                       | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | functional-550000 cache reload                                                              | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
| ssh     | functional-550000 ssh                                                                       | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | sudo crictl inspecti                                                                        |                      |         |         |                     |                     |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | registry.k8s.io/pause:3.1                                                                   |                      |         |         |                     |                     |
| cache   | delete                                                                                      | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:57 PST | 07 Mar 24 13:57 PST |
|         | registry.k8s.io/pause:latest                                                                |                      |         |         |                     |                     |
| kubectl | functional-550000 kubectl --                                                                | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | --context functional-550000                                                                 |                      |         |         |                     |                     |
|         | get pods                                                                                    |                      |         |         |                     |                     |
| start   | -p functional-550000                                                                        | functional-550000    | jenkins | v1.32.0 | 07 Mar 24 13:57 PST |                     |
|         | --extra-config=apiserver.enable-admission-plugins=NamespaceAutoProvision                    |                      |         |         |                     |                     |
|         | --wait=all                                                                                  |                      |         |         |                     |                     |
|---------|---------------------------------------------------------------------------------------------|----------------------|---------|---------|---------------------|---------------------|

                                                
                                                

                                                
                                                
==> Last Start <==
Log file created at: 2024/03/07 13:57:47
Running on machine: MacOS-Agent-4
Binary: Built with gc go1.22.0 for darwin/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0307 13:57:47.739886    2752 out.go:291] Setting OutFile to fd 1 ...
I0307 13:57:47.740139    2752 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:57:47.740142    2752 out.go:304] Setting ErrFile to fd 2...
I0307 13:57:47.740145    2752 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:57:47.740299    2752 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
I0307 13:57:47.741681    2752 out.go:298] Setting JSON to false
I0307 13:57:47.763952    2752 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1638,"bootTime":1709847029,"procs":489,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
W0307 13:57:47.764042    2752 start.go:137] gopshost.Virtualization returned error: not implemented yet
I0307 13:57:47.793156    2752 out.go:177] * [functional-550000] minikube v1.32.0 on Darwin 14.3.1
I0307 13:57:47.835913    2752 out.go:177]   - MINIKUBE_LOCATION=18320
I0307 13:57:47.835930    2752 notify.go:220] Checking for updates...
I0307 13:57:47.858039    2752 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
I0307 13:57:47.878877    2752 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
I0307 13:57:47.920588    2752 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
I0307 13:57:47.941412    2752 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
I0307 13:57:47.962868    2752 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
I0307 13:57:47.984489    2752 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 13:57:47.984619    2752 driver.go:392] Setting default libvirt URI to qemu:///system
I0307 13:57:47.985178    2752 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:57:47.985246    2752 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 13:57:47.994029    2752 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49833
I0307 13:57:47.994490    2752 main.go:141] libmachine: () Calling .GetVersion
I0307 13:57:47.994917    2752 main.go:141] libmachine: Using API Version  1
I0307 13:57:47.994922    2752 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 13:57:47.995129    2752 main.go:141] libmachine: () Calling .GetMachineName
I0307 13:57:47.995225    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
I0307 13:57:48.023579    2752 out.go:177] * Using the hyperkit driver based on existing profile
I0307 13:57:48.065857    2752 start.go:297] selected driver: hyperkit
I0307 13:57:48.065873    2752 start.go:901] validating driver "hyperkit" against &{Name:functional-550000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:functional-550000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0307 13:57:48.066072    2752 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0307 13:57:48.066265    2752 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 13:57:48.066437    2752 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
I0307 13:57:48.075227    2752 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
I0307 13:57:48.078937    2752 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:57:48.078955    2752 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
I0307 13:57:48.081528    2752 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
I0307 13:57:48.081588    2752 cni.go:84] Creating CNI manager for ""
I0307 13:57:48.081603    2752 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
I0307 13:57:48.081665    2752 start.go:340] cluster config:
{Name:functional-550000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:functional-550000 Namespace:default APISer
verHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPor
t:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
I0307 13:57:48.081752    2752 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0307 13:57:48.123898    2752 out.go:177] * Starting "functional-550000" primary control-plane node in "functional-550000" cluster
I0307 13:57:48.145841    2752 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
I0307 13:57:48.145900    2752 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
I0307 13:57:48.145924    2752 cache.go:56] Caching tarball of preloaded images
I0307 13:57:48.146119    2752 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0307 13:57:48.146133    2752 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
I0307 13:57:48.146283    2752 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/functional-550000/config.json ...
I0307 13:57:48.147259    2752 start.go:360] acquireMachinesLock for functional-550000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0307 13:57:48.147401    2752 start.go:364] duration metric: took 123.333µs to acquireMachinesLock for "functional-550000"
I0307 13:57:48.147435    2752 start.go:96] Skipping create...Using existing machine configuration
I0307 13:57:48.147447    2752 fix.go:54] fixHost starting: 
I0307 13:57:48.147848    2752 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:57:48.147879    2752 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 13:57:48.156446    2752 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49835
I0307 13:57:48.156772    2752 main.go:141] libmachine: () Calling .GetVersion
I0307 13:57:48.157118    2752 main.go:141] libmachine: Using API Version  1
I0307 13:57:48.157126    2752 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 13:57:48.157308    2752 main.go:141] libmachine: () Calling .GetMachineName
I0307 13:57:48.157430    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
I0307 13:57:48.157521    2752 main.go:141] libmachine: (functional-550000) Calling .GetState
I0307 13:57:48.157597    2752 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:57:48.157615    2752 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
I0307 13:57:48.157629    2752 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
I0307 13:57:48.157680    2752 fix.go:112] recreateIfNeeded on functional-550000: state=Stopped err=<nil>
I0307 13:57:48.157723    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
W0307 13:57:48.157809    2752 fix.go:138] unexpected machine state, will restart: <nil>
I0307 13:57:48.199625    2752 out.go:177] * Restarting existing hyperkit VM for "functional-550000" ...
I0307 13:57:48.220604    2752 main.go:141] libmachine: (functional-550000) Calling .Start
I0307 13:57:48.220804    2752 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:57:48.220824    2752 main.go:141] libmachine: (functional-550000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.pid
I0307 13:57:48.220875    2752 main.go:141] libmachine: (functional-550000) DBG | Using UUID c4e81114-816f-463b-971e-0678710887f5
I0307 13:57:48.258926    2752 main.go:141] libmachine: (functional-550000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0307 13:57:48.259032    2752 fix.go:56] duration metric: took 111.586222ms for fixHost
I0307 13:57:48.259040    2752 start.go:83] releasing machines lock for "functional-550000", held for 111.631961ms
W0307 13:57:48.259054    2752 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
W0307 13:57:48.259098    2752 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0307 13:57:48.259107    2752 start.go:728] Will try again in 5 seconds ...
I0307 13:57:53.260684    2752 start.go:360] acquireMachinesLock for functional-550000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0307 13:57:53.260795    2752 start.go:364] duration metric: took 95.454µs to acquireMachinesLock for "functional-550000"
I0307 13:57:53.260816    2752 start.go:96] Skipping create...Using existing machine configuration
I0307 13:57:53.260820    2752 fix.go:54] fixHost starting: 
I0307 13:57:53.261144    2752 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:57:53.261168    2752 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 13:57:53.269727    2752 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49838
I0307 13:57:53.270095    2752 main.go:141] libmachine: () Calling .GetVersion
I0307 13:57:53.270462    2752 main.go:141] libmachine: Using API Version  1
I0307 13:57:53.270472    2752 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 13:57:53.270698    2752 main.go:141] libmachine: () Calling .GetMachineName
I0307 13:57:53.270819    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
I0307 13:57:53.270901    2752 main.go:141] libmachine: (functional-550000) Calling .GetState
I0307 13:57:53.270995    2752 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:57:53.271019    2752 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
I0307 13:57:53.271023    2752 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
I0307 13:57:53.271044    2752 fix.go:112] recreateIfNeeded on functional-550000: state=Stopped err=<nil>
I0307 13:57:53.271052    2752 main.go:141] libmachine: (functional-550000) Calling .DriverName
W0307 13:57:53.271140    2752 fix.go:138] unexpected machine state, will restart: <nil>
I0307 13:57:53.292747    2752 out.go:177] * Restarting existing hyperkit VM for "functional-550000" ...
I0307 13:57:53.334684    2752 main.go:141] libmachine: (functional-550000) Calling .Start
I0307 13:57:53.334976    2752 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:57:53.335017    2752 main.go:141] libmachine: (functional-550000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.pid
I0307 13:57:53.335074    2752 main.go:141] libmachine: (functional-550000) DBG | Using UUID c4e81114-816f-463b-971e-0678710887f5
I0307 13:57:53.337011    2752 main.go:141] libmachine: (functional-550000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
I0307 13:57:53.337110    2752 fix.go:56] duration metric: took 76.287704ms for fixHost
I0307 13:57:53.337118    2752 start.go:83] releasing machines lock for "functional-550000", held for 76.315672ms
W0307 13:57:53.337201    2752 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p functional-550000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
I0307 13:57:53.379502    2752 out.go:177] 
W0307 13:57:53.400748    2752 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1

                                                
                                                
W0307 13:57:53.400808    2752 out.go:239] * Suggestion: 

                                                
                                                
Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
W0307 13:57:53.400825    2752 out.go:239] * Related issues:
W0307 13:57:53.400850    2752 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
W0307 13:57:53.400873    2752 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
I0307 13:57:53.422521    2752 out.go:177] 

                                                
                                                

                                                
                                                
***
--- FAIL: TestFunctional/serial/LogsFileCmd (0.29s)

                                                
                                    
x
+
TestFunctional/serial/InvalidService (0.04s)

                                                
                                                
=== RUN   TestFunctional/serial/InvalidService
functional_test.go:2317: (dbg) Run:  kubectl --context functional-550000 apply -f testdata/invalidsvc.yaml
functional_test.go:2317: (dbg) Non-zero exit: kubectl --context functional-550000 apply -f testdata/invalidsvc.yaml: exit status 1 (37.302839ms)

                                                
                                                
** stderr ** 
	error: context "functional-550000" does not exist

                                                
                                                
** /stderr **
functional_test.go:2319: kubectl --context functional-550000 apply -f testdata/invalidsvc.yaml failed: exit status 1
--- FAIL: TestFunctional/serial/InvalidService (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/DashboardCmd (0.33s)

                                                
                                                
=== RUN   TestFunctional/parallel/DashboardCmd
=== PAUSE TestFunctional/parallel/DashboardCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DashboardCmd
functional_test.go:901: (dbg) daemon: [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-550000 --alsologtostderr -v=1]
functional_test.go:914: output didn't produce a URL
functional_test.go:906: (dbg) stopping [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-550000 --alsologtostderr -v=1] ...
functional_test.go:906: (dbg) [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-550000 --alsologtostderr -v=1] stdout:
functional_test.go:906: (dbg) [out/minikube-darwin-amd64 dashboard --url --port 36195 -p functional-550000 --alsologtostderr -v=1] stderr:
I0307 13:58:52.049114    3195 out.go:291] Setting OutFile to fd 1 ...
I0307 13:58:52.049489    3195 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:58:52.049495    3195 out.go:304] Setting ErrFile to fd 2...
I0307 13:58:52.049498    3195 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:58:52.049687    3195 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
I0307 13:58:52.050059    3195 mustload.go:65] Loading cluster: functional-550000
I0307 13:58:52.050346    3195 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 13:58:52.050734    3195 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:58:52.050774    3195 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 13:58:52.058314    3195 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50066
I0307 13:58:52.058685    3195 main.go:141] libmachine: () Calling .GetVersion
I0307 13:58:52.059120    3195 main.go:141] libmachine: Using API Version  1
I0307 13:58:52.059130    3195 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 13:58:52.059361    3195 main.go:141] libmachine: () Calling .GetMachineName
I0307 13:58:52.059496    3195 main.go:141] libmachine: (functional-550000) Calling .GetState
I0307 13:58:52.059579    3195 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:58:52.059607    3195 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
I0307 13:58:52.059619    3195 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
I0307 13:58:52.081551    3195 out.go:177] * The control-plane node functional-550000 host is not running: state=Stopped
I0307 13:58:52.102073    3195 out.go:177]   To start a cluster, run: "minikube start -p functional-550000"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (74.337557ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/DashboardCmd (0.33s)

                                                
                                    
x
+
TestFunctional/parallel/StatusCmd (0.29s)

                                                
                                                
=== RUN   TestFunctional/parallel/StatusCmd
=== PAUSE TestFunctional/parallel/StatusCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/StatusCmd
functional_test.go:850: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 status
functional_test.go:850: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 status: exit status 7 (72.156237ms)

                                                
                                                
-- stdout --
	functional-550000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
functional_test.go:852: failed to run minikube status. args "out/minikube-darwin-amd64 -p functional-550000 status" : exit status 7
functional_test.go:856: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}
functional_test.go:856: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}: exit status 7 (73.415187ms)

                                                
                                                
-- stdout --
	host:Stopped,kublet:Stopped,apiserver:Stopped,kubeconfig:Stopped

                                                
                                                
-- /stdout --
functional_test.go:858: failed to run minikube status with custom format: args "out/minikube-darwin-amd64 -p functional-550000 status -f host:{{.Host}},kublet:{{.Kubelet}},apiserver:{{.APIServer}},kubeconfig:{{.Kubeconfig}}": exit status 7
functional_test.go:868: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 status -o json
functional_test.go:868: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 status -o json: exit status 7 (72.782334ms)

                                                
                                                
-- stdout --
	{"Name":"functional-550000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
functional_test.go:870: failed to run minikube status with json output. args "out/minikube-darwin-amd64 -p functional-550000 status -o json" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (71.645778ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/StatusCmd (0.29s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmdConnect (0.22s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmdConnect
=== PAUSE TestFunctional/parallel/ServiceCmdConnect

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ServiceCmdConnect
functional_test.go:1625: (dbg) Run:  kubectl --context functional-550000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8
functional_test.go:1625: (dbg) Non-zero exit: kubectl --context functional-550000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8: exit status 1 (36.79383ms)

                                                
                                                
** stderr ** 
	error: context "functional-550000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1629: failed to create hello-node deployment with this command "kubectl --context functional-550000 create deployment hello-node-connect --image=registry.k8s.io/echoserver:1.8": exit status 1.
functional_test.go:1594: service test failed - dumping debug information
functional_test.go:1595: -----------------------service failure post-mortem--------------------------------
functional_test.go:1598: (dbg) Run:  kubectl --context functional-550000 describe po hello-node-connect
functional_test.go:1598: (dbg) Non-zero exit: kubectl --context functional-550000 describe po hello-node-connect: exit status 1 (36.100733ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-550000

                                                
                                                
** /stderr **
functional_test.go:1600: "kubectl --context functional-550000 describe po hello-node-connect" failed: exit status 1
functional_test.go:1602: hello-node pod describe:
functional_test.go:1604: (dbg) Run:  kubectl --context functional-550000 logs -l app=hello-node-connect
functional_test.go:1604: (dbg) Non-zero exit: kubectl --context functional-550000 logs -l app=hello-node-connect: exit status 1 (38.502262ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-550000

                                                
                                                
** /stderr **
functional_test.go:1606: "kubectl --context functional-550000 logs -l app=hello-node-connect" failed: exit status 1
functional_test.go:1608: hello-node logs:
functional_test.go:1610: (dbg) Run:  kubectl --context functional-550000 describe svc hello-node-connect
functional_test.go:1610: (dbg) Non-zero exit: kubectl --context functional-550000 describe svc hello-node-connect: exit status 1 (36.561158ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-550000

                                                
                                                
** /stderr **
functional_test.go:1612: "kubectl --context functional-550000 describe svc hello-node-connect" failed: exit status 1
functional_test.go:1614: hello-node svc describe:
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (72.666397ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/ServiceCmdConnect (0.22s)

                                                
                                    
x
+
TestFunctional/parallel/PersistentVolumeClaim (0.07s)

                                                
                                                
=== RUN   TestFunctional/parallel/PersistentVolumeClaim
=== PAUSE TestFunctional/parallel/PersistentVolumeClaim

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PersistentVolumeClaim
functional_test_pvc_test.go:45: failed waiting for storage-provisioner: client config: context "functional-550000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (72.771523ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/PersistentVolumeClaim (0.07s)

                                                
                                    
x
+
TestFunctional/parallel/SSHCmd (0.37s)

                                                
                                                
=== RUN   TestFunctional/parallel/SSHCmd
=== PAUSE TestFunctional/parallel/SSHCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/SSHCmd
functional_test.go:1721: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "echo hello"
functional_test.go:1721: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "echo hello": exit status 83 (157.885493ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1726: failed to run an ssh command. args "out/minikube-darwin-amd64 -p functional-550000 ssh \"echo hello\"" : exit status 83
functional_test.go:1730: expected minikube ssh command output to be -"hello"- but got *"* The control-plane node functional-550000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-550000\"\n"*. args "out/minikube-darwin-amd64 -p functional-550000 ssh \"echo hello\""
functional_test.go:1738: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "cat /etc/hostname"
functional_test.go:1738: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "cat /etc/hostname": exit status 83 (137.876633ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1744: failed to run an ssh command. args "out/minikube-darwin-amd64 -p functional-550000 ssh \"cat /etc/hostname\"" : exit status 83
functional_test.go:1748: expected minikube ssh command output to be -"functional-550000"- but got *"* The control-plane node functional-550000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-550000\"\n"*. args "out/minikube-darwin-amd64 -p functional-550000 ssh \"cat /etc/hostname\""
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (73.230269ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/SSHCmd (0.37s)

                                                
                                    
x
+
TestFunctional/parallel/CpCmd (0.96s)

                                                
                                                
=== RUN   TestFunctional/parallel/CpCmd
=== PAUSE TestFunctional/parallel/CpCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CpCmd
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 cp testdata/cp-test.txt /home/docker/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 cp testdata/cp-test.txt /home/docker/cp-test.txt: exit status 83 (152.855191ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-550000 cp testdata/cp-test.txt /home/docker/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh -n functional-550000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh -n functional-550000 "sudo cat /home/docker/cp-test.txt": exit status 83 (153.58204ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-550000 ssh -n functional-550000 \"sudo cat /home/docker/cp-test.txt\"" : exit status 83
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
strings.Join({
+ 	"* ",
	"T",
- 	"est file for checking file cp process",
+ 	"he control-plane node functional-550000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-550000\"\n",
}, "")
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 cp functional-550000:/home/docker/cp-test.txt /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelCpCmd1826797565/001/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 cp functional-550000:/home/docker/cp-test.txt /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelCpCmd1826797565/001/cp-test.txt: exit status 83 (192.085179ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-550000 cp functional-550000:/home/docker/cp-test.txt /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelCpCmd1826797565/001/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh -n functional-550000 "sudo cat /home/docker/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh -n functional-550000 "sudo cat /home/docker/cp-test.txt": exit status 83 (172.546873ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-550000 ssh -n functional-550000 \"sudo cat /home/docker/cp-test.txt\"" : exit status 83
helpers_test.go:528: failed to read test file 'testdata/cp-test.txt' : open /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelCpCmd1826797565/001/cp-test.txt: no such file or directory
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
string(
- 	"* The control-plane node functional-550000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-550000\"\n",
+ 	"",
)
helpers_test.go:556: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt
helpers_test.go:556: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt: exit status 83 (136.521654ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
helpers_test.go:561: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-550000 cp testdata/cp-test.txt /tmp/does/not/exist/cp-test.txt" : exit status 83
helpers_test.go:534: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh -n functional-550000 "sudo cat /tmp/does/not/exist/cp-test.txt"
helpers_test.go:534: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh -n functional-550000 "sudo cat /tmp/does/not/exist/cp-test.txt": exit status 83 (135.197833ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
helpers_test.go:539: failed to run an cp command. args "out/minikube-darwin-amd64 -p functional-550000 ssh -n functional-550000 \"sudo cat /tmp/does/not/exist/cp-test.txt\"" : exit status 83
helpers_test.go:573: /testdata/cp-test.txt content mismatch (-want +got):
strings.Join({
+ 	"* ",
	"T",
- 	"est file for checking file cp process",
+ 	"he control-plane node functional-550000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-550000\"\n",
}, "")
--- FAIL: TestFunctional/parallel/CpCmd (0.96s)

                                                
                                    
x
+
TestFunctional/parallel/MySQL (0.12s)

                                                
                                                
=== RUN   TestFunctional/parallel/MySQL
=== PAUSE TestFunctional/parallel/MySQL

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/MySQL
functional_test.go:1789: (dbg) Run:  kubectl --context functional-550000 replace --force -f testdata/mysql.yaml
functional_test.go:1789: (dbg) Non-zero exit: kubectl --context functional-550000 replace --force -f testdata/mysql.yaml: exit status 1 (39.823752ms)

                                                
                                                
** stderr ** 
	error: context "functional-550000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1791: failed to kubectl replace mysql: args "kubectl --context functional-550000 replace --force -f testdata/mysql.yaml" failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (75.086281ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/MySQL (0.12s)

                                                
                                    
x
+
TestFunctional/parallel/FileSync (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/FileSync
=== PAUSE TestFunctional/parallel/FileSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/FileSync
functional_test.go:1925: Checking for existence of /etc/test/nested/copy/1843/hosts within VM
functional_test.go:1927: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /etc/test/nested/copy/1843/hosts"
functional_test.go:1927: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /etc/test/nested/copy/1843/hosts": exit status 83 (138.818365ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1929: out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /etc/test/nested/copy/1843/hosts" failed: exit status 83
functional_test.go:1932: file sync test content: * The control-plane node functional-550000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-550000"
functional_test.go:1942: /etc/sync.test content mismatch (-want +got):
strings.Join({
+ 	"* ",
	"T",
- 	"est file for checking file sync process",
+ 	"he control-plane node functional-550000 host is not running: sta",
+ 	"te=Stopped\n  To start a cluster, run: \"minikube start -p functio",
+ 	"nal-550000\"\n",
}, "")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (73.256336ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/FileSync (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/CertSync (1.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/CertSync
=== PAUSE TestFunctional/parallel/CertSync

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/CertSync
functional_test.go:1968: Checking for existence of /etc/ssl/certs/1843.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /etc/ssl/certs/1843.pem"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /etc/ssl/certs/1843.pem": exit status 83 (184.282519ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/etc/ssl/certs/1843.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-550000 ssh \"sudo cat /etc/ssl/certs/1843.pem\"": exit status 83
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /etc/ssl/certs/1843.pem mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-550000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-550000"
	"""
)
functional_test.go:1968: Checking for existence of /usr/share/ca-certificates/1843.pem within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /usr/share/ca-certificates/1843.pem"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /usr/share/ca-certificates/1843.pem": exit status 83 (139.739184ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/usr/share/ca-certificates/1843.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-550000 ssh \"sudo cat /usr/share/ca-certificates/1843.pem\"": exit status 83
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /usr/share/ca-certificates/1843.pem mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-550000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-550000"
	"""
)
functional_test.go:1968: Checking for existence of /etc/ssl/certs/51391683.0 within VM
functional_test.go:1969: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /etc/ssl/certs/51391683.0"
functional_test.go:1969: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /etc/ssl/certs/51391683.0": exit status 83 (166.118927ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1971: failed to check existence of "/etc/ssl/certs/51391683.0" inside minikube. args "out/minikube-darwin-amd64 -p functional-550000 ssh \"sudo cat /etc/ssl/certs/51391683.0\"": exit status 83
functional_test.go:1977: failed verify pem file. minikube_test.pem -> /etc/ssl/certs/51391683.0 mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIDsDCCApgCCQD5n0OIsOYIjDANBgkqhkiG9w0BAQsFADCBmTELMAkGA1UEBhMC
- 	VVMxEzARBgNVBAgMCkNhbGlmb3JuaWExFjAUBgNVBAcMDVNhbiBGcmFuY2lzY28x
- 	ETAPBgNVBAoMCG1pbmlrdWJlMRYwFAYDVQQLDA1QYXJ0eSBQYXJyb3RzMREwDwYD
- 	VQQDDAhtaW5pa3ViZTEfMB0GCSqGSIb3DQEJARYQbWluaWt1YmVAY25jZi5pbzAe
- 	Fw0yMDAzMDQyMTU2MjZaFw0yMTAzMDQyMTU2MjZaMIGZMQswCQYDVQQGEwJVUzET
- 	MBEGA1UECAwKQ2FsaWZvcm5pYTEWMBQGA1UEBwwNU2FuIEZyYW5jaXNjbzERMA8G
- 	A1UECgwIbWluaWt1YmUxFjAUBgNVBAsMDVBhcnR5IFBhcnJvdHMxETAPBgNVBAMM
- 	CG1pbmlrdWJlMR8wHQYJKoZIhvcNAQkBFhBtaW5pa3ViZUBjbmNmLmlvMIIBIjAN
- 	BgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA/qVMQ/234ul5yWI1yaHvV4pZ5Ffy
- 	M0bSMjzZUwlsvzerXzF3WrdpeZs5GzBNBWL/Db9KziGHCtfX9j5okJqPvB2lxdL5
- 	d5hFIYSORSemYLX2kdlnlykY5fzmFLKIUO9xXs0YNF4JUMEBgGK6n/BdLvXDUULZ
- 	26QOKs6+iH7TAL4RtozxQ8YXKQArdmpeAvxy2PSZGvVk1htKtyuKQsiFqH3oRleK
- 	3mljXfC5LsoIJHqd/8lAsckH87+IfwYnJ1CNJM2gueaCf+HmudVrvXfHaszh1Wh1
- 	9HKPE95Azi6CKoBGlRGFxt8UR72YIcTjC/lYxzbHeCpU7RCiXfsC0iMTlQIDAQAB
- 	MA0GCSqGSIb3DQEBCwUAA4IBAQBhsKnghyBki4NOnK5gHm7ow+7S+xvkjJhXBQ6i
- 	/xQD4/GCZ1tH5iFHXmo+bt4jB9hvKLyN5M5a8TlDwwqTLIoPDQJh37UpSCwbY/6z
- 	nE2aP3N2ue1/DeY60tgAh1c1uJDMeTiFbalJqSkneaHpNfvEQhUORFoN4yQSVEYg
- 	+T9mzTAWQ55TeBgbRevmA25nXHdPAae1MvJWDeG+aJfhq1I2hCwaitJ3iSwgn2ew
- 	637It/aBkMLhsCKTHxlXDGUX401ddbc0ZiC308cyMbis3iBeh4RBjkFxP8eIWFmK
- 	sos/dyqdua742L1cOKYFbLJfjA1VyxJQUxQvWKkbaq0xi7ao
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-550000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-550000"
	"""
)
functional_test.go:1995: Checking for existence of /etc/ssl/certs/18432.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /etc/ssl/certs/18432.pem"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /etc/ssl/certs/18432.pem": exit status 83 (143.671869ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/etc/ssl/certs/18432.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-550000 ssh \"sudo cat /etc/ssl/certs/18432.pem\"": exit status 83
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /etc/ssl/certs/18432.pem mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-550000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-550000"
	"""
)
functional_test.go:1995: Checking for existence of /usr/share/ca-certificates/18432.pem within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /usr/share/ca-certificates/18432.pem"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /usr/share/ca-certificates/18432.pem": exit status 83 (175.399815ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/usr/share/ca-certificates/18432.pem" inside minikube. args "out/minikube-darwin-amd64 -p functional-550000 ssh \"sudo cat /usr/share/ca-certificates/18432.pem\"": exit status 83
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /usr/share/ca-certificates/18432.pem mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-550000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-550000"
	"""
)
functional_test.go:1995: Checking for existence of /etc/ssl/certs/3ec20f2e.0 within VM
functional_test.go:1996: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0"
functional_test.go:1996: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "sudo cat /etc/ssl/certs/3ec20f2e.0": exit status 83 (140.401169ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1998: failed to check existence of "/etc/ssl/certs/3ec20f2e.0" inside minikube. args "out/minikube-darwin-amd64 -p functional-550000 ssh \"sudo cat /etc/ssl/certs/3ec20f2e.0\"": exit status 83
functional_test.go:2004: failed verify pem file. minikube_test2.pem -> /etc/ssl/certs/3ec20f2e.0 mismatch (-want +got):
(
	"""
- 	-----BEGIN CERTIFICATE-----
- 	MIIEwDCCAqgCCQCUeXrVemI4eTANBgkqhkiG9w0BAQsFADAiMQswCQYDVQQGEwJV
- 	UzETMBEGA1UECAwKQ2FsaWZvcm5pYTAeFw0yMTA3MjEyMDM4MDdaFw0yMTA4MjAy
- 	MDM4MDdaMCIxCzAJBgNVBAYTAlVTMRMwEQYDVQQIDApDYWxpZm9ybmlhMIICIjAN
- 	BgkqhkiG9w0BAQEFAAOCAg8AMIICCgKCAgEAu1+sCiosrYIy83a+KtPdoGsKun+O
- 	jKhETWQrum5FGxqKyQzhHN8q6iZBI94m1sZb2xIJDcKaAsHpKf1z/5pkrWQW4JeL
- 	riqJ5U0kENy6mWGoFzPLQHkKMXSYUEkRjrgJphh5zLkWDzx6uwxHIrs5yaIwn71Z
- 	enYezHL8NyMd10+up1lNvH+xGqnSJ3ge7Rj+r5XbA3avvaJ9AVdiJMU5ArMw4Snu
- 	dLDSUueWFedmXoQud083EvDbMY61blNKUR6BKBJLPopH+9NnUP7FRU25lvTsA8qT
- 	zz/KertMFhCfwvK4y7a7+GbIPD3fItpm23GORuViEGgeRMH7GGSNVfm4VtK5mI4c
- 	XK9BrCE+FXowHOWU3MTH1qsvTigd3JZc8BKTaePJGMIDT1HIAaoK7SOoZOLka7bi
- 	IiLaojrIWY6tE5IIl46cQWLg09G+kjKVfEEvEHNe0t22I9etGeUUEwlcMITHmEdE
- 	WrXytC8dSNFObSG5B2MX2Ovm+yNblcK7TI7lW/tkbxtKs56J1mNmi4LXXBM8FdF8
- 	w9MpJc+ySVj2+f+eBE08amKjC9VVbBzNSw7MRaI9fFY5AAifJ8g55F3/KCNq5aTd
- 	rBADtAa5kQkTVjfMBhG++0Ow4f55hm73oJAy/qxb09OY7Vk9ky/K3l8GfWv8ozIF
- 	w+Oq6vdsspvtVJ8CAwEAATANBgkqhkiG9w0BAQsFAAOCAgEAGKVxsf13kYGaQJ+J
- 	6eyRZXlV5Bp+9EGtMPGsuVv2HJa4oxMBn7Xc/bUhjY9Is/ZwfOpPUPO/nQtSSPmO
- 	aozQj/27p8HDTW201fwLNiZMcppBdJvIQdDzCh6e2ikg3lqsw2BoLX1vbgc9HPml
- 	P8QCHEz2lricGdTuMRtBgH5x/ZkZGLbADQBeyoPTsPaQceRt5hPYXWifqiHhcJoL
- 	2T+XgbaHJ4lEhCU0IXJG0vlLuAyxQzO3gMeHK8BlLt/h/JCiDndo63a4XCkenmY8
- 	8/6Y9Lgh+O3954YgwdXBIS33CzhY7c+tfpag1hwpDHro/zsyLwdN2JxZqWymfg8T
- 	RyIeJ5VpY+CGm1fVTx84twQbiM241eZDYaW6Ap5/ZuxPbzY++KDMZHMuJYURorAU
- 	JE/SE6WltXpKTvtzyPNKt8fgPQmFzlBosDZCf/5EiyVqbLzideF1l+Rd//5gRBg0
- 	B63fOlCdxGtDeX1gKzekV4sXQIsWKW1BSCEInJt5lOS8Ex4JTXy8crwKo7hv0zPc
- 	sOjAXbtDYlPf/jPFGKzkgFACB87Bx4ZUZMp/ShOzjMt20MLGLJvCGCQIHetUz+GG
- 	/LTwSNhgWCheYkbDwXhCmqbN249xE3fNHC6zQ/IMJ30v/UWN4RldGfFzmoVBRUUX
- 	eQ7g5kXER7H/Lh/2V9FyaRhPpZM=
- 	-----END CERTIFICATE-----
+ 	* The control-plane node functional-550000 host is not running: state=Stopped
+ 	  To start a cluster, run: "minikube start -p functional-550000"
	"""
)
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (86.894781ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/CertSync (1.04s)

                                                
                                    
x
+
TestFunctional/parallel/NodeLabels (0.13s)

                                                
                                                
=== RUN   TestFunctional/parallel/NodeLabels
=== PAUSE TestFunctional/parallel/NodeLabels

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NodeLabels
functional_test.go:218: (dbg) Run:  kubectl --context functional-550000 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'"
functional_test.go:218: (dbg) Non-zero exit: kubectl --context functional-550000 get nodes --output=go-template "--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'": exit status 1 (46.589122ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-550000

                                                
                                                
** /stderr **
functional_test.go:220: failed to 'kubectl get nodes' with args "kubectl --context functional-550000 get nodes --output=go-template \"--template='{{range $k, $v := (index .items 0).metadata.labels}}{{$k}} {{end}}'\"": exit status 1
functional_test.go:226: expected to have label "minikube.k8s.io/commit" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-550000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/version" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-550000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/updated_at" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-550000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/name" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-550000

                                                
                                                
** /stderr **
functional_test.go:226: expected to have label "minikube.k8s.io/primary" in node labels but got : 
** stderr ** 
	Error in configuration: context was not found for specified context: functional-550000

                                                
                                                
** /stderr **
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p functional-550000 -n functional-550000: exit status 7 (79.721772ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "functional-550000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestFunctional/parallel/NodeLabels (0.13s)

                                                
                                    
x
+
TestFunctional/parallel/NonActiveRuntimeDisabled (0.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/NonActiveRuntimeDisabled
=== PAUSE TestFunctional/parallel/NonActiveRuntimeDisabled

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/NonActiveRuntimeDisabled
functional_test.go:2023: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "sudo systemctl is-active crio"
functional_test.go:2023: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "sudo systemctl is-active crio": exit status 83 (160.458613ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:2026: output of 
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --: exit status 83
functional_test.go:2029: For runtime "docker": expected "crio" to be inactive but got "* The control-plane node functional-550000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-550000\"\n" 
--- FAIL: TestFunctional/parallel/NonActiveRuntimeDisabled (0.16s)

                                                
                                    
x
+
TestFunctional/parallel/Version/components (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/components
=== PAUSE TestFunctional/parallel/Version/components

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/components
functional_test.go:2266: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 version -o=json --components
functional_test.go:2266: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 version -o=json --components: exit status 83 (136.359396ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:2268: error version: exit status 83
functional_test.go:2273: expected to see "buildctl" in the minikube version --components but got:
* The control-plane node functional-550000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-550000"
functional_test.go:2273: expected to see "commit" in the minikube version --components but got:
* The control-plane node functional-550000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-550000"
functional_test.go:2273: expected to see "containerd" in the minikube version --components but got:
* The control-plane node functional-550000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-550000"
functional_test.go:2273: expected to see "crictl" in the minikube version --components but got:
* The control-plane node functional-550000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-550000"
functional_test.go:2273: expected to see "crio" in the minikube version --components but got:
* The control-plane node functional-550000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-550000"
functional_test.go:2273: expected to see "ctr" in the minikube version --components but got:
* The control-plane node functional-550000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-550000"
functional_test.go:2273: expected to see "docker" in the minikube version --components but got:
* The control-plane node functional-550000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-550000"
functional_test.go:2273: expected to see "minikubeVersion" in the minikube version --components but got:
* The control-plane node functional-550000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-550000"
functional_test.go:2273: expected to see "podman" in the minikube version --components but got:
* The control-plane node functional-550000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-550000"
functional_test.go:2273: expected to see "crun" in the minikube version --components but got:
* The control-plane node functional-550000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-550000"
--- FAIL: TestFunctional/parallel/Version/components (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListShort (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListShort
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListShort

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListShort
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image ls --format short --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-550000 image ls --format short --alsologtostderr:

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-550000 image ls --format short --alsologtostderr:
I0307 13:58:53.055379    3217 out.go:291] Setting OutFile to fd 1 ...
I0307 13:58:53.055577    3217 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:58:53.055583    3217 out.go:304] Setting ErrFile to fd 2...
I0307 13:58:53.055586    3217 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:58:53.055761    3217 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
I0307 13:58:53.056339    3217 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 13:58:53.056432    3217 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 13:58:53.056751    3217 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:58:53.056792    3217 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 13:58:53.064340    3217 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50079
I0307 13:58:53.064742    3217 main.go:141] libmachine: () Calling .GetVersion
I0307 13:58:53.065145    3217 main.go:141] libmachine: Using API Version  1
I0307 13:58:53.065176    3217 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 13:58:53.065409    3217 main.go:141] libmachine: () Calling .GetMachineName
I0307 13:58:53.065515    3217 main.go:141] libmachine: (functional-550000) Calling .GetState
I0307 13:58:53.065605    3217 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:58:53.065643    3217 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
I0307 13:58:53.065650    3217 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
I0307 13:58:53.065731    3217 main.go:141] libmachine: Making call to close driver server
I0307 13:58:53.065746    3217 main.go:141] libmachine: (functional-550000) Calling .Close
I0307 13:58:53.065835    3217 main.go:141] libmachine: (functional-550000) DBG | Closing plugin on server side
I0307 13:58:53.065843    3217 main.go:141] libmachine: Successfully made call to close driver server
I0307 13:58:53.065853    3217 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListShort (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListTable (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListTable
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListTable

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListTable
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image ls --format table --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-550000 image ls --format table --alsologtostderr:
|-------|-----|----------|------|
| Image | Tag | Image ID | Size |
|-------|-----|----------|------|
|-------|-----|----------|------|
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-550000 image ls --format table --alsologtostderr:
I0307 13:58:53.698836    3235 out.go:291] Setting OutFile to fd 1 ...
I0307 13:58:53.699033    3235 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:58:53.699039    3235 out.go:304] Setting ErrFile to fd 2...
I0307 13:58:53.699043    3235 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:58:53.699229    3235 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
I0307 13:58:53.699822    3235 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 13:58:53.699916    3235 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 13:58:53.700249    3235 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:58:53.700292    3235 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 13:58:53.708020    3235 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50091
I0307 13:58:53.708401    3235 main.go:141] libmachine: () Calling .GetVersion
I0307 13:58:53.708816    3235 main.go:141] libmachine: Using API Version  1
I0307 13:58:53.708849    3235 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 13:58:53.709084    3235 main.go:141] libmachine: () Calling .GetMachineName
I0307 13:58:53.709199    3235 main.go:141] libmachine: (functional-550000) Calling .GetState
I0307 13:58:53.709286    3235 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:58:53.709303    3235 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
I0307 13:58:53.709317    3235 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
I0307 13:58:53.709442    3235 main.go:141] libmachine: Making call to close driver server
I0307 13:58:53.709454    3235 main.go:141] libmachine: (functional-550000) Calling .Close
I0307 13:58:53.709539    3235 main.go:141] libmachine: (functional-550000) DBG | Closing plugin on server side
I0307 13:58:53.709579    3235 main.go:141] libmachine: Successfully made call to close driver server
I0307 13:58:53.709604    3235 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected | registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListTable (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListJson (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListJson
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListJson

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListJson
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image ls --format json --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-550000 image ls --format json --alsologtostderr:
[]
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-550000 image ls --format json --alsologtostderr:
I0307 13:58:53.602673    3232 out.go:291] Setting OutFile to fd 1 ...
I0307 13:58:53.602863    3232 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:58:53.602869    3232 out.go:304] Setting ErrFile to fd 2...
I0307 13:58:53.602872    3232 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:58:53.603057    3232 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
I0307 13:58:53.603737    3232 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 13:58:53.603832    3232 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 13:58:53.604166    3232 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:58:53.604210    3232 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 13:58:53.611846    3232 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50089
I0307 13:58:53.612245    3232 main.go:141] libmachine: () Calling .GetVersion
I0307 13:58:53.612657    3232 main.go:141] libmachine: Using API Version  1
I0307 13:58:53.612697    3232 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 13:58:53.612926    3232 main.go:141] libmachine: () Calling .GetMachineName
I0307 13:58:53.613035    3232 main.go:141] libmachine: (functional-550000) Calling .GetState
I0307 13:58:53.613128    3232 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:58:53.613159    3232 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
I0307 13:58:53.613167    3232 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
I0307 13:58:53.613274    3232 main.go:141] libmachine: Making call to close driver server
I0307 13:58:53.613280    3232 main.go:141] libmachine: (functional-550000) Calling .Close
I0307 13:58:53.613360    3232 main.go:141] libmachine: Successfully made call to close driver server
I0307 13:58:53.613365    3232 main.go:141] libmachine: (functional-550000) DBG | Closing plugin on server side
I0307 13:58:53.613370    3232 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected ["registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListJson (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageListYaml (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageListYaml
=== PAUSE TestFunctional/parallel/ImageCommands/ImageListYaml

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageListYaml
functional_test.go:260: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image ls --format yaml --alsologtostderr
functional_test.go:265: (dbg) Stdout: out/minikube-darwin-amd64 -p functional-550000 image ls --format yaml --alsologtostderr:
[]

                                                
                                                
functional_test.go:268: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-550000 image ls --format yaml --alsologtostderr:
I0307 13:58:53.151825    3220 out.go:291] Setting OutFile to fd 1 ...
I0307 13:58:53.152087    3220 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:58:53.152095    3220 out.go:304] Setting ErrFile to fd 2...
I0307 13:58:53.152099    3220 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:58:53.152263    3220 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
I0307 13:58:53.152824    3220 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 13:58:53.152921    3220 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 13:58:53.153258    3220 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:58:53.153301    3220 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 13:58:53.160942    3220 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50081
I0307 13:58:53.161338    3220 main.go:141] libmachine: () Calling .GetVersion
I0307 13:58:53.161758    3220 main.go:141] libmachine: Using API Version  1
I0307 13:58:53.161793    3220 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 13:58:53.162027    3220 main.go:141] libmachine: () Calling .GetMachineName
I0307 13:58:53.162145    3220 main.go:141] libmachine: (functional-550000) Calling .GetState
I0307 13:58:53.162231    3220 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:58:53.162246    3220 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
I0307 13:58:53.162256    3220 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
I0307 13:58:53.162347    3220 main.go:141] libmachine: Making call to close driver server
I0307 13:58:53.162362    3220 main.go:141] libmachine: (functional-550000) Calling .Close
I0307 13:58:53.162448    3220 main.go:141] libmachine: (functional-550000) DBG | Closing plugin on server side
I0307 13:58:53.162469    3220 main.go:141] libmachine: Successfully made call to close driver server
I0307 13:58:53.162479    3220 main.go:141] libmachine: Making call to close connection to plugin binary
functional_test.go:274: expected - registry.k8s.io/pause to be listed with minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageListYaml (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageBuild (0.35s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageBuild
=== PAUSE TestFunctional/parallel/ImageCommands/ImageBuild

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ImageCommands/ImageBuild
functional_test.go:307: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh pgrep buildkitd
functional_test.go:307: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh pgrep buildkitd: exit status 83 (158.494759ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:314: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image build -t localhost/my-image:functional-550000 testdata/build --alsologtostderr
functional_test.go:322: (dbg) Stderr: out/minikube-darwin-amd64 -p functional-550000 image build -t localhost/my-image:functional-550000 testdata/build --alsologtostderr:
I0307 13:58:53.407679    3226 out.go:291] Setting OutFile to fd 1 ...
I0307 13:58:53.408043    3226 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:58:53.408049    3226 out.go:304] Setting ErrFile to fd 2...
I0307 13:58:53.408053    3226 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:58:53.408236    3226 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
I0307 13:58:53.408823    3226 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 13:58:53.409423    3226 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 13:58:53.409795    3226 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:58:53.409838    3226 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 13:58:53.417371    3226 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50085
I0307 13:58:53.417755    3226 main.go:141] libmachine: () Calling .GetVersion
I0307 13:58:53.418169    3226 main.go:141] libmachine: Using API Version  1
I0307 13:58:53.418180    3226 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 13:58:53.418377    3226 main.go:141] libmachine: () Calling .GetMachineName
I0307 13:58:53.418468    3226 main.go:141] libmachine: (functional-550000) Calling .GetState
I0307 13:58:53.418551    3226 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:58:53.418598    3226 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
I0307 13:58:53.418615    3226 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
I0307 13:58:53.418624    3226 build_images.go:123] succeeded building to: 
I0307 13:58:53.418632    3226 build_images.go:124] failed building to: 
I0307 13:58:53.418642    3226 main.go:141] libmachine: Making call to close driver server
I0307 13:58:53.418650    3226 main.go:141] libmachine: (functional-550000) Calling .Close
I0307 13:58:53.418727    3226 main.go:141] libmachine: Successfully made call to close driver server
I0307 13:58:53.418737    3226 main.go:141] libmachine: Making call to close connection to plugin binary
I0307 13:58:53.418744    3226 main.go:141] libmachine: (functional-550000) DBG | Closing plugin on server side
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image ls
functional_test.go:442: expected "localhost/my-image:functional-550000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageBuild (0.35s)

                                                
                                    
x
+
TestFunctional/parallel/DockerEnv/bash (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/DockerEnv/bash
functional_test.go:495: (dbg) Run:  /bin/bash -c "eval $(out/minikube-darwin-amd64 -p functional-550000 docker-env) && out/minikube-darwin-amd64 status -p functional-550000"
functional_test.go:495: (dbg) Non-zero exit: /bin/bash -c "eval $(out/minikube-darwin-amd64 -p functional-550000 docker-env) && out/minikube-darwin-amd64 status -p functional-550000": exit status 1 (143.001844ms)
functional_test.go:501: failed to do status after eval-ing docker-env. error: exit status 1
--- FAIL: TestFunctional/parallel/DockerEnv/bash (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_changes (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_changes
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_changes

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_changes
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 update-context --alsologtostderr -v=2: exit status 83 (137.105598ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 13:58:52.622368    3207 out.go:291] Setting OutFile to fd 1 ...
	I0307 13:58:52.622758    3207 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:58:52.622765    3207 out.go:304] Setting ErrFile to fd 2...
	I0307 13:58:52.622768    3207 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:58:52.622959    3207 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 13:58:52.623290    3207 mustload.go:65] Loading cluster: functional-550000
	I0307 13:58:52.623594    3207 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 13:58:52.623921    3207 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:58:52.623973    3207 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 13:58:52.631627    3207 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50073
	I0307 13:58:52.632019    3207 main.go:141] libmachine: () Calling .GetVersion
	I0307 13:58:52.632441    3207 main.go:141] libmachine: Using API Version  1
	I0307 13:58:52.632452    3207 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 13:58:52.632664    3207 main.go:141] libmachine: () Calling .GetMachineName
	I0307 13:58:52.632776    3207 main.go:141] libmachine: (functional-550000) Calling .GetState
	I0307 13:58:52.632866    3207 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 13:58:52.632883    3207 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
	I0307 13:58:52.632897    3207 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
	I0307 13:58:52.654773    3207 out.go:177] * The control-plane node functional-550000 host is not running: state=Stopped
	I0307 13:58:52.676460    3207 out.go:177]   To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-550000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2122: update-context: got="* The control-plane node functional-550000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-550000\"\n", want=*"No changes"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_changes (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 update-context --alsologtostderr -v=2: exit status 83 (157.808625ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 13:58:52.895892    3214 out.go:291] Setting OutFile to fd 1 ...
	I0307 13:58:52.896067    3214 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:58:52.896072    3214 out.go:304] Setting ErrFile to fd 2...
	I0307 13:58:52.896076    3214 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:58:52.896879    3214 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 13:58:52.897424    3214 mustload.go:65] Loading cluster: functional-550000
	I0307 13:58:52.897688    3214 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 13:58:52.898018    3214 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:58:52.898076    3214 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 13:58:52.905671    3214 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50077
	I0307 13:58:52.906094    3214 main.go:141] libmachine: () Calling .GetVersion
	I0307 13:58:52.906519    3214 main.go:141] libmachine: Using API Version  1
	I0307 13:58:52.906528    3214 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 13:58:52.906707    3214 main.go:141] libmachine: () Calling .GetMachineName
	I0307 13:58:52.906847    3214 main.go:141] libmachine: (functional-550000) Calling .GetState
	I0307 13:58:52.906950    3214 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 13:58:52.907001    3214 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
	I0307 13:58:52.907017    3214 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
	I0307 13:58:52.929146    3214 out.go:177] * The control-plane node functional-550000 host is not running: state=Stopped
	I0307 13:58:52.971386    3214 out.go:177]   To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-550000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2122: update-context: got="* The control-plane node functional-550000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-550000\"\n", want=*"context has been updated"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_minikube_cluster (0.16s)

                                                
                                    
x
+
TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/UpdateContextCmd/no_clusters
=== PAUSE TestFunctional/parallel/UpdateContextCmd/no_clusters

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/UpdateContextCmd/no_clusters
functional_test.go:2115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 update-context --alsologtostderr -v=2
functional_test.go:2115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 update-context --alsologtostderr -v=2: exit status 83 (136.456686ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 13:58:52.759978    3211 out.go:291] Setting OutFile to fd 1 ...
	I0307 13:58:52.760240    3211 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:58:52.760246    3211 out.go:304] Setting ErrFile to fd 2...
	I0307 13:58:52.760250    3211 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:58:52.760427    3211 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 13:58:52.760733    3211 mustload.go:65] Loading cluster: functional-550000
	I0307 13:58:52.761005    3211 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 13:58:52.761373    3211 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:58:52.761421    3211 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 13:58:52.769111    3211 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50075
	I0307 13:58:52.769495    3211 main.go:141] libmachine: () Calling .GetVersion
	I0307 13:58:52.769913    3211 main.go:141] libmachine: Using API Version  1
	I0307 13:58:52.769933    3211 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 13:58:52.770173    3211 main.go:141] libmachine: () Calling .GetMachineName
	I0307 13:58:52.770289    3211 main.go:141] libmachine: (functional-550000) Calling .GetState
	I0307 13:58:52.770375    3211 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 13:58:52.770402    3211 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
	I0307 13:58:52.770409    3211 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
	I0307 13:58:52.792267    3211 out.go:177] * The control-plane node functional-550000 host is not running: state=Stopped
	I0307 13:58:52.814022    3211 out.go:177]   To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
** /stderr **
functional_test.go:2117: failed to run minikube update-context: args "out/minikube-darwin-amd64 -p functional-550000 update-context --alsologtostderr -v=2": exit status 83
functional_test.go:2122: update-context: got="* The control-plane node functional-550000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-550000\"\n", want=*"context has been updated"*
--- FAIL: TestFunctional/parallel/UpdateContextCmd/no_clusters (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/DeployApp (0.04s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/DeployApp
functional_test.go:1435: (dbg) Run:  kubectl --context functional-550000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8
functional_test.go:1435: (dbg) Non-zero exit: kubectl --context functional-550000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8: exit status 1 (42.169583ms)

                                                
                                                
** stderr ** 
	error: context "functional-550000" does not exist

                                                
                                                
** /stderr **
functional_test.go:1439: failed to create hello-node deployment with this command "kubectl --context functional-550000 create deployment hello-node --image=registry.k8s.io/echoserver:1.8": exit status 1.
--- FAIL: TestFunctional/parallel/ServiceCmd/DeployApp (0.04s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/List (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/List
functional_test.go:1455: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 service list
functional_test.go:1455: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 service list: exit status 83 (203.772611ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1457: failed to do service list. args "out/minikube-darwin-amd64 -p functional-550000 service list" : exit status 83
functional_test.go:1460: expected 'service list' to contain *hello-node* but got -"* The control-plane node functional-550000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-550000\"\n"-
--- FAIL: TestFunctional/parallel/ServiceCmd/List (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/JSONOutput (0.18s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/JSONOutput
functional_test.go:1485: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 service list -o json
functional_test.go:1485: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 service list -o json: exit status 83 (182.279608ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1487: failed to list services with json format. args "out/minikube-darwin-amd64 -p functional-550000 service list -o json": exit status 83
--- FAIL: TestFunctional/parallel/ServiceCmd/JSONOutput (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/HTTPS (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/HTTPS
functional_test.go:1505: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 service --namespace=default --https --url hello-node
functional_test.go:1505: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 service --namespace=default --https --url hello-node: exit status 83 (140.166665ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1507: failed to get service url. args "out/minikube-darwin-amd64 -p functional-550000 service --namespace=default --https --url hello-node" : exit status 83
--- FAIL: TestFunctional/parallel/ServiceCmd/HTTPS (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/Format (0.16s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/Format
functional_test.go:1536: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 service hello-node --url --format={{.IP}}
functional_test.go:1536: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 service hello-node --url --format={{.IP}}: exit status 83 (156.994853ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1538: failed to get service url with custom format. args "out/minikube-darwin-amd64 -p functional-550000 service hello-node --url --format={{.IP}}": exit status 83
functional_test.go:1544: "* The control-plane node functional-550000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-550000\"" is not a valid IP
--- FAIL: TestFunctional/parallel/ServiceCmd/Format (0.16s)

                                                
                                    
x
+
TestFunctional/parallel/ServiceCmd/URL (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/ServiceCmd/URL
functional_test.go:1555: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 service hello-node --url
functional_test.go:1555: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 service hello-node --url: exit status 83 (140.439241ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test.go:1557: failed to get service url. args: "out/minikube-darwin-amd64 -p functional-550000 service hello-node --url": exit status 83
functional_test.go:1561: found endpoint for hello-node: * The control-plane node functional-550000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-550000"
functional_test.go:1565: failed to parse "* The control-plane node functional-550000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-550000\"": parse "* The control-plane node functional-550000 host is not running: state=Stopped\n  To start a cluster, run: \"minikube start -p functional-550000\"": net/url: invalid control character in URL
--- FAIL: TestFunctional/parallel/ServiceCmd/URL (0.14s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.34s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-550000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:154: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-550000 tunnel --alsologtostderr]
functional_test_tunnel_test.go:190: tunnel command failed with unexpected error: exit code 83. stderr: I0307 13:57:59.818352    2945 out.go:291] Setting OutFile to fd 1 ...
I0307 13:57:59.818559    2945 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:57:59.818565    2945 out.go:304] Setting ErrFile to fd 2...
I0307 13:57:59.818569    2945 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 13:57:59.818758    2945 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
I0307 13:57:59.819325    2945 mustload.go:65] Loading cluster: functional-550000
I0307 13:57:59.819604    2945 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 13:57:59.819974    2945 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
I0307 13:57:59.820018    2945 main.go:141] libmachine: Launching plugin server for driver hyperkit
I0307 13:57:59.827630    2945 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:49926
I0307 13:57:59.828060    2945 main.go:141] libmachine: () Calling .GetVersion
I0307 13:57:59.828486    2945 main.go:141] libmachine: Using API Version  1
I0307 13:57:59.828496    2945 main.go:141] libmachine: () Calling .SetConfigRaw
I0307 13:57:59.828722    2945 main.go:141] libmachine: () Calling .GetMachineName
I0307 13:57:59.828830    2945 main.go:141] libmachine: (functional-550000) Calling .GetState
I0307 13:57:59.828919    2945 main.go:141] libmachine: (functional-550000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
I0307 13:57:59.828939    2945 main.go:141] libmachine: (functional-550000) DBG | hyperkit pid from json: 0
I0307 13:57:59.828968    2945 main.go:141] libmachine: (functional-550000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/functional-550000/hyperkit.json: no such file or directory
I0307 13:57:59.850501    2945 out.go:177] * The control-plane node functional-550000 host is not running: state=Stopped
I0307 13:57:59.913188    2945 out.go:177]   To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
stdout: * The control-plane node functional-550000 host is not running: state=Stopped
To start a cluster, run: "minikube start -p functional-550000"
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-amd64 -p functional-550000 tunnel --alsologtostderr] ...
helpers_test.go:508: unable to kill pid 2949: os: process already finished
helpers_test.go:502: unable to terminate pid 2946: os: process already finished
functional_test_tunnel_test.go:194: read stdout failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-550000 tunnel --alsologtostderr] stdout:
functional_test_tunnel_test.go:194: read stderr failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-550000 tunnel --alsologtostderr] stderr:
functional_test_tunnel_test.go:194: (dbg) stopping [out/minikube-darwin-amd64 -p functional-550000 tunnel --alsologtostderr] ...
helpers_test.go:490: unable to find parent, assuming dead: process does not exist
functional_test_tunnel_test.go:194: read stdout failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-550000 tunnel --alsologtostderr] stdout:
functional_test_tunnel_test.go:194: read stderr failed: read |0: file already closed
functional_test_tunnel_test.go:194: (dbg) [out/minikube-darwin-amd64 -p functional-550000 tunnel --alsologtostderr] stderr:
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/RunSecondTunnel (0.34s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup
functional_test_tunnel_test.go:208: failed to get Kubernetes client for "functional-550000": client config: context "functional-550000" does not exist
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessDirect (103.76s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessDirect
functional_test_tunnel_test.go:288: failed to hit nginx at "http://": Temporary Error: Get "http:": http: no Host in request URL
functional_test_tunnel_test.go:290: (dbg) Run:  kubectl --context functional-550000 get svc nginx-svc
functional_test_tunnel_test.go:290: (dbg) Non-zero exit: kubectl --context functional-550000 get svc nginx-svc: exit status 1 (36.935371ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: functional-550000

                                                
                                                
** /stderr **
functional_test_tunnel_test.go:292: kubectl --context functional-550000 get svc nginx-svc failed: exit status 1
functional_test_tunnel_test.go:294: failed to kubectl get svc nginx-svc:
functional_test_tunnel_test.go:301: expected body to contain "Welcome to nginx!", but got *""*
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/AccessDirect (103.76s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.91s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadDaemon
functional_test.go:354: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image load --daemon gcr.io/google-containers/addon-resizer:functional-550000 --alsologtostderr
functional_test.go:354: (dbg) Done: out/minikube-darwin-amd64 -p functional-550000 image load --daemon gcr.io/google-containers/addon-resizer:functional-550000 --alsologtostderr: (1.815860736s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-550000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadDaemon (1.91s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.82s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageReloadDaemon
functional_test.go:364: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image load --daemon gcr.io/google-containers/addon-resizer:functional-550000 --alsologtostderr
functional_test.go:364: (dbg) Done: out/minikube-darwin-amd64 -p functional-550000 image load --daemon gcr.io/google-containers/addon-resizer:functional-550000 --alsologtostderr: (1.7268099s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-550000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageReloadDaemon (1.82s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (7.36s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon
functional_test.go:234: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.9
functional_test.go:234: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.9: (5.581222573s)
functional_test.go:239: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.9 gcr.io/google-containers/addon-resizer:functional-550000
functional_test.go:244: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image load --daemon gcr.io/google-containers/addon-resizer:functional-550000 --alsologtostderr
functional_test.go:244: (dbg) Done: out/minikube-darwin-amd64 -p functional-550000 image load --daemon gcr.io/google-containers/addon-resizer:functional-550000 --alsologtostderr: (1.627826508s)
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-550000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (7.36s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.1s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveToFile
functional_test.go:379: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image save gcr.io/google-containers/addon-resizer:functional-550000 /Users/jenkins/workspace/addon-resizer-save.tar --alsologtostderr
functional_test.go:385: expected "/Users/jenkins/workspace/addon-resizer-save.tar" to exist after `image save`, but doesn't exist
--- FAIL: TestFunctional/parallel/ImageCommands/ImageSaveToFile (0.10s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.19s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageLoadFromFile
functional_test.go:408: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image load /Users/jenkins/workspace/addon-resizer-save.tar --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image ls
functional_test.go:442: expected "gcr.io/google-containers/addon-resizer:functional-550000" to be loaded into minikube but the image is not there
--- FAIL: TestFunctional/parallel/ImageCommands/ImageLoadFromFile (0.19s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (15.05s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig
functional_test_tunnel_test.go:319: (dbg) Run:  dig +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A
E0307 13:59:45.405243    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
E0307 13:59:45.411901    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
E0307 13:59:45.422107    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
E0307 13:59:45.444294    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
E0307 13:59:45.484928    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
E0307 13:59:45.566866    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
E0307 13:59:45.729147    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
E0307 13:59:46.051364    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
E0307 13:59:46.693589    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
E0307 13:59:47.993122    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
E0307 13:59:50.553894    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
E0307 13:59:55.674479    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
functional_test_tunnel_test.go:319: (dbg) Non-zero exit: dig +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A: exit status 9 (15.023801042s)

                                                
                                                
-- stdout --
	
	; <<>> DiG 9.10.6 <<>> +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A
	; (1 server found)
	;; global options: +cmd
	;; connection timed out; no servers could be reached

                                                
                                                
-- /stdout --
functional_test_tunnel_test.go:322: failed to resolve DNS name: exit status 9
functional_test_tunnel_test.go:329: expected body to contain "ANSWER: 1", but got *"\n; <<>> DiG 9.10.6 <<>> +time=5 +tries=3 @10.96.0.10 nginx-svc.default.svc.cluster.local. A\n; (1 server found)\n;; global options: +cmd\n;; connection timed out; no servers could be reached\n"*
functional_test_tunnel_test.go:332: (dbg) Run:  scutil --dns
functional_test_tunnel_test.go:336: debug for DNS configuration:
DNS configuration

                                                
                                                
resolver #1
nameserver[0] : 207.254.72.253
nameserver[1] : 207.254.72.254
nameserver[2] : 8.8.8.8
flags    : Request A records
reach    : 0x00000002 (Reachable)

                                                
                                                
resolver #2
domain   : local
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300000

                                                
                                                
resolver #3
domain   : 254.169.in-addr.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300200

                                                
                                                
resolver #4
domain   : 8.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300400

                                                
                                                
resolver #5
domain   : 9.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300600

                                                
                                                
resolver #6
domain   : a.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 300800

                                                
                                                
resolver #7
domain   : b.e.f.ip6.arpa
options  : mdns
timeout  : 5
flags    : Request A records
reach    : 0x00000000 (Not Reachable)
order    : 301000

                                                
                                                
resolver #8
domain   : cluster.local
nameserver[0] : 10.96.0.10
flags    : Request A records
reach    : 0x00000002 (Reachable)
order    : 1

                                                
                                                
DNS configuration (for scoped queries)

                                                
                                                
resolver #1
nameserver[0] : 207.254.72.253
nameserver[1] : 207.254.72.254
nameserver[2] : 8.8.8.8
if_index : 4 (en0)
flags    : Scoped, Request A records
reach    : 0x00000002 (Reachable)
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDig (15.05s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (34.38s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS
E0307 14:00:26.395416    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
functional_test_tunnel_test.go:419: failed to hit nginx with DNS forwarded "http://nginx-svc.default.svc.cluster.local.": Temporary Error: Get "http://nginx-svc.default.svc.cluster.local.": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
functional_test_tunnel_test.go:426: expected body to contain "Welcome to nginx!", but got *""*
--- FAIL: TestFunctional/parallel/TunnelCmd/serial/AccessThroughDNS (34.38s)

                                                
                                    
x
+
TestMutliControlPlane/serial/StartCluster (11.41s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/StartCluster
ha_test.go:101: (dbg) Run:  out/minikube-darwin-amd64 start -p ha-271000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=hyperkit 
ha_test.go:101: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ha-271000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=hyperkit : exit status 60 (11.338100969s)

                                                
                                                
-- stdout --
	* [ha-271000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "ha-271000" primary control-plane node in "ha-271000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "ha-271000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:00:44.025015    3325 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:00:44.025179    3325 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:00:44.025184    3325 out.go:304] Setting ErrFile to fd 2...
	I0307 14:00:44.025188    3325 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:00:44.025393    3325 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:00:44.026868    3325 out.go:298] Setting JSON to false
	I0307 14:00:44.049760    3325 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1815,"bootTime":1709847029,"procs":492,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:00:44.049845    3325 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:00:44.071211    3325 out.go:177] * [ha-271000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:00:44.113025    3325 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:00:44.135014    3325 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:00:44.113095    3325 notify.go:220] Checking for updates...
	I0307 14:00:44.155766    3325 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:00:44.177265    3325 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:00:44.199068    3325 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:00:44.219842    3325 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:00:44.241376    3325 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:00:44.271991    3325 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:00:44.314000    3325 start.go:297] selected driver: hyperkit
	I0307 14:00:44.314028    3325 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:00:44.314048    3325 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:00:44.318769    3325 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:00:44.318910    3325 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:00:44.326745    3325 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:00:44.330665    3325 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:00:44.330702    3325 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 14:00:44.330744    3325 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:00:44.330962    3325 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:00:44.331016    3325 cni.go:84] Creating CNI manager for ""
	I0307 14:00:44.331024    3325 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I0307 14:00:44.331032    3325 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0307 14:00:44.331105    3325 start.go:340] cluster config:
	{Name:ha-271000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-271000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docke
r CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0
GPUs: AutoPauseInterval:1m0s}
	I0307 14:00:44.331199    3325 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:00:44.372779    3325 out.go:177] * Starting "ha-271000" primary control-plane node in "ha-271000" cluster
	I0307 14:00:44.394108    3325 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:00:44.394174    3325 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:00:44.394196    3325 cache.go:56] Caching tarball of preloaded images
	I0307 14:00:44.394342    3325 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:00:44.394356    3325 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:00:44.394707    3325 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/ha-271000/config.json ...
	I0307 14:00:44.394736    3325 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/ha-271000/config.json: {Name:mk1a20445d273825d56dec2ab89224a549a2f2e8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:00:44.395092    3325 start.go:360] acquireMachinesLock for ha-271000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:00:44.395153    3325 start.go:364] duration metric: took 44.061µs to acquireMachinesLock for "ha-271000"
	I0307 14:00:44.395175    3325 start.go:93] Provisioning new machine with config: &{Name:ha-271000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-271000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:00:44.395224    3325 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:00:44.437815    3325 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:00:44.438038    3325 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:00:44.438084    3325 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:00:44.446547    3325 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50098
	I0307 14:00:44.446891    3325 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:00:44.447304    3325 main.go:141] libmachine: Using API Version  1
	I0307 14:00:44.447314    3325 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:00:44.447536    3325 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:00:44.447651    3325 main.go:141] libmachine: (ha-271000) Calling .GetMachineName
	I0307 14:00:44.447737    3325 main.go:141] libmachine: (ha-271000) Calling .DriverName
	I0307 14:00:44.447837    3325 start.go:159] libmachine.API.Create for "ha-271000" (driver="hyperkit")
	I0307 14:00:44.447862    3325 client.go:168] LocalClient.Create starting
	I0307 14:00:44.447907    3325 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:00:44.447958    3325 main.go:141] libmachine: Decoding PEM data...
	I0307 14:00:44.447973    3325 main.go:141] libmachine: Parsing certificate...
	I0307 14:00:44.448055    3325 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:00:44.448092    3325 main.go:141] libmachine: Decoding PEM data...
	I0307 14:00:44.448104    3325 main.go:141] libmachine: Parsing certificate...
	I0307 14:00:44.448118    3325 main.go:141] libmachine: Running pre-create checks...
	I0307 14:00:44.448124    3325 main.go:141] libmachine: (ha-271000) Calling .PreCreateCheck
	I0307 14:00:44.448209    3325 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:00:44.448359    3325 main.go:141] libmachine: (ha-271000) Calling .GetConfigRaw
	I0307 14:00:44.448803    3325 main.go:141] libmachine: Creating machine...
	I0307 14:00:44.448811    3325 main.go:141] libmachine: (ha-271000) Calling .Create
	I0307 14:00:44.448884    3325 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:00:44.448999    3325 main.go:141] libmachine: (ha-271000) DBG | I0307 14:00:44.448875    3333 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:00:44.449069    3325 main.go:141] libmachine: (ha-271000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:00:44.621321    3325 main.go:141] libmachine: (ha-271000) DBG | I0307 14:00:44.621198    3333 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/id_rsa...
	I0307 14:00:44.861810    3325 main.go:141] libmachine: (ha-271000) DBG | I0307 14:00:44.861724    3333 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/ha-271000.rawdisk...
	I0307 14:00:44.861822    3325 main.go:141] libmachine: (ha-271000) DBG | Writing magic tar header
	I0307 14:00:44.861830    3325 main.go:141] libmachine: (ha-271000) DBG | Writing SSH key tar header
	I0307 14:00:44.862617    3325 main.go:141] libmachine: (ha-271000) DBG | I0307 14:00:44.862546    3333 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000 ...
	I0307 14:00:45.216496    3325 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:00:45.216524    3325 main.go:141] libmachine: (ha-271000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.pid
	I0307 14:00:45.216545    3325 main.go:141] libmachine: (ha-271000) DBG | Using UUID 8d0366a3-1ddb-4497-bcae-89ed0068d0db
	I0307 14:00:45.255208    3325 main.go:141] libmachine: (ha-271000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:00:45.255291    3325 client.go:171] duration metric: took 807.412399ms to LocalClient.Create
	I0307 14:00:47.256043    3325 start.go:128] duration metric: took 2.860783775s to createHost
	I0307 14:00:47.256061    3325 start.go:83] releasing machines lock for "ha-271000", held for 2.860878271s
	W0307 14:00:47.256080    3325 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:00:47.256385    3325 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:00:47.256413    3325 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:00:47.264502    3325 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50100
	I0307 14:00:47.264842    3325 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:00:47.265210    3325 main.go:141] libmachine: Using API Version  1
	I0307 14:00:47.265230    3325 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:00:47.265458    3325 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:00:47.265800    3325 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:00:47.265823    3325 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:00:47.273342    3325 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50102
	I0307 14:00:47.273655    3325 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:00:47.273966    3325 main.go:141] libmachine: Using API Version  1
	I0307 14:00:47.273975    3325 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:00:47.274151    3325 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:00:47.274249    3325 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:00:47.274328    3325 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:00:47.274385    3325 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:00:47.274403    3325 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:00:47.274435    3325 main.go:141] libmachine: (ha-271000) Calling .DriverName
	I0307 14:00:47.320225    3325 out.go:177] * Deleting "ha-271000" in hyperkit ...
	I0307 14:00:47.341931    3325 main.go:141] libmachine: (ha-271000) Calling .Remove
	I0307 14:00:47.342101    3325 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:00:47.342110    3325 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:00:47.342119    3325 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:00:47.342131    3325 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	W0307 14:00:47.355541    3325 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:00:47.355556    3325 start.go:728] Will try again in 5 seconds ...
	I0307 14:00:52.355758    3325 start.go:360] acquireMachinesLock for ha-271000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:00:52.355895    3325 start.go:364] duration metric: took 73.04µs to acquireMachinesLock for "ha-271000"
	I0307 14:00:52.355920    3325 start.go:93] Provisioning new machine with config: &{Name:ha-271000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-271000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:00:52.356005    3325 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:00:52.399699    3325 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:00:52.399866    3325 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:00:52.399893    3325 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:00:52.408753    3325 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50104
	I0307 14:00:52.409173    3325 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:00:52.409523    3325 main.go:141] libmachine: Using API Version  1
	I0307 14:00:52.409537    3325 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:00:52.409767    3325 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:00:52.409886    3325 main.go:141] libmachine: (ha-271000) Calling .GetMachineName
	I0307 14:00:52.409988    3325 main.go:141] libmachine: (ha-271000) Calling .DriverName
	I0307 14:00:52.410092    3325 start.go:159] libmachine.API.Create for "ha-271000" (driver="hyperkit")
	I0307 14:00:52.410111    3325 client.go:168] LocalClient.Create starting
	I0307 14:00:52.410140    3325 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:00:52.410187    3325 main.go:141] libmachine: Decoding PEM data...
	I0307 14:00:52.410198    3325 main.go:141] libmachine: Parsing certificate...
	I0307 14:00:52.410237    3325 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:00:52.410272    3325 main.go:141] libmachine: Decoding PEM data...
	I0307 14:00:52.410290    3325 main.go:141] libmachine: Parsing certificate...
	I0307 14:00:52.410303    3325 main.go:141] libmachine: Running pre-create checks...
	I0307 14:00:52.410308    3325 main.go:141] libmachine: (ha-271000) Calling .PreCreateCheck
	I0307 14:00:52.410385    3325 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:00:52.410405    3325 main.go:141] libmachine: (ha-271000) Calling .GetConfigRaw
	I0307 14:00:52.410823    3325 main.go:141] libmachine: Creating machine...
	I0307 14:00:52.410831    3325 main.go:141] libmachine: (ha-271000) Calling .Create
	I0307 14:00:52.410904    3325 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:00:52.411030    3325 main.go:141] libmachine: (ha-271000) DBG | I0307 14:00:52.410902    3339 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:00:52.411069    3325 main.go:141] libmachine: (ha-271000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:00:52.582601    3325 main.go:141] libmachine: (ha-271000) DBG | I0307 14:00:52.582508    3339 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/id_rsa...
	I0307 14:00:52.735532    3325 main.go:141] libmachine: (ha-271000) DBG | I0307 14:00:52.735463    3339 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/ha-271000.rawdisk...
	I0307 14:00:52.735545    3325 main.go:141] libmachine: (ha-271000) DBG | Writing magic tar header
	I0307 14:00:52.735562    3325 main.go:141] libmachine: (ha-271000) DBG | Writing SSH key tar header
	I0307 14:00:52.736327    3325 main.go:141] libmachine: (ha-271000) DBG | I0307 14:00:52.736233    3339 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000 ...
	I0307 14:00:53.092163    3325 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:00:53.092198    3325 main.go:141] libmachine: (ha-271000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.pid
	I0307 14:00:53.092235    3325 main.go:141] libmachine: (ha-271000) DBG | Using UUID f6db2f39-45de-4a0c-8989-472a3ac2ba20
	I0307 14:00:53.128076    3325 main.go:141] libmachine: (ha-271000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:00:53.128162    3325 client.go:171] duration metric: took 718.039011ms to LocalClient.Create
	I0307 14:00:55.130401    3325 start.go:128] duration metric: took 2.77434076s to createHost
	I0307 14:00:55.130431    3325 start.go:83] releasing machines lock for "ha-271000", held for 2.774505999s
	W0307 14:00:55.130563    3325 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p ha-271000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p ha-271000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:00:55.174107    3325 out.go:177] 
	W0307 14:00:55.198035    3325 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:00:55.198089    3325 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:00:55.198106    3325 out.go:239] * Related issues:
	* Related issues:
	W0307 14:00:55.198154    3325 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:00:55.198210    3325 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:00:55.240959    3325 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:103: failed to fresh-start ha (multi-control plane) cluster. args "out/minikube-darwin-amd64 start -p ha-271000 --wait=true --memory=2200 --ha -v=7 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (73.494011ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/StartCluster (11.41s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DeployApp (97.81s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DeployApp
ha_test.go:128: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml
ha_test.go:128: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- apply -f ./testdata/ha/ha-pod-dns-test.yaml: exit status 1 (98.967657ms)

                                                
                                                
** stderr ** 
	error: cluster "ha-271000" does not exist

                                                
                                                
** /stderr **
ha_test.go:130: failed to create busybox deployment to ha (multi-control plane) cluster
ha_test.go:133: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- rollout status deployment/busybox
ha_test.go:133: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- rollout status deployment/busybox: exit status 1 (99.166869ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:135: failed to deploy busybox to ha (multi-control plane) cluster
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (97.596112ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (99.600054ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (98.315675ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.226202ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (98.858656ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
E0307 14:01:07.357967    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (99.567322ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (98.638965ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.041058ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.022425ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (99.106075ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
E0307 14:02:29.281065    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
ha_test.go:140: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}'
ha_test.go:140: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (97.793449ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:143: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:159: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1
ha_test.go:163: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:163: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (98.592904ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:165: failed get Pod names
ha_test.go:171: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- exec  -- nslookup kubernetes.io
ha_test.go:171: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- exec  -- nslookup kubernetes.io: exit status 1 (97.7728ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:173: Pod  could not resolve 'kubernetes.io': exit status 1
ha_test.go:181: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- exec  -- nslookup kubernetes.default
ha_test.go:181: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- exec  -- nslookup kubernetes.default: exit status 1 (97.402344ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:183: Pod  could not resolve 'kubernetes.default': exit status 1
ha_test.go:189: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- exec  -- nslookup kubernetes.default.svc.cluster.local
ha_test.go:189: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (97.366887ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:191: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (72.835893ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DeployApp (97.81s)

                                                
                                    
x
+
TestMutliControlPlane/serial/PingHostFromPods (0.17s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/PingHostFromPods
ha_test.go:199: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].metadata.name}'
ha_test.go:199: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p ha-271000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (97.51434ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "ha-271000"

                                                
                                                
** /stderr **
ha_test.go:201: failed to get Pod names: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (71.546712ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/PingHostFromPods (0.17s)

                                                
                                    
x
+
TestMutliControlPlane/serial/AddWorkerNode (0.21s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/AddWorkerNode
ha_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 node add -p ha-271000 -v=7 --alsologtostderr
ha_test.go:228: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p ha-271000 -v=7 --alsologtostderr: exit status 83 (140.430143ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-271000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-271000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:02:33.423244    3450 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:02:33.423957    3450 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:33.423985    3450 out.go:304] Setting ErrFile to fd 2...
	I0307 14:02:33.423996    3450 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:33.424529    3450 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:02:33.424887    3450 mustload.go:65] Loading cluster: ha-271000
	I0307 14:02:33.425181    3450 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:02:33.425492    3450 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:02:33.425537    3450 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:02:33.433208    3450 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50115
	I0307 14:02:33.433661    3450 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:02:33.434066    3450 main.go:141] libmachine: Using API Version  1
	I0307 14:02:33.434076    3450 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:02:33.434312    3450 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:02:33.434418    3450 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:02:33.434496    3450 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:02:33.434512    3450 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:02:33.434526    3450 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:02:33.456680    3450 out.go:177] * The control-plane node ha-271000 host is not running: state=Stopped
	I0307 14:02:33.480291    3450 out.go:177]   To start a cluster, run: "minikube start -p ha-271000"

                                                
                                                
** /stderr **
ha_test.go:230: failed to add worker node to current ha (multi-control plane) cluster. args "out/minikube-darwin-amd64 node add -p ha-271000 -v=7 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (72.143555ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/AddWorkerNode (0.21s)

                                                
                                    
x
+
TestMutliControlPlane/serial/NodeLabels (0.11s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/NodeLabels
ha_test.go:255: (dbg) Run:  kubectl --context ha-271000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
ha_test.go:255: (dbg) Non-zero exit: kubectl --context ha-271000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (37.085145ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: ha-271000

                                                
                                                
** /stderr **
ha_test.go:257: failed to 'kubectl get nodes' with args "kubectl --context ha-271000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1
ha_test.go:264: failed to decode json from label list: args "kubectl --context ha-271000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (72.837019ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/NodeLabels (0.11s)

                                                
                                    
x
+
TestMutliControlPlane/serial/HAppyAfterClusterStart (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/HAppyAfterClusterStart
ha_test.go:281: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:304: expected profile "ha-271000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-271000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-271000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServe
rPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-271000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4\",\"Containe
rRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\"
:false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
ha_test.go:307: expected profile "ha-271000" in json of 'profile list' to have "HAppy" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-271000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-271000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-271000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4
\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000000
0},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (73.210672ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/HAppyAfterClusterStart (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/CopyFile (0.15s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/CopyFile
ha_test.go:326: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 status --output json -v=7 --alsologtostderr
ha_test.go:326: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 status --output json -v=7 --alsologtostderr: exit status 7 (72.438541ms)

                                                
                                                
-- stdout --
	{"Name":"ha-271000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:02:33.965565    3468 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:02:33.965835    3468 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:33.965840    3468 out.go:304] Setting ErrFile to fd 2...
	I0307 14:02:33.965844    3468 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:33.966033    3468 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:02:33.966227    3468 out.go:298] Setting JSON to true
	I0307 14:02:33.966248    3468 mustload.go:65] Loading cluster: ha-271000
	I0307 14:02:33.966290    3468 notify.go:220] Checking for updates...
	I0307 14:02:33.966506    3468 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:02:33.966524    3468 status.go:255] checking status of ha-271000 ...
	I0307 14:02:33.966864    3468 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:02:33.966925    3468 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:02:33.974909    3468 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50130
	I0307 14:02:33.975222    3468 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:02:33.975645    3468 main.go:141] libmachine: Using API Version  1
	I0307 14:02:33.975656    3468 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:02:33.975916    3468 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:02:33.976031    3468 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:02:33.976122    3468 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:02:33.976141    3468 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:02:33.976159    3468 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:02:33.976199    3468 status.go:330] ha-271000 host status = "Stopped" (err=<nil>)
	I0307 14:02:33.976212    3468 status.go:343] host is not running, skipping remaining checks
	I0307 14:02:33.976220    3468 status.go:257] ha-271000 status: &{Name:ha-271000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:333: failed to decode json from status: args "out/minikube-darwin-amd64 -p ha-271000 status --output json -v=7 --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (72.87393ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/CopyFile (0.15s)

                                                
                                    
x
+
TestMutliControlPlane/serial/StopSecondaryNode (0.3s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/StopSecondaryNode
ha_test.go:363: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 node stop m02 -v=7 --alsologtostderr
ha_test.go:363: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 node stop m02 -v=7 --alsologtostderr: exit status 85 (152.053844ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:02:34.111201    3474 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:02:34.111557    3474 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:34.111564    3474 out.go:304] Setting ErrFile to fd 2...
	I0307 14:02:34.111567    3474 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:34.111734    3474 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:02:34.112089    3474 mustload.go:65] Loading cluster: ha-271000
	I0307 14:02:34.112366    3474 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:02:34.134924    3474 out.go:177] 
	W0307 14:02:34.156540    3474 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	W0307 14:02:34.156553    3474 out.go:239] * 
	* 
	W0307 14:02:34.158570    3474 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_8ce24bb09be8aab84076d51946735f62cbf80299_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_8ce24bb09be8aab84076d51946735f62cbf80299_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I0307 14:02:34.179729    3474 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:365: secondary control-plane node stop returned an error. args "out/minikube-darwin-amd64 -p ha-271000 node stop m02 -v=7 --alsologtostderr": exit status 85
ha_test.go:369: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr
ha_test.go:369: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr: exit status 7 (72.846074ms)

                                                
                                                
-- stdout --
	ha-271000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:02:34.264153    3476 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:02:34.264437    3476 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:34.264443    3476 out.go:304] Setting ErrFile to fd 2...
	I0307 14:02:34.264447    3476 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:34.264619    3476 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:02:34.264787    3476 out.go:298] Setting JSON to false
	I0307 14:02:34.264808    3476 mustload.go:65] Loading cluster: ha-271000
	I0307 14:02:34.264845    3476 notify.go:220] Checking for updates...
	I0307 14:02:34.265091    3476 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:02:34.265107    3476 status.go:255] checking status of ha-271000 ...
	I0307 14:02:34.265459    3476 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:02:34.265504    3476 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:02:34.273857    3476 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50136
	I0307 14:02:34.274222    3476 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:02:34.274634    3476 main.go:141] libmachine: Using API Version  1
	I0307 14:02:34.274648    3476 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:02:34.274849    3476 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:02:34.274941    3476 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:02:34.275028    3476 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:02:34.275045    3476 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:02:34.275054    3476 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:02:34.275082    3476 status.go:330] ha-271000 host status = "Stopped" (err=<nil>)
	I0307 14:02:34.275093    3476 status.go:343] host is not running, skipping remaining checks
	I0307 14:02:34.275099    3476 status.go:257] ha-271000 status: &{Name:ha-271000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:375: status says not all three control-plane nodes are present: args "out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr": ha-271000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:378: status says not three hosts are running: args "out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr": ha-271000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:381: status says not three kubelets are running: args "out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr": ha-271000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:384: status says not two apiservers are running: args "out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr": ha-271000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (71.823306ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/StopSecondaryNode (0.30s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop
ha_test.go:390: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:413: expected profile "ha-271000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-271000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-271000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACoun
t\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-271000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.2
8.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000
0000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (72.847404ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DegradedAfterControlPlaneNodeStop (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/RestartSecondaryNode (40.86s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/RestartSecondaryNode
ha_test.go:420: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 node start m02 -v=7 --alsologtostderr
ha_test.go:420: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 node start m02 -v=7 --alsologtostderr: exit status 85 (151.814686ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:02:34.631978    3490 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:02:34.632267    3490 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:34.632273    3490 out.go:304] Setting ErrFile to fd 2...
	I0307 14:02:34.632277    3490 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:34.632456    3490 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:02:34.632786    3490 mustload.go:65] Loading cluster: ha-271000
	I0307 14:02:34.633039    3490 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:02:34.653288    3490 out.go:177] 
	W0307 14:02:34.675290    3490 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
	W0307 14:02:34.675334    3490 out.go:239] * 
	* 
	W0307 14:02:34.678909    3490 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I0307 14:02:34.700162    3490 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:422: I0307 14:02:34.631978    3490 out.go:291] Setting OutFile to fd 1 ...
I0307 14:02:34.632267    3490 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 14:02:34.632273    3490 out.go:304] Setting ErrFile to fd 2...
I0307 14:02:34.632277    3490 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 14:02:34.632456    3490 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
I0307 14:02:34.632786    3490 mustload.go:65] Loading cluster: ha-271000
I0307 14:02:34.633039    3490 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 14:02:34.653288    3490 out.go:177] 
W0307 14:02:34.675290    3490 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m02
W0307 14:02:34.675334    3490 out.go:239] * 
* 
W0307 14:02:34.678909    3490 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_6a758bccf1d363a5d0799efcdea444172a621e97_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I0307 14:02:34.700162    3490 out.go:177] 
ha_test.go:423: secondary control-plane node start returned an error. args "out/minikube-darwin-amd64 -p ha-271000 node start m02 -v=7 --alsologtostderr": exit status 85
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr: exit status 7 (72.701619ms)

                                                
                                                
-- stdout --
	ha-271000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:02:34.783463    3492 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:02:34.783639    3492 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:34.783645    3492 out.go:304] Setting ErrFile to fd 2...
	I0307 14:02:34.783649    3492 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:34.784805    3492 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:02:34.785016    3492 out.go:298] Setting JSON to false
	I0307 14:02:34.785038    3492 mustload.go:65] Loading cluster: ha-271000
	I0307 14:02:34.785077    3492 notify.go:220] Checking for updates...
	I0307 14:02:34.785303    3492 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:02:34.785323    3492 status.go:255] checking status of ha-271000 ...
	I0307 14:02:34.785658    3492 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:02:34.785698    3492 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:02:34.793947    3492 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50148
	I0307 14:02:34.794323    3492 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:02:34.794738    3492 main.go:141] libmachine: Using API Version  1
	I0307 14:02:34.794755    3492 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:02:34.794955    3492 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:02:34.795089    3492 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:02:34.795181    3492 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:02:34.795195    3492 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:02:34.795209    3492 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:02:34.795248    3492 status.go:330] ha-271000 host status = "Stopped" (err=<nil>)
	I0307 14:02:34.795259    3492 status.go:343] host is not running, skipping remaining checks
	I0307 14:02:34.795266    3492 status.go:257] ha-271000 status: &{Name:ha-271000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr: exit status 7 (74.215772ms)

                                                
                                                
-- stdout --
	ha-271000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:02:36.278096    3495 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:02:36.278739    3495 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:36.278747    3495 out.go:304] Setting ErrFile to fd 2...
	I0307 14:02:36.278753    3495 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:36.279211    3495 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:02:36.279618    3495 out.go:298] Setting JSON to false
	I0307 14:02:36.279641    3495 mustload.go:65] Loading cluster: ha-271000
	I0307 14:02:36.279680    3495 notify.go:220] Checking for updates...
	I0307 14:02:36.279886    3495 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:02:36.279904    3495 status.go:255] checking status of ha-271000 ...
	I0307 14:02:36.280232    3495 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:02:36.280276    3495 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:02:36.288272    3495 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50151
	I0307 14:02:36.288590    3495 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:02:36.288985    3495 main.go:141] libmachine: Using API Version  1
	I0307 14:02:36.288996    3495 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:02:36.289188    3495 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:02:36.289290    3495 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:02:36.289372    3495 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:02:36.289392    3495 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:02:36.289397    3495 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:02:36.289435    3495 status.go:330] ha-271000 host status = "Stopped" (err=<nil>)
	I0307 14:02:36.289455    3495 status.go:343] host is not running, skipping remaining checks
	I0307 14:02:36.289462    3495 status.go:257] ha-271000 status: &{Name:ha-271000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr: exit status 7 (73.165817ms)

                                                
                                                
-- stdout --
	ha-271000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:02:37.717206    3502 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:02:37.717874    3502 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:37.717883    3502 out.go:304] Setting ErrFile to fd 2...
	I0307 14:02:37.717889    3502 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:37.718458    3502 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:02:37.718659    3502 out.go:298] Setting JSON to false
	I0307 14:02:37.718684    3502 mustload.go:65] Loading cluster: ha-271000
	I0307 14:02:37.718720    3502 notify.go:220] Checking for updates...
	I0307 14:02:37.718935    3502 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:02:37.718954    3502 status.go:255] checking status of ha-271000 ...
	I0307 14:02:37.719292    3502 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:02:37.719334    3502 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:02:37.727539    3502 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50154
	I0307 14:02:37.727915    3502 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:02:37.728363    3502 main.go:141] libmachine: Using API Version  1
	I0307 14:02:37.728374    3502 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:02:37.728586    3502 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:02:37.728771    3502 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:02:37.728870    3502 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:02:37.728885    3502 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:02:37.728895    3502 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:02:37.728944    3502 status.go:330] ha-271000 host status = "Stopped" (err=<nil>)
	I0307 14:02:37.728957    3502 status.go:343] host is not running, skipping remaining checks
	I0307 14:02:37.728963    3502 status.go:257] ha-271000 status: &{Name:ha-271000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr: exit status 7 (73.857761ms)

                                                
                                                
-- stdout --
	ha-271000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:02:40.662435    3505 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:02:40.663066    3505 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:40.663076    3505 out.go:304] Setting ErrFile to fd 2...
	I0307 14:02:40.663082    3505 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:40.663659    3505 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:02:40.663853    3505 out.go:298] Setting JSON to false
	I0307 14:02:40.663878    3505 mustload.go:65] Loading cluster: ha-271000
	I0307 14:02:40.663914    3505 notify.go:220] Checking for updates...
	I0307 14:02:40.664134    3505 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:02:40.664153    3505 status.go:255] checking status of ha-271000 ...
	I0307 14:02:40.664490    3505 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:02:40.664531    3505 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:02:40.672543    3505 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50157
	I0307 14:02:40.672885    3505 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:02:40.673313    3505 main.go:141] libmachine: Using API Version  1
	I0307 14:02:40.673322    3505 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:02:40.673585    3505 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:02:40.673703    3505 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:02:40.673798    3505 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:02:40.673820    3505 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:02:40.673829    3505 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:02:40.673889    3505 status.go:330] ha-271000 host status = "Stopped" (err=<nil>)
	I0307 14:02:40.673903    3505 status.go:343] host is not running, skipping remaining checks
	I0307 14:02:40.673910    3505 status.go:257] ha-271000 status: &{Name:ha-271000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr: exit status 7 (72.996676ms)

                                                
                                                
-- stdout --
	ha-271000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:02:42.921832    3508 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:02:42.922100    3508 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:42.922105    3508 out.go:304] Setting ErrFile to fd 2...
	I0307 14:02:42.922109    3508 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:42.922277    3508 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:02:42.922461    3508 out.go:298] Setting JSON to false
	I0307 14:02:42.922481    3508 mustload.go:65] Loading cluster: ha-271000
	I0307 14:02:42.922519    3508 notify.go:220] Checking for updates...
	I0307 14:02:42.922744    3508 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:02:42.922762    3508 status.go:255] checking status of ha-271000 ...
	I0307 14:02:42.923109    3508 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:02:42.923149    3508 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:02:42.931029    3508 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50160
	I0307 14:02:42.931355    3508 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:02:42.931762    3508 main.go:141] libmachine: Using API Version  1
	I0307 14:02:42.931790    3508 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:02:42.932037    3508 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:02:42.932151    3508 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:02:42.932246    3508 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:02:42.932259    3508 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:02:42.932272    3508 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:02:42.932286    3508 status.go:330] ha-271000 host status = "Stopped" (err=<nil>)
	I0307 14:02:42.932297    3508 status.go:343] host is not running, skipping remaining checks
	I0307 14:02:42.932304    3508 status.go:257] ha-271000 status: &{Name:ha-271000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr: exit status 7 (73.058547ms)

                                                
                                                
-- stdout --
	ha-271000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:02:46.191190    3513 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:02:46.191453    3513 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:46.191458    3513 out.go:304] Setting ErrFile to fd 2...
	I0307 14:02:46.191462    3513 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:46.191636    3513 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:02:46.191809    3513 out.go:298] Setting JSON to false
	I0307 14:02:46.191830    3513 mustload.go:65] Loading cluster: ha-271000
	I0307 14:02:46.191865    3513 notify.go:220] Checking for updates...
	I0307 14:02:46.192770    3513 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:02:46.192818    3513 status.go:255] checking status of ha-271000 ...
	I0307 14:02:46.193608    3513 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:02:46.193663    3513 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:02:46.201789    3513 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50163
	I0307 14:02:46.202157    3513 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:02:46.202571    3513 main.go:141] libmachine: Using API Version  1
	I0307 14:02:46.202582    3513 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:02:46.202812    3513 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:02:46.202922    3513 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:02:46.203008    3513 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:02:46.203040    3513 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:02:46.203046    3513 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:02:46.203055    3513 status.go:330] ha-271000 host status = "Stopped" (err=<nil>)
	I0307 14:02:46.203065    3513 status.go:343] host is not running, skipping remaining checks
	I0307 14:02:46.203072    3513 status.go:257] ha-271000 status: &{Name:ha-271000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr: exit status 7 (72.321161ms)

                                                
                                                
-- stdout --
	ha-271000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:02:50.794039    3516 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:02:50.794215    3516 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:50.794220    3516 out.go:304] Setting ErrFile to fd 2...
	I0307 14:02:50.794224    3516 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:02:50.795061    3516 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:02:50.795548    3516 out.go:298] Setting JSON to false
	I0307 14:02:50.795571    3516 mustload.go:65] Loading cluster: ha-271000
	I0307 14:02:50.795620    3516 notify.go:220] Checking for updates...
	I0307 14:02:50.795834    3516 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:02:50.795852    3516 status.go:255] checking status of ha-271000 ...
	I0307 14:02:50.796257    3516 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:02:50.796297    3516 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:02:50.804542    3516 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50166
	I0307 14:02:50.804914    3516 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:02:50.805311    3516 main.go:141] libmachine: Using API Version  1
	I0307 14:02:50.805320    3516 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:02:50.805558    3516 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:02:50.805669    3516 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:02:50.805756    3516 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:02:50.805769    3516 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:02:50.805778    3516 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:02:50.805804    3516 status.go:330] ha-271000 host status = "Stopped" (err=<nil>)
	I0307 14:02:50.805813    3516 status.go:343] host is not running, skipping remaining checks
	I0307 14:02:50.805826    3516 status.go:257] ha-271000 status: &{Name:ha-271000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr: exit status 7 (73.958313ms)

                                                
                                                
-- stdout --
	ha-271000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:03:00.108926    3521 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:03:00.109105    3521 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:00.109111    3521 out.go:304] Setting ErrFile to fd 2...
	I0307 14:03:00.109115    3521 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:00.109298    3521 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:03:00.109490    3521 out.go:298] Setting JSON to false
	I0307 14:03:00.109511    3521 mustload.go:65] Loading cluster: ha-271000
	I0307 14:03:00.109550    3521 notify.go:220] Checking for updates...
	I0307 14:03:00.109787    3521 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:03:00.109804    3521 status.go:255] checking status of ha-271000 ...
	I0307 14:03:00.110188    3521 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:00.110264    3521 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:03:00.118550    3521 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50169
	I0307 14:03:00.118924    3521 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:03:00.119327    3521 main.go:141] libmachine: Using API Version  1
	I0307 14:03:00.119336    3521 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:03:00.119520    3521 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:03:00.119623    3521 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:03:00.119712    3521 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:03:00.119728    3521 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:03:00.119740    3521 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:03:00.119745    3521 status.go:330] ha-271000 host status = "Stopped" (err=<nil>)
	I0307 14:03:00.119754    3521 status.go:343] host is not running, skipping remaining checks
	I0307 14:03:00.119761    3521 status.go:257] ha-271000 status: &{Name:ha-271000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:428: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr
ha_test.go:428: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr: exit status 7 (77.38747ms)

                                                
                                                
-- stdout --
	ha-271000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:03:15.344788    3536 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:03:15.344989    3536 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:15.344994    3536 out.go:304] Setting ErrFile to fd 2...
	I0307 14:03:15.344998    3536 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:15.345190    3536 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:03:15.345379    3536 out.go:298] Setting JSON to false
	I0307 14:03:15.345400    3536 mustload.go:65] Loading cluster: ha-271000
	I0307 14:03:15.345735    3536 notify.go:220] Checking for updates...
	I0307 14:03:15.346637    3536 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:03:15.346662    3536 status.go:255] checking status of ha-271000 ...
	I0307 14:03:15.347025    3536 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:15.347070    3536 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:03:15.355386    3536 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50172
	I0307 14:03:15.355734    3536 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:03:15.356161    3536 main.go:141] libmachine: Using API Version  1
	I0307 14:03:15.356171    3536 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:03:15.356391    3536 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:03:15.356647    3536 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:03:15.356736    3536 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:03:15.356754    3536 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:03:15.356761    3536 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:03:15.356786    3536 status.go:330] ha-271000 host status = "Stopped" (err=<nil>)
	I0307 14:03:15.356795    3536 status.go:343] host is not running, skipping remaining checks
	I0307 14:03:15.356802    3536 status.go:257] ha-271000 status: &{Name:ha-271000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:432: failed to run minikube status. args "out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (71.688576ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/RestartSecondaryNode (40.86s)

                                                
                                    
x
+
TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart
ha_test.go:281: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:304: expected profile "ha-271000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-271000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-271000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServe
rPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-271000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4\",\"Containe
rRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\"
:false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
ha_test.go:307: expected profile "ha-271000" in json of 'profile list' to have "HAppy" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-271000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-271000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-271000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4
\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000000
0},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (72.539142ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/HAppyAfterSecondaryNodeRestart (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/RestartClusterKeepsNodes (9.09s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/RestartClusterKeepsNodes
ha_test.go:456: (dbg) Run:  out/minikube-darwin-amd64 node list -p ha-271000 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Run:  out/minikube-darwin-amd64 stop -p ha-271000 -v=7 --alsologtostderr
ha_test.go:462: (dbg) Done: out/minikube-darwin-amd64 stop -p ha-271000 -v=7 --alsologtostderr: (3.117714317s)
ha_test.go:467: (dbg) Run:  out/minikube-darwin-amd64 start -p ha-271000 --wait=true -v=7 --alsologtostderr
ha_test.go:467: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ha-271000 --wait=true -v=7 --alsologtostderr: exit status 60 (5.76954215s)

                                                
                                                
-- stdout --
	* [ha-271000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "ha-271000" primary control-plane node in "ha-271000" cluster
	* Restarting existing hyperkit VM for "ha-271000" ...
	* Restarting existing hyperkit VM for "ha-271000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:03:18.887098    3571 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:03:18.887282    3571 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:18.887287    3571 out.go:304] Setting ErrFile to fd 2...
	I0307 14:03:18.887290    3571 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:18.887486    3571 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:03:18.888892    3571 out.go:298] Setting JSON to false
	I0307 14:03:18.911245    3571 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1969,"bootTime":1709847029,"procs":492,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:03:18.911343    3571 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:03:18.933380    3571 out.go:177] * [ha-271000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:03:18.976264    3571 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:03:18.976325    3571 notify.go:220] Checking for updates...
	I0307 14:03:19.018937    3571 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:03:19.039872    3571 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:03:19.061015    3571 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:03:19.081775    3571 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:03:19.103028    3571 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:03:19.124726    3571 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:03:19.124962    3571 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:03:19.125641    3571 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:19.125733    3571 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:03:19.134648    3571 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50194
	I0307 14:03:19.135029    3571 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:03:19.135452    3571 main.go:141] libmachine: Using API Version  1
	I0307 14:03:19.135461    3571 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:03:19.135688    3571 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:03:19.135796    3571 main.go:141] libmachine: (ha-271000) Calling .DriverName
	I0307 14:03:19.164054    3571 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 14:03:19.184849    3571 start.go:297] selected driver: hyperkit
	I0307 14:03:19.184868    3571 start.go:901] validating driver "hyperkit" against &{Name:ha-271000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-271000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:03:19.185008    3571 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:03:19.185182    3571 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:03:19.185287    3571 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:03:19.193053    3571 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:03:19.196762    3571 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:19.196784    3571 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 14:03:19.199387    3571 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:03:19.199451    3571 cni.go:84] Creating CNI manager for ""
	I0307 14:03:19.199460    3571 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0307 14:03:19.199535    3571 start.go:340] cluster config:
	{Name:ha-271000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-271000 Namespace:default APIServerHAVIP: APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:03:19.199613    3571 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:03:19.241789    3571 out.go:177] * Starting "ha-271000" primary control-plane node in "ha-271000" cluster
	I0307 14:03:19.262904    3571 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:03:19.262980    3571 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:03:19.263032    3571 cache.go:56] Caching tarball of preloaded images
	I0307 14:03:19.263215    3571 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:03:19.263235    3571 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:03:19.263383    3571 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/ha-271000/config.json ...
	I0307 14:03:19.264196    3571 start.go:360] acquireMachinesLock for ha-271000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:03:19.264307    3571 start.go:364] duration metric: took 87.115µs to acquireMachinesLock for "ha-271000"
	I0307 14:03:19.264345    3571 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:03:19.264373    3571 fix.go:54] fixHost starting: 
	I0307 14:03:19.264664    3571 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:19.264694    3571 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:03:19.272902    3571 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50196
	I0307 14:03:19.273253    3571 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:03:19.273624    3571 main.go:141] libmachine: Using API Version  1
	I0307 14:03:19.273635    3571 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:03:19.273848    3571 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:03:19.273977    3571 main.go:141] libmachine: (ha-271000) Calling .DriverName
	I0307 14:03:19.274074    3571 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:03:19.274158    3571 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:03:19.274173    3571 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:03:19.274191    3571 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:03:19.274224    3571 fix.go:112] recreateIfNeeded on ha-271000: state=Stopped err=<nil>
	I0307 14:03:19.274250    3571 main.go:141] libmachine: (ha-271000) Calling .DriverName
	W0307 14:03:19.274327    3571 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:03:19.294993    3571 out.go:177] * Restarting existing hyperkit VM for "ha-271000" ...
	I0307 14:03:19.336753    3571 main.go:141] libmachine: (ha-271000) Calling .Start
	I0307 14:03:19.336950    3571 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:03:19.336964    3571 main.go:141] libmachine: (ha-271000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.pid
	I0307 14:03:19.336974    3571 main.go:141] libmachine: (ha-271000) DBG | Using UUID f6db2f39-45de-4a0c-8989-472a3ac2ba20
	I0307 14:03:19.370546    3571 main.go:141] libmachine: (ha-271000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:03:19.370646    3571 fix.go:56] duration metric: took 106.274383ms for fixHost
	I0307 14:03:19.370657    3571 start.go:83] releasing machines lock for "ha-271000", held for 106.338698ms
	W0307 14:03:19.370672    3571 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 14:03:19.370743    3571 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:03:19.370750    3571 start.go:728] Will try again in 5 seconds ...
	I0307 14:03:24.372459    3571 start.go:360] acquireMachinesLock for ha-271000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:03:24.372633    3571 start.go:364] duration metric: took 116.93µs to acquireMachinesLock for "ha-271000"
	I0307 14:03:24.372666    3571 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:03:24.372674    3571 fix.go:54] fixHost starting: 
	I0307 14:03:24.373098    3571 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:24.373137    3571 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:03:24.382373    3571 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50198
	I0307 14:03:24.382704    3571 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:03:24.383041    3571 main.go:141] libmachine: Using API Version  1
	I0307 14:03:24.383051    3571 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:03:24.383255    3571 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:03:24.383345    3571 main.go:141] libmachine: (ha-271000) Calling .DriverName
	I0307 14:03:24.383440    3571 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:03:24.383523    3571 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:03:24.383543    3571 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:03:24.383551    3571 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:03:24.383589    3571 fix.go:112] recreateIfNeeded on ha-271000: state=Stopped err=<nil>
	I0307 14:03:24.383607    3571 main.go:141] libmachine: (ha-271000) Calling .DriverName
	W0307 14:03:24.383690    3571 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:03:24.405474    3571 out.go:177] * Restarting existing hyperkit VM for "ha-271000" ...
	I0307 14:03:24.447899    3571 main.go:141] libmachine: (ha-271000) Calling .Start
	I0307 14:03:24.448134    3571 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:03:24.448164    3571 main.go:141] libmachine: (ha-271000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.pid
	I0307 14:03:24.448179    3571 main.go:141] libmachine: (ha-271000) DBG | Using UUID f6db2f39-45de-4a0c-8989-472a3ac2ba20
	I0307 14:03:24.449750    3571 main.go:141] libmachine: (ha-271000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:03:24.449825    3571 fix.go:56] duration metric: took 77.14919ms for fixHost
	I0307 14:03:24.449836    3571 start.go:83] releasing machines lock for "ha-271000", held for 77.190212ms
	W0307 14:03:24.449920    3571 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p ha-271000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p ha-271000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:03:24.491938    3571 out.go:177] 
	W0307 14:03:24.512906    3571 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:03:24.512966    3571 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:03:24.512979    3571 out.go:239] * Related issues:
	* Related issues:
	W0307 14:03:24.513010    3571 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:03:24.513027    3571 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:03:24.533954    3571 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:469: failed to run minikube start. args "out/minikube-darwin-amd64 node list -p ha-271000 -v=7 --alsologtostderr" : exit status 60
ha_test.go:472: (dbg) Run:  out/minikube-darwin-amd64 node list -p ha-271000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (73.170539ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/RestartClusterKeepsNodes (9.09s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DeleteSecondaryNode (0.28s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DeleteSecondaryNode
ha_test.go:487: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 node delete m03 -v=7 --alsologtostderr
ha_test.go:487: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 node delete m03 -v=7 --alsologtostderr: exit status 83 (135.515656ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-271000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-271000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:03:24.793010    3588 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:03:24.793997    3588 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:24.794005    3588 out.go:304] Setting ErrFile to fd 2...
	I0307 14:03:24.794011    3588 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:24.794466    3588 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:03:24.794802    3588 mustload.go:65] Loading cluster: ha-271000
	I0307 14:03:24.795051    3588 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:03:24.795369    3588 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:24.795412    3588 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:03:24.803192    3588 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50203
	I0307 14:03:24.803593    3588 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:03:24.803993    3588 main.go:141] libmachine: Using API Version  1
	I0307 14:03:24.804002    3588 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:03:24.804182    3588 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:03:24.804281    3588 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:03:24.804401    3588 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:03:24.804418    3588 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:03:24.804425    3588 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:03:24.826252    3588 out.go:177] * The control-plane node ha-271000 host is not running: state=Stopped
	I0307 14:03:24.847092    3588 out.go:177]   To start a cluster, run: "minikube start -p ha-271000"

                                                
                                                
** /stderr **
ha_test.go:489: node delete returned an error. args "out/minikube-darwin-amd64 -p ha-271000 node delete m03 -v=7 --alsologtostderr": exit status 83
ha_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr
ha_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr: exit status 7 (72.082243ms)

                                                
                                                
-- stdout --
	ha-271000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:03:24.928549    3591 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:03:24.929274    3591 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:24.929285    3591 out.go:304] Setting ErrFile to fd 2...
	I0307 14:03:24.929290    3591 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:24.929693    3591 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:03:24.930062    3591 out.go:298] Setting JSON to false
	I0307 14:03:24.930086    3591 mustload.go:65] Loading cluster: ha-271000
	I0307 14:03:24.930126    3591 notify.go:220] Checking for updates...
	I0307 14:03:24.930347    3591 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:03:24.930364    3591 status.go:255] checking status of ha-271000 ...
	I0307 14:03:24.930687    3591 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:24.930726    3591 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:03:24.938824    3591 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50206
	I0307 14:03:24.939148    3591 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:03:24.939556    3591 main.go:141] libmachine: Using API Version  1
	I0307 14:03:24.939572    3591 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:03:24.939776    3591 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:03:24.939881    3591 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:03:24.939966    3591 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:03:24.940011    3591 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:03:24.940021    3591 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:03:24.940074    3591 status.go:330] ha-271000 host status = "Stopped" (err=<nil>)
	I0307 14:03:24.940090    3591 status.go:343] host is not running, skipping remaining checks
	I0307 14:03:24.940099    3591 status.go:257] ha-271000 status: &{Name:ha-271000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:495: failed to run minikube status. args "out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (71.602239ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DeleteSecondaryNode (0.28s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete
ha_test.go:390: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:413: expected profile "ha-271000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-271000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-271000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACoun
t\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-271000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.2
8.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000
0000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (72.198719ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DegradedAfterSecondaryNodeDelete (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/StopCluster (2.39s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/StopCluster
ha_test.go:531: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 stop -v=7 --alsologtostderr
ha_test.go:531: (dbg) Done: out/minikube-darwin-amd64 -p ha-271000 stop -v=7 --alsologtostderr: (2.246286672s)
ha_test.go:537: (dbg) Run:  out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr
ha_test.go:537: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr: exit status 7 (72.727785ms)

                                                
                                                
-- stdout --
	ha-271000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:03:27.536769    3618 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:03:27.536943    3618 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:27.536947    3618 out.go:304] Setting ErrFile to fd 2...
	I0307 14:03:27.536951    3618 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:27.537145    3618 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:03:27.537349    3618 out.go:298] Setting JSON to false
	I0307 14:03:27.537373    3618 mustload.go:65] Loading cluster: ha-271000
	I0307 14:03:27.537408    3618 notify.go:220] Checking for updates...
	I0307 14:03:27.537631    3618 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:03:27.537648    3618 status.go:255] checking status of ha-271000 ...
	I0307 14:03:27.537981    3618 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:27.538026    3618 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:03:27.546286    3618 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50225
	I0307 14:03:27.546613    3618 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:03:27.547000    3618 main.go:141] libmachine: Using API Version  1
	I0307 14:03:27.547008    3618 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:03:27.547237    3618 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:03:27.547337    3618 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:03:27.547415    3618 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:03:27.547433    3618 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:03:27.547445    3618 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:03:27.547460    3618 status.go:330] ha-271000 host status = "Stopped" (err=<nil>)
	I0307 14:03:27.547468    3618 status.go:343] host is not running, skipping remaining checks
	I0307 14:03:27.547475    3618 status.go:257] ha-271000 status: &{Name:ha-271000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
ha_test.go:543: status says not two control-plane nodes are present: args "out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr": ha-271000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:549: status says not three kubelets are stopped: args "out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr": ha-271000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
ha_test.go:552: status says not two apiservers are stopped: args "out/minikube-darwin-amd64 -p ha-271000 status -v=7 --alsologtostderr": ha-271000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (72.462062ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/StopCluster (2.39s)

                                                
                                    
x
+
TestMutliControlPlane/serial/RestartCluster (5.84s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/RestartCluster
ha_test.go:560: (dbg) Run:  out/minikube-darwin-amd64 start -p ha-271000 --wait=true -v=7 --alsologtostderr --driver=hyperkit 
ha_test.go:560: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p ha-271000 --wait=true -v=7 --alsologtostderr --driver=hyperkit : exit status 60 (5.766239675s)

                                                
                                                
-- stdout --
	* [ha-271000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "ha-271000" primary control-plane node in "ha-271000" cluster
	* Restarting existing hyperkit VM for "ha-271000" ...
	* Restarting existing hyperkit VM for "ha-271000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:03:27.681470    3624 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:03:27.681642    3624 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:27.681653    3624 out.go:304] Setting ErrFile to fd 2...
	I0307 14:03:27.681658    3624 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:27.681834    3624 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:03:27.683190    3624 out.go:298] Setting JSON to false
	I0307 14:03:27.705159    3624 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1978,"bootTime":1709847029,"procs":497,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:03:27.705266    3624 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:03:27.727525    3624 out.go:177] * [ha-271000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:03:27.769491    3624 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:03:27.769525    3624 notify.go:220] Checking for updates...
	I0307 14:03:27.790335    3624 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:03:27.811264    3624 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:03:27.832271    3624 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:03:27.853269    3624 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:03:27.874251    3624 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:03:27.895781    3624 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:03:27.896251    3624 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:27.896310    3624 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:03:27.904751    3624 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50231
	I0307 14:03:27.905123    3624 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:03:27.905534    3624 main.go:141] libmachine: Using API Version  1
	I0307 14:03:27.905542    3624 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:03:27.905745    3624 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:03:27.905843    3624 main.go:141] libmachine: (ha-271000) Calling .DriverName
	I0307 14:03:27.906026    3624 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:03:27.906256    3624 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:27.906285    3624 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:03:27.913926    3624 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50233
	I0307 14:03:27.914251    3624 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:03:27.914609    3624 main.go:141] libmachine: Using API Version  1
	I0307 14:03:27.914625    3624 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:03:27.914857    3624 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:03:27.914968    3624 main.go:141] libmachine: (ha-271000) Calling .DriverName
	I0307 14:03:27.943097    3624 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 14:03:27.985166    3624 start.go:297] selected driver: hyperkit
	I0307 14:03:27.985187    3624 start.go:901] validating driver "hyperkit" against &{Name:ha-271000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kuber
netesVersion:v1.28.4 ClusterName:ha-271000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType
:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:03:27.985311    3624 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:03:27.985483    3624 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:03:27.985610    3624 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:03:27.993932    3624 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:03:27.997943    3624 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:27.997967    3624 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 14:03:28.000686    3624 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:03:28.000762    3624 cni.go:84] Creating CNI manager for ""
	I0307 14:03:28.000770    3624 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0307 14:03:28.000848    3624 start.go:340] cluster config:
	{Name:ha-271000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:ha-271000 Namespace:default APIServerHAVIP: APISe
rverName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:03:28.000940    3624 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:03:28.043231    3624 out.go:177] * Starting "ha-271000" primary control-plane node in "ha-271000" cluster
	I0307 14:03:28.064414    3624 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:03:28.064469    3624 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:03:28.064492    3624 cache.go:56] Caching tarball of preloaded images
	I0307 14:03:28.064610    3624 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:03:28.064623    3624 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:03:28.064730    3624 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/ha-271000/config.json ...
	I0307 14:03:28.065181    3624 start.go:360] acquireMachinesLock for ha-271000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:03:28.065234    3624 start.go:364] duration metric: took 37.938µs to acquireMachinesLock for "ha-271000"
	I0307 14:03:28.065253    3624 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:03:28.065271    3624 fix.go:54] fixHost starting: 
	I0307 14:03:28.065489    3624 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:28.065512    3624 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:03:28.073468    3624 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50235
	I0307 14:03:28.073811    3624 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:03:28.074150    3624 main.go:141] libmachine: Using API Version  1
	I0307 14:03:28.074161    3624 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:03:28.074343    3624 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:03:28.074448    3624 main.go:141] libmachine: (ha-271000) Calling .DriverName
	I0307 14:03:28.074528    3624 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:03:28.074603    3624 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:03:28.074638    3624 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:03:28.074662    3624 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:03:28.074651    3624 fix.go:112] recreateIfNeeded on ha-271000: state=Stopped err=<nil>
	I0307 14:03:28.074672    3624 main.go:141] libmachine: (ha-271000) Calling .DriverName
	W0307 14:03:28.074744    3624 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:03:28.117173    3624 out.go:177] * Restarting existing hyperkit VM for "ha-271000" ...
	I0307 14:03:28.138311    3624 main.go:141] libmachine: (ha-271000) Calling .Start
	I0307 14:03:28.138605    3624 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:03:28.138676    3624 main.go:141] libmachine: (ha-271000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.pid
	I0307 14:03:28.138803    3624 main.go:141] libmachine: (ha-271000) DBG | Using UUID f6db2f39-45de-4a0c-8989-472a3ac2ba20
	I0307 14:03:28.140546    3624 main.go:141] libmachine: (ha-271000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:03:28.140675    3624 fix.go:56] duration metric: took 75.409291ms for fixHost
	I0307 14:03:28.140689    3624 start.go:83] releasing machines lock for "ha-271000", held for 75.447846ms
	W0307 14:03:28.140708    3624 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 14:03:28.140774    3624 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:03:28.140782    3624 start.go:728] Will try again in 5 seconds ...
	I0307 14:03:33.141111    3624 start.go:360] acquireMachinesLock for ha-271000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:03:33.141255    3624 start.go:364] duration metric: took 112.261µs to acquireMachinesLock for "ha-271000"
	I0307 14:03:33.141289    3624 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:03:33.141299    3624 fix.go:54] fixHost starting: 
	I0307 14:03:33.141731    3624 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:33.141762    3624 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:03:33.150425    3624 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50237
	I0307 14:03:33.150793    3624 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:03:33.151138    3624 main.go:141] libmachine: Using API Version  1
	I0307 14:03:33.151149    3624 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:03:33.151379    3624 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:03:33.151507    3624 main.go:141] libmachine: (ha-271000) Calling .DriverName
	I0307 14:03:33.151613    3624 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:03:33.151709    3624 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:03:33.151724    3624 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:03:33.151730    3624 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:03:33.151783    3624 fix.go:112] recreateIfNeeded on ha-271000: state=Stopped err=<nil>
	I0307 14:03:33.151804    3624 main.go:141] libmachine: (ha-271000) Calling .DriverName
	W0307 14:03:33.151898    3624 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:03:33.173538    3624 out.go:177] * Restarting existing hyperkit VM for "ha-271000" ...
	I0307 14:03:33.216180    3624 main.go:141] libmachine: (ha-271000) Calling .Start
	I0307 14:03:33.216450    3624 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:03:33.216519    3624 main.go:141] libmachine: (ha-271000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.pid
	I0307 14:03:33.216615    3624 main.go:141] libmachine: (ha-271000) DBG | Using UUID f6db2f39-45de-4a0c-8989-472a3ac2ba20
	I0307 14:03:33.218372    3624 main.go:141] libmachine: (ha-271000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:03:33.218447    3624 fix.go:56] duration metric: took 77.148689ms for fixHost
	I0307 14:03:33.218456    3624 start.go:83] releasing machines lock for "ha-271000", held for 77.187865ms
	W0307 14:03:33.218518    3624 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p ha-271000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p ha-271000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:03:33.261211    3624 out.go:177] 
	W0307 14:03:33.282381    3624 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:03:33.282479    3624 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:03:33.282499    3624 out.go:239] * Related issues:
	* Related issues:
	W0307 14:03:33.282525    3624 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:03:33.282572    3624 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:03:33.304170    3624 out.go:177] 

                                                
                                                
** /stderr **
ha_test.go:562: failed to start cluster. args "out/minikube-darwin-amd64 start -p ha-271000 --wait=true -v=7 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (73.593918ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/RestartCluster (5.84s)

                                                
                                    
x
+
TestMutliControlPlane/serial/DegradedAfterClusterRestart (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/DegradedAfterClusterRestart
ha_test.go:390: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:413: expected profile "ha-271000" in json of 'profile list' to have "Degraded" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-271000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-271000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACoun
t\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-271000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.2
8.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000
0000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (73.001054ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/DegradedAfterClusterRestart (0.22s)

                                                
                                    
x
+
TestMutliControlPlane/serial/AddSecondaryNode (0.21s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/AddSecondaryNode
ha_test.go:605: (dbg) Run:  out/minikube-darwin-amd64 node add -p ha-271000 --control-plane -v=7 --alsologtostderr
ha_test.go:605: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p ha-271000 --control-plane -v=7 --alsologtostderr: exit status 83 (136.383423ms)

                                                
                                                
-- stdout --
	* The control-plane node ha-271000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p ha-271000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:03:33.738803    3647 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:03:33.739504    3647 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:33.739514    3647 out.go:304] Setting ErrFile to fd 2...
	I0307 14:03:33.739521    3647 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:03:33.740077    3647 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:03:33.740438    3647 mustload.go:65] Loading cluster: ha-271000
	I0307 14:03:33.740691    3647 config.go:182] Loaded profile config "ha-271000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:03:33.741015    3647 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:03:33.741071    3647 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:03:33.748657    3647 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50248
	I0307 14:03:33.749069    3647 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:03:33.749480    3647 main.go:141] libmachine: Using API Version  1
	I0307 14:03:33.749490    3647 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:03:33.749731    3647 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:03:33.749848    3647 main.go:141] libmachine: (ha-271000) Calling .GetState
	I0307 14:03:33.749929    3647 main.go:141] libmachine: (ha-271000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:03:33.749940    3647 main.go:141] libmachine: (ha-271000) DBG | hyperkit pid from json: 0
	I0307 14:03:33.750013    3647 main.go:141] libmachine: (ha-271000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/ha-271000/hyperkit.json: no such file or directory
	I0307 14:03:33.771789    3647 out.go:177] * The control-plane node ha-271000 host is not running: state=Stopped
	I0307 14:03:33.792490    3647 out.go:177]   To start a cluster, run: "minikube start -p ha-271000"

                                                
                                                
** /stderr **
ha_test.go:607: failed to add control-plane node to current ha (multi-control plane) cluster. args "out/minikube-darwin-amd64 node add -p ha-271000 --control-plane -v=7 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (72.255483ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/AddSecondaryNode (0.21s)

                                                
                                    
x
+
TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.22s)

                                                
                                                
=== RUN   TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd
ha_test.go:281: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
ha_test.go:304: expected profile "ha-271000" in json of 'profile list' to include 4 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-271000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-271000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\":1,\"APIServe
rPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-271000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4\",\"Containe
rRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":60000000000},\"Active\"
:false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
ha_test.go:307: expected profile "ha-271000" in json of 'profile list' to have "HAppy" status but have "Stopped" status. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"ha-271000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"ha-271000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KVMNUMACount\"
:1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"ha-271000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"KubernetesVersion\":\"v1.28.4
\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseInterval\":6000000000
0},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p ha-271000 -n ha-271000: exit status 7 (71.754908ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "ha-271000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMutliControlPlane/serial/HAppyAfterSecondaryNodeAdd (0.22s)

                                                
                                    
x
+
TestImageBuild/serial/Setup (11.21s)

                                                
                                                
=== RUN   TestImageBuild/serial/Setup
image_test.go:69: (dbg) Run:  out/minikube-darwin-amd64 start -p image-797000 --driver=hyperkit 
image_test.go:69: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p image-797000 --driver=hyperkit : exit status 60 (11.136790787s)

                                                
                                                
-- stdout --
	* [image-797000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "image-797000" primary control-plane node in "image-797000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "image-797000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p image-797000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
image_test.go:70: failed to start minikube with args: "out/minikube-darwin-amd64 start -p image-797000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p image-797000 -n image-797000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p image-797000 -n image-797000: exit status 7 (73.954727ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "image-797000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestImageBuild/serial/Setup (11.21s)

                                                
                                    
x
+
TestJSONOutput/start/Command (11.33s)

                                                
                                                
=== RUN   TestJSONOutput/start/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 start -p json-output-020000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit 
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p json-output-020000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit : exit status 60 (11.330455197s)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"a43e3b69-54ba-48cc-bb7b-5cc441576ce9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-020000] minikube v1.32.0 on Darwin 14.3.1","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"f53b949b-fb03-4d91-b3c1-7d1cd5e47b08","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=18320"}}
	{"specversion":"1.0","id":"3d76844f-0a56-470d-93ea-ea106c6e5861","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig"}}
	{"specversion":"1.0","id":"aaa4a46d-646d-42f3-b3d1-0772aae39af1","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-amd64"}}
	{"specversion":"1.0","id":"b7f8b8f0-a378-40fc-ac60-49f04b178130","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"f132250d-8d9f-4810-a8d0-6f468cbb464e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube"}}
	{"specversion":"1.0","id":"3cdb7abb-5969-4367-a9cc-ff29ac35d24d","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"54b589c7-5337-45d0-858e-5dd19b643b76","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"1","message":"Using the hyperkit driver based on user configuration","name":"Selecting Driver","totalsteps":"19"}}
	{"specversion":"1.0","id":"768f8444-1bd4-45c0-8332-3d0f677d514a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"3","message":"Starting \"json-output-020000\" primary control-plane node in \"json-output-020000\" cluster","name":"Starting Node","totalsteps":"19"}}
	{"specversion":"1.0","id":"b9e374ac-baf4-4f2c-a72d-3c58e319b2c8","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"a2d6c0d4-1311-400f-b274-848b9224346a","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Deleting \"json-output-020000\" in hyperkit ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"86da1f3e-f224-42b3-9f57-3ca878123cd0","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"}}
	{"specversion":"1.0","id":"f3b4567c-5d12-4751-8feb-d55b321a2498","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"9","message":"Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...","name":"Creating VM","totalsteps":"19"}}
	{"specversion":"1.0","id":"d239d28f-166d-4eef-968a-c5ef7e89e75e","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"message":"Failed to start hyperkit VM. Running \"minikube delete -p json-output-020000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"}}
	{"specversion":"1.0","id":"61cd81cd-3b70-4f6b-8bce-9e47fd121ad9","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.","exitcode":"60","issues":"https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594","message":"Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1","name":"PR_HYPERKIT_VMNET_FRAMEWORK","url":""}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 start -p json-output-020000 --output=json --user=testUser --memory=2200 --wait=true --driver=hyperkit ": exit status 60
--- FAIL: TestJSONOutput/start/Command (11.33s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/DistinctCurrentSteps
json_output_test.go:114: step 9 has already been assigned to another step:
Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
Cannot use for:
Deleting "json-output-020000" in hyperkit ...
[Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: a43e3b69-54ba-48cc-bb7b-5cc441576ce9
datacontenttype: application/json
Data,
{
"currentstep": "0",
"message": "[json-output-020000] minikube v1.32.0 on Darwin 14.3.1",
"name": "Initial Minikube Setup",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: f53b949b-fb03-4d91-b3c1-7d1cd5e47b08
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_LOCATION=18320"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 3d76844f-0a56-470d-93ea-ea106c6e5861
datacontenttype: application/json
Data,
{
"message": "KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: aaa4a46d-646d-42f3-b3d1-0772aae39af1
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_BIN=out/minikube-darwin-amd64"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: b7f8b8f0-a378-40fc-ac60-49f04b178130
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: f132250d-8d9f-4810-a8d0-6f468cbb464e
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 3cdb7abb-5969-4367-a9cc-ff29ac35d24d
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_FORCE_SYSTEMD="
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 54b589c7-5337-45d0-858e-5dd19b643b76
datacontenttype: application/json
Data,
{
"currentstep": "1",
"message": "Using the hyperkit driver based on user configuration",
"name": "Selecting Driver",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 768f8444-1bd4-45c0-8332-3d0f677d514a
datacontenttype: application/json
Data,
{
"currentstep": "3",
"message": "Starting \"json-output-020000\" primary control-plane node in \"json-output-020000\" cluster",
"name": "Starting Node",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: b9e374ac-baf4-4f2c-a72d-3c58e319b2c8
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: a2d6c0d4-1311-400f-b274-848b9224346a
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Deleting \"json-output-020000\" in hyperkit ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 86da1f3e-f224-42b3-9f57-3ca878123cd0
datacontenttype: application/json
Data,
{
"message": "StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: f3b4567c-5d12-4751-8feb-d55b321a2498
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: d239d28f-166d-4eef-968a-c5ef7e89e75e
datacontenttype: application/json
Data,
{
"message": "Failed to start hyperkit VM. Running \"minikube delete -p json-output-020000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 61cd81cd-3b70-4f6b-8bce-9e47fd121ad9
datacontenttype: application/json
Data,
{
"advice": "Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.",
"exitcode": "60",
"issues": "https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594",
"message": "Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1",
"name": "PR_HYPERKIT_VMNET_FRAMEWORK",
"url": ""
}
]
--- FAIL: TestJSONOutput/start/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/start/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/start/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/start/parallel/IncreasingCurrentSteps
json_output_test.go:144: current step is not in increasing order: [Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: a43e3b69-54ba-48cc-bb7b-5cc441576ce9
datacontenttype: application/json
Data,
{
"currentstep": "0",
"message": "[json-output-020000] minikube v1.32.0 on Darwin 14.3.1",
"name": "Initial Minikube Setup",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: f53b949b-fb03-4d91-b3c1-7d1cd5e47b08
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_LOCATION=18320"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 3d76844f-0a56-470d-93ea-ea106c6e5861
datacontenttype: application/json
Data,
{
"message": "KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: aaa4a46d-646d-42f3-b3d1-0772aae39af1
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_BIN=out/minikube-darwin-amd64"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: b7f8b8f0-a378-40fc-ac60-49f04b178130
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: f132250d-8d9f-4810-a8d0-6f468cbb464e
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.info
source: https://minikube.sigs.k8s.io/
id: 3cdb7abb-5969-4367-a9cc-ff29ac35d24d
datacontenttype: application/json
Data,
{
"message": "MINIKUBE_FORCE_SYSTEMD="
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 54b589c7-5337-45d0-858e-5dd19b643b76
datacontenttype: application/json
Data,
{
"currentstep": "1",
"message": "Using the hyperkit driver based on user configuration",
"name": "Selecting Driver",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: 768f8444-1bd4-45c0-8332-3d0f677d514a
datacontenttype: application/json
Data,
{
"currentstep": "3",
"message": "Starting \"json-output-020000\" primary control-plane node in \"json-output-020000\" cluster",
"name": "Starting Node",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: b9e374ac-baf4-4f2c-a72d-3c58e319b2c8
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: a2d6c0d4-1311-400f-b274-848b9224346a
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Deleting \"json-output-020000\" in hyperkit ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 86da1f3e-f224-42b3-9f57-3ca878123cd0
datacontenttype: application/json
Data,
{
"message": "StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.step
source: https://minikube.sigs.k8s.io/
id: f3b4567c-5d12-4751-8feb-d55b321a2498
datacontenttype: application/json
Data,
{
"currentstep": "9",
"message": "Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...",
"name": "Creating VM",
"totalsteps": "19"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: d239d28f-166d-4eef-968a-c5ef7e89e75e
datacontenttype: application/json
Data,
{
"message": "Failed to start hyperkit VM. Running \"minikube delete -p json-output-020000\" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1"
}
Context Attributes,
specversion: 1.0
type: io.k8s.sigs.minikube.error
source: https://minikube.sigs.k8s.io/
id: 61cd81cd-3b70-4f6b-8bce-9e47fd121ad9
datacontenttype: application/json
Data,
{
"advice": "Hyperkit networking is broken. Try disabling Internet Sharing: System Preference \u003e Sharing \u003e Internet Sharing. \nAlternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.",
"exitcode": "60",
"issues": "https://github.com/kubernetes/minikube/issues/6028,https://github.com/kubernetes/minikube/issues/5594",
"message": "Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1",
"name": "PR_HYPERKIT_VMNET_FRAMEWORK",
"url": ""
}
]
--- FAIL: TestJSONOutput/start/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Command (0.14s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 pause -p json-output-020000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p json-output-020000 --output=json --user=testUser: exit status 83 (138.445619ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"6db8c075-7f6e-487b-9183-c6a5a6c5e12f","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"The control-plane node json-output-020000 host is not running: state=Stopped"}}
	{"specversion":"1.0","id":"d4cbffa6-9bbb-4201-bdf2-422c52de99c2","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"To start a cluster, run: \"minikube start -p json-output-020000\""}}

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 pause -p json-output-020000 --output=json --user=testUser": exit status 83
--- FAIL: TestJSONOutput/pause/Command (0.14s)

                                                
                                    
x
+
TestJSONOutput/unpause/Command (0.14s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 unpause -p json-output-020000 --output=json --user=testUser
json_output_test.go:63: (dbg) Non-zero exit: out/minikube-darwin-amd64 unpause -p json-output-020000 --output=json --user=testUser: exit status 83 (138.291344ms)

                                                
                                                
-- stdout --
	* The control-plane node json-output-020000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p json-output-020000"

                                                
                                                
-- /stdout --
json_output_test.go:65: failed to clean up: args "out/minikube-darwin-amd64 unpause -p json-output-020000 --output=json --user=testUser": exit status 83
json_output_test.go:213: unable to marshal output: * The control-plane node json-output-020000 host is not running: state=Stopped
json_output_test.go:70: converting to cloud events: invalid character '*' looking for beginning of value
--- FAIL: TestJSONOutput/unpause/Command (0.14s)

                                                
                                    
x
+
TestMinikubeProfile (12.48s)

                                                
                                                
=== RUN   TestMinikubeProfile
minikube_profile_test.go:44: (dbg) Run:  out/minikube-darwin-amd64 start -p first-464000 --driver=hyperkit 
minikube_profile_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p first-464000 --driver=hyperkit : exit status 60 (11.643321236s)

                                                
                                                
-- stdout --
	* [first-464000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "first-464000" primary control-plane node in "first-464000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "first-464000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p first-464000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
minikube_profile_test.go:46: test pre-condition failed. args "out/minikube-darwin-amd64 start -p first-464000 --driver=hyperkit ": exit status 60
panic.go:626: *** TestMinikubeProfile FAILED at 2024-03-07 14:04:13.399104 -0800 PST m=+1056.453765698
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p second-466000 -n second-466000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p second-466000 -n second-466000: exit status 85 (128.226682ms)

                                                
                                                
-- stdout --
	* Profile "second-466000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p second-466000"

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 85 (may be ok)
helpers_test.go:241: "second-466000" host is not running, skipping log retrieval (state="* Profile \"second-466000\" not found. Run \"minikube profile list\" to view all profiles.\n  To start a cluster, run: \"minikube start -p second-466000\"")
helpers_test.go:175: Cleaning up "second-466000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p second-466000
panic.go:626: *** TestMinikubeProfile FAILED at 2024-03-07 14:04:13.903706 -0800 PST m=+1056.958363311
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p first-464000 -n first-464000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p first-464000 -n first-464000: exit status 7 (73.086277ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "first-464000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "first-464000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p first-464000
--- FAIL: TestMinikubeProfile (12.48s)

                                                
                                    
x
+
TestMountStart/serial/StartWithMountFirst (12.08s)

                                                
                                                
=== RUN   TestMountStart/serial/StartWithMountFirst
mount_start_test.go:98: (dbg) Run:  out/minikube-darwin-amd64 start -p mount-start-1-630000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit 
mount_start_test.go:98: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p mount-start-1-630000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit : exit status 60 (12.008263181s)

                                                
                                                
-- stdout --
	* [mount-start-1-630000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting minikube without Kubernetes in cluster mount-start-1-630000
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "mount-start-1-630000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p mount-start-1-630000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
mount_start_test.go:100: failed to start minikube with args: "out/minikube-darwin-amd64 start -p mount-start-1-630000 --memory=2048 --mount --mount-gid 0 --mount-msize 6543 --mount-port 46464 --mount-uid 0 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p mount-start-1-630000 -n mount-start-1-630000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p mount-start-1-630000 -n mount-start-1-630000: exit status 7 (72.645437ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "mount-start-1-630000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMountStart/serial/StartWithMountFirst (12.08s)

                                                
                                    
x
+
TestMultiNode/serial/FreshStart2Nodes (11.29s)

                                                
                                                
=== RUN   TestMultiNode/serial/FreshStart2Nodes
multinode_test.go:96: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-419000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit 
multinode_test.go:96: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-419000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit : exit status 60 (11.219536388s)

                                                
                                                
-- stdout --
	* [multinode-419000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "multinode-419000" primary control-plane node in "multinode-419000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "multinode-419000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:04:27.062334    3849 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:04:27.062621    3849 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:04:27.062626    3849 out.go:304] Setting ErrFile to fd 2...
	I0307 14:04:27.062630    3849 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:04:27.063405    3849 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:04:27.065133    3849 out.go:298] Setting JSON to false
	I0307 14:04:27.087608    3849 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2038,"bootTime":1709847029,"procs":493,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:04:27.087728    3849 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:04:27.110038    3849 out.go:177] * [multinode-419000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:04:27.151115    3849 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:04:27.151147    3849 notify.go:220] Checking for updates...
	I0307 14:04:27.194092    3849 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:04:27.215116    3849 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:04:27.236267    3849 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:04:27.259118    3849 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:04:27.280234    3849 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:04:27.301336    3849 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:04:27.330119    3849 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:04:27.372261    3849 start.go:297] selected driver: hyperkit
	I0307 14:04:27.372279    3849 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:04:27.372291    3849 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:04:27.375316    3849 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:04:27.375426    3849 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:04:27.383238    3849 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:04:27.387130    3849 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:04:27.387154    3849 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 14:04:27.387190    3849 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:04:27.387415    3849 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:04:27.387472    3849 cni.go:84] Creating CNI manager for ""
	I0307 14:04:27.387481    3849 cni.go:136] multinode detected (0 nodes found), recommending kindnet
	I0307 14:04:27.387488    3849 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0307 14:04:27.387561    3849 start.go:340] cluster config:
	{Name:multinode-419000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-419000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Containe
rRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock:
SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:04:27.387649    3849 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:04:27.409191    3849 out.go:177] * Starting "multinode-419000" primary control-plane node in "multinode-419000" cluster
	I0307 14:04:27.430271    3849 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:04:27.430358    3849 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:04:27.430392    3849 cache.go:56] Caching tarball of preloaded images
	I0307 14:04:27.430589    3849 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:04:27.430607    3849 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:04:27.431145    3849 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/multinode-419000/config.json ...
	I0307 14:04:27.431179    3849 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/multinode-419000/config.json: {Name:mk1229a4fe707de19209aa680cb9795d6e6d8e00 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:04:27.431618    3849 start.go:360] acquireMachinesLock for multinode-419000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:04:27.431690    3849 start.go:364] duration metric: took 58.492µs to acquireMachinesLock for "multinode-419000"
	I0307 14:04:27.431718    3849 start.go:93] Provisioning new machine with config: &{Name:multinode-419000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-419000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:04:27.431772    3849 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:04:27.453371    3849 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:04:27.453599    3849 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:04:27.453660    3849 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:04:27.462266    3849 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50345
	I0307 14:04:27.462614    3849 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:04:27.463036    3849 main.go:141] libmachine: Using API Version  1
	I0307 14:04:27.463047    3849 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:04:27.463295    3849 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:04:27.463414    3849 main.go:141] libmachine: (multinode-419000) Calling .GetMachineName
	I0307 14:04:27.463491    3849 main.go:141] libmachine: (multinode-419000) Calling .DriverName
	I0307 14:04:27.463591    3849 start.go:159] libmachine.API.Create for "multinode-419000" (driver="hyperkit")
	I0307 14:04:27.463616    3849 client.go:168] LocalClient.Create starting
	I0307 14:04:27.463648    3849 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:04:27.463700    3849 main.go:141] libmachine: Decoding PEM data...
	I0307 14:04:27.463717    3849 main.go:141] libmachine: Parsing certificate...
	I0307 14:04:27.463799    3849 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:04:27.463843    3849 main.go:141] libmachine: Decoding PEM data...
	I0307 14:04:27.463855    3849 main.go:141] libmachine: Parsing certificate...
	I0307 14:04:27.463869    3849 main.go:141] libmachine: Running pre-create checks...
	I0307 14:04:27.463876    3849 main.go:141] libmachine: (multinode-419000) Calling .PreCreateCheck
	I0307 14:04:27.463961    3849 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:04:27.464185    3849 main.go:141] libmachine: (multinode-419000) Calling .GetConfigRaw
	I0307 14:04:27.474823    3849 main.go:141] libmachine: Creating machine...
	I0307 14:04:27.474852    3849 main.go:141] libmachine: (multinode-419000) Calling .Create
	I0307 14:04:27.475125    3849 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:04:27.475359    3849 main.go:141] libmachine: (multinode-419000) DBG | I0307 14:04:27.475080    3857 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:04:27.475475    3849 main.go:141] libmachine: (multinode-419000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:04:27.646405    3849 main.go:141] libmachine: (multinode-419000) DBG | I0307 14:04:27.646309    3857 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/id_rsa...
	I0307 14:04:27.774456    3849 main.go:141] libmachine: (multinode-419000) DBG | I0307 14:04:27.774377    3857 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/multinode-419000.rawdisk...
	I0307 14:04:27.774468    3849 main.go:141] libmachine: (multinode-419000) DBG | Writing magic tar header
	I0307 14:04:27.774479    3849 main.go:141] libmachine: (multinode-419000) DBG | Writing SSH key tar header
	I0307 14:04:27.774994    3849 main.go:141] libmachine: (multinode-419000) DBG | I0307 14:04:27.774958    3857 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000 ...
	I0307 14:04:28.135856    3849 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:04:28.135897    3849 main.go:141] libmachine: (multinode-419000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.pid
	I0307 14:04:28.135939    3849 main.go:141] libmachine: (multinode-419000) DBG | Using UUID f1e1e65b-dadf-4ab5-b584-c240698b9c58
	I0307 14:04:28.170050    3849 main.go:141] libmachine: (multinode-419000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:04:28.170127    3849 client.go:171] duration metric: took 706.497177ms to LocalClient.Create
	I0307 14:04:30.170396    3849 start.go:128] duration metric: took 2.738587205s to createHost
	I0307 14:04:30.170423    3849 start.go:83] releasing machines lock for "multinode-419000", held for 2.738701588s
	W0307 14:04:30.170450    3849 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:04:30.170945    3849 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:04:30.170974    3849 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:04:30.178937    3849 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50347
	I0307 14:04:30.179285    3849 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:04:30.179647    3849 main.go:141] libmachine: Using API Version  1
	I0307 14:04:30.179660    3849 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:04:30.179862    3849 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:04:30.180177    3849 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:04:30.180202    3849 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:04:30.187869    3849 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50349
	I0307 14:04:30.188208    3849 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:04:30.188556    3849 main.go:141] libmachine: Using API Version  1
	I0307 14:04:30.188572    3849 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:04:30.188798    3849 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:04:30.188902    3849 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:04:30.188991    3849 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:04:30.189018    3849 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:04:30.189030    3849 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:04:30.189068    3849 main.go:141] libmachine: (multinode-419000) Calling .DriverName
	I0307 14:04:30.243733    3849 out.go:177] * Deleting "multinode-419000" in hyperkit ...
	I0307 14:04:30.265650    3849 main.go:141] libmachine: (multinode-419000) Calling .Remove
	I0307 14:04:30.265903    3849 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:04:30.265921    3849 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:04:30.265942    3849 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:04:30.265962    3849 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	W0307 14:04:30.282926    3849 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:04:30.282938    3849 start.go:728] Will try again in 5 seconds ...
	I0307 14:04:35.283639    3849 start.go:360] acquireMachinesLock for multinode-419000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:04:35.283737    3849 start.go:364] duration metric: took 78.152µs to acquireMachinesLock for "multinode-419000"
	I0307 14:04:35.283755    3849 start.go:93] Provisioning new machine with config: &{Name:multinode-419000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-419000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:04:35.283828    3849 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:04:35.327285    3849 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:04:35.327408    3849 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:04:35.327467    3849 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:04:35.336149    3849 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50351
	I0307 14:04:35.336492    3849 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:04:35.336881    3849 main.go:141] libmachine: Using API Version  1
	I0307 14:04:35.336896    3849 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:04:35.337125    3849 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:04:35.337262    3849 main.go:141] libmachine: (multinode-419000) Calling .GetMachineName
	I0307 14:04:35.337359    3849 main.go:141] libmachine: (multinode-419000) Calling .DriverName
	I0307 14:04:35.337498    3849 start.go:159] libmachine.API.Create for "multinode-419000" (driver="hyperkit")
	I0307 14:04:35.337522    3849 client.go:168] LocalClient.Create starting
	I0307 14:04:35.337550    3849 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:04:35.337597    3849 main.go:141] libmachine: Decoding PEM data...
	I0307 14:04:35.337608    3849 main.go:141] libmachine: Parsing certificate...
	I0307 14:04:35.337647    3849 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:04:35.337690    3849 main.go:141] libmachine: Decoding PEM data...
	I0307 14:04:35.337702    3849 main.go:141] libmachine: Parsing certificate...
	I0307 14:04:35.337714    3849 main.go:141] libmachine: Running pre-create checks...
	I0307 14:04:35.337719    3849 main.go:141] libmachine: (multinode-419000) Calling .PreCreateCheck
	I0307 14:04:35.337808    3849 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:04:35.337842    3849 main.go:141] libmachine: (multinode-419000) Calling .GetConfigRaw
	I0307 14:04:35.338288    3849 main.go:141] libmachine: Creating machine...
	I0307 14:04:35.338295    3849 main.go:141] libmachine: (multinode-419000) Calling .Create
	I0307 14:04:35.338370    3849 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:04:35.338489    3849 main.go:141] libmachine: (multinode-419000) DBG | I0307 14:04:35.338362    3863 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:04:35.338545    3849 main.go:141] libmachine: (multinode-419000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:04:35.513943    3849 main.go:141] libmachine: (multinode-419000) DBG | I0307 14:04:35.513882    3863 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/id_rsa...
	I0307 14:04:35.633847    3849 main.go:141] libmachine: (multinode-419000) DBG | I0307 14:04:35.633743    3863 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/multinode-419000.rawdisk...
	I0307 14:04:35.633867    3849 main.go:141] libmachine: (multinode-419000) DBG | Writing magic tar header
	I0307 14:04:35.633883    3849 main.go:141] libmachine: (multinode-419000) DBG | Writing SSH key tar header
	I0307 14:04:35.634183    3849 main.go:141] libmachine: (multinode-419000) DBG | I0307 14:04:35.634140    3863 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000 ...
	I0307 14:04:35.992773    3849 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:04:35.992793    3849 main.go:141] libmachine: (multinode-419000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.pid
	I0307 14:04:35.992830    3849 main.go:141] libmachine: (multinode-419000) DBG | Using UUID a293e975-e73b-4082-bd57-dd1c23566e3c
	I0307 14:04:36.029621    3849 main.go:141] libmachine: (multinode-419000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:04:36.029699    3849 client.go:171] duration metric: took 692.164486ms to LocalClient.Create
	I0307 14:04:38.029909    3849 start.go:128] duration metric: took 2.746048209s to createHost
	I0307 14:04:38.029929    3849 start.go:83] releasing machines lock for "multinode-419000", held for 2.746161924s
	W0307 14:04:38.030024    3849 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-419000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-419000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:04:38.074746    3849 out.go:177] 
	W0307 14:04:38.096643    3849 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:04:38.096718    3849 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:04:38.096738    3849 out.go:239] * Related issues:
	* Related issues:
	W0307 14:04:38.096861    3849 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:04:38.096896    3849 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:04:38.138846    3849 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:98: failed to start cluster. args "out/minikube-darwin-amd64 start -p multinode-419000 --wait=true --memory=2200 --nodes=2 -v=8 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000: exit status 7 (72.98269ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/FreshStart2Nodes (11.29s)

                                                
                                    
x
+
TestMultiNode/serial/DeployApp2Nodes (78.21s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeployApp2Nodes
multinode_test.go:493: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml
multinode_test.go:493: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- apply -f ./testdata/multinodes/multinode-pod-dns-test.yaml: exit status 1 (97.881118ms)

                                                
                                                
** stderr ** 
	error: cluster "multinode-419000" does not exist

                                                
                                                
** /stderr **
multinode_test.go:495: failed to create busybox deployment to multinode cluster
multinode_test.go:498: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- rollout status deployment/busybox
multinode_test.go:498: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- rollout status deployment/busybox: exit status 1 (97.16945ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:500: failed to deploy busybox to multinode cluster
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (98.109626ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (98.459706ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (98.351986ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (98.159259ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
E0307 14:04:45.407065    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (100.290293ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (101.10929ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (99.220744ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (99.868271ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
E0307 14:05:13.123188    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (99.214289ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:505: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}'
multinode_test.go:505: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].status.podIP}': exit status 1 (104.282713ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:508: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:524: failed to resolve pod IPs: failed to retrieve Pod IPs (may be temporary): exit status 1
multinode_test.go:528: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:528: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (97.293304ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:530: failed get Pod names
multinode_test.go:536: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- exec  -- nslookup kubernetes.io
multinode_test.go:536: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- exec  -- nslookup kubernetes.io: exit status 1 (97.880776ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:538: Pod  could not resolve 'kubernetes.io': exit status 1
multinode_test.go:546: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- exec  -- nslookup kubernetes.default
multinode_test.go:546: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- exec  -- nslookup kubernetes.default: exit status 1 (97.658977ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:548: Pod  could not resolve 'kubernetes.default': exit status 1
multinode_test.go:554: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- exec  -- nslookup kubernetes.default.svc.cluster.local
multinode_test.go:554: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- exec  -- nslookup kubernetes.default.svc.cluster.local: exit status 1 (97.979478ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:556: Pod  could not resolve local service (kubernetes.default.svc.cluster.local): exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000: exit status 7 (72.924953ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeployApp2Nodes (78.21s)

                                                
                                    
x
+
TestMultiNode/serial/PingHostFrom2Pods (0.2s)

                                                
                                                
=== RUN   TestMultiNode/serial/PingHostFrom2Pods
multinode_test.go:564: (dbg) Run:  out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].metadata.name}'
multinode_test.go:564: (dbg) Non-zero exit: out/minikube-darwin-amd64 kubectl -p multinode-419000 -- get pods -o jsonpath='{.items[*].metadata.name}': exit status 1 (98.445037ms)

                                                
                                                
** stderr ** 
	error: no server found for cluster "multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:566: failed to get Pod names: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000: exit status 7 (97.83877ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/PingHostFrom2Pods (0.20s)

                                                
                                    
x
+
TestMultiNode/serial/AddNode (0.21s)

                                                
                                                
=== RUN   TestMultiNode/serial/AddNode
multinode_test.go:121: (dbg) Run:  out/minikube-darwin-amd64 node add -p multinode-419000 -v 3 --alsologtostderr
multinode_test.go:121: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p multinode-419000 -v 3 --alsologtostderr: exit status 83 (137.846078ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-419000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-419000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:05:56.768951    3950 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:05:56.769150    3950 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:05:56.769155    3950 out.go:304] Setting ErrFile to fd 2...
	I0307 14:05:56.769159    3950 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:05:56.769354    3950 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:05:56.769698    3950 mustload.go:65] Loading cluster: multinode-419000
	I0307 14:05:56.770890    3950 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:05:56.771232    3950 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:05:56.771275    3950 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:05:56.779026    3950 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50362
	I0307 14:05:56.779384    3950 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:05:56.779832    3950 main.go:141] libmachine: Using API Version  1
	I0307 14:05:56.779843    3950 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:05:56.780085    3950 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:05:56.780209    3950 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:05:56.780302    3950 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:05:56.780333    3950 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:05:56.780352    3950 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:05:56.801510    3950 out.go:177] * The control-plane node multinode-419000 host is not running: state=Stopped
	I0307 14:05:56.822513    3950 out.go:177]   To start a cluster, run: "minikube start -p multinode-419000"

                                                
                                                
** /stderr **
multinode_test.go:123: failed to add node to current cluster. args "out/minikube-darwin-amd64 node add -p multinode-419000 -v 3 --alsologtostderr" : exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000: exit status 7 (72.846185ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/AddNode (0.21s)

                                                
                                    
x
+
TestMultiNode/serial/MultiNodeLabels (0.11s)

                                                
                                                
=== RUN   TestMultiNode/serial/MultiNodeLabels
multinode_test.go:221: (dbg) Run:  kubectl --context multinode-419000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]"
multinode_test.go:221: (dbg) Non-zero exit: kubectl --context multinode-419000 get nodes -o "jsonpath=[{range .items[*]}{.metadata.labels},{end}]": exit status 1 (36.919089ms)

                                                
                                                
** stderr ** 
	Error in configuration: context was not found for specified context: multinode-419000

                                                
                                                
** /stderr **
multinode_test.go:223: failed to 'kubectl get nodes' with args "kubectl --context multinode-419000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": exit status 1
multinode_test.go:230: failed to decode json from label list: args "kubectl --context multinode-419000 get nodes -o \"jsonpath=[{range .items[*]}{.metadata.labels},{end}]\"": unexpected end of JSON input
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000: exit status 7 (72.409827ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/MultiNodeLabels (0.11s)

                                                
                                    
x
+
TestMultiNode/serial/ProfileList (0.22s)

                                                
                                                
=== RUN   TestMultiNode/serial/ProfileList
multinode_test.go:143: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
multinode_test.go:166: expected profile "multinode-419000" in json of 'profile list' include 3 nodes but have 1 nodes. got *"{\"invalid\":[],\"valid\":[{\"Name\":\"multinode-419000\",\"Status\":\"Stopped\",\"Config\":{\"Name\":\"multinode-419000\",\"KeepContext\":false,\"EmbedCerts\":false,\"MinikubeISO\":\"https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso\",\"KicBaseImage\":\"gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08\",\"Memory\":2200,\"CPUs\":2,\"DiskSize\":20000,\"Driver\":\"hyperkit\",\"HyperkitVpnKitSock\":\"\",\"HyperkitVSockPorts\":[],\"DockerEnv\":null,\"ContainerVolumeMounts\":null,\"InsecureRegistry\":null,\"RegistryMirror\":[],\"HostOnlyCIDR\":\"192.168.59.1/24\",\"HypervVirtualSwitch\":\"\",\"HypervUseExternalSwitch\":false,\"HypervExternalAdapter\":\"\",\"KVMNetwork\":\"default\",\"KVMQemuURI\":\"qemu:///system\",\"KVMGPU\":false,\"KVMHidden\":false,\"KV
MNUMACount\":1,\"APIServerPort\":8443,\"DockerOpt\":null,\"DisableDriverMounts\":false,\"NFSShare\":[],\"NFSSharesRoot\":\"/nfsshares\",\"UUID\":\"\",\"NoVTXCheck\":false,\"DNSProxy\":false,\"HostDNSResolver\":true,\"HostOnlyNicType\":\"virtio\",\"NatNicType\":\"virtio\",\"SSHIPAddress\":\"\",\"SSHUser\":\"root\",\"SSHKey\":\"\",\"SSHPort\":22,\"KubernetesConfig\":{\"KubernetesVersion\":\"v1.28.4\",\"ClusterName\":\"multinode-419000\",\"Namespace\":\"default\",\"APIServerHAVIP\":\"\",\"APIServerName\":\"minikubeCA\",\"APIServerNames\":null,\"APIServerIPs\":null,\"DNSDomain\":\"cluster.local\",\"ContainerRuntime\":\"docker\",\"CRISocket\":\"\",\"NetworkPlugin\":\"cni\",\"FeatureGates\":\"\",\"ServiceCIDR\":\"10.96.0.0/12\",\"ImageRepository\":\"\",\"LoadBalancerStartIP\":\"\",\"LoadBalancerEndIP\":\"\",\"CustomIngressCert\":\"\",\"RegistryAliases\":\"\",\"ExtraOptions\":null,\"ShouldLoadCachedImages\":true,\"EnableDefaultCNI\":false,\"CNI\":\"\"},\"Nodes\":[{\"Name\":\"\",\"IP\":\"\",\"Port\":8443,\"Kubernetes
Version\":\"v1.28.4\",\"ContainerRuntime\":\"docker\",\"ControlPlane\":true,\"Worker\":true}],\"Addons\":null,\"CustomAddonImages\":null,\"CustomAddonRegistries\":null,\"VerifyComponents\":{\"apiserver\":true,\"apps_running\":true,\"default_sa\":true,\"extra\":true,\"kubelet\":true,\"node_ready\":true,\"system_pods\":true},\"StartHostTimeout\":360000000000,\"ScheduledStop\":null,\"ExposedPorts\":[],\"ListenAddress\":\"\",\"Network\":\"\",\"Subnet\":\"\",\"MultiNodeRequested\":true,\"ExtraDisks\":0,\"CertExpiration\":94608000000000000,\"Mount\":false,\"MountString\":\"/Users:/minikube-host\",\"Mount9PVersion\":\"9p2000.L\",\"MountGID\":\"docker\",\"MountIP\":\"\",\"MountMSize\":262144,\"MountOptions\":[],\"MountPort\":0,\"MountType\":\"9p\",\"MountUID\":\"docker\",\"BinaryMirror\":\"\",\"DisableOptimizations\":false,\"DisableMetrics\":false,\"CustomQemuFirmwarePath\":\"\",\"SocketVMnetClientPath\":\"\",\"SocketVMnetPath\":\"\",\"StaticIP\":\"\",\"SSHAuthSock\":\"\",\"SSHAgentPID\":0,\"GPUs\":\"\",\"AutoPauseIn
terval\":60000000000},\"Active\":false}]}"*. args: "out/minikube-darwin-amd64 profile list --output json"
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000: exit status 7 (71.63785ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ProfileList (0.22s)

                                                
                                    
x
+
TestMultiNode/serial/CopyFile (0.15s)

                                                
                                                
=== RUN   TestMultiNode/serial/CopyFile
multinode_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 status --output json --alsologtostderr
multinode_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 status --output json --alsologtostderr: exit status 7 (73.465503ms)

                                                
                                                
-- stdout --
	{"Name":"multinode-419000","Host":"Stopped","Kubelet":"Stopped","APIServer":"Stopped","Kubeconfig":"Stopped","Worker":false}

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:05:57.305506    3968 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:05:57.305774    3968 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:05:57.305779    3968 out.go:304] Setting ErrFile to fd 2...
	I0307 14:05:57.305784    3968 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:05:57.305962    3968 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:05:57.306155    3968 out.go:298] Setting JSON to true
	I0307 14:05:57.306179    3968 mustload.go:65] Loading cluster: multinode-419000
	I0307 14:05:57.306222    3968 notify.go:220] Checking for updates...
	I0307 14:05:57.307466    3968 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:05:57.307486    3968 status.go:255] checking status of multinode-419000 ...
	I0307 14:05:57.307867    3968 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:05:57.307923    3968 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:05:57.316208    3968 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50377
	I0307 14:05:57.316547    3968 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:05:57.316979    3968 main.go:141] libmachine: Using API Version  1
	I0307 14:05:57.316991    3968 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:05:57.317187    3968 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:05:57.317280    3968 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:05:57.317364    3968 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:05:57.317376    3968 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:05:57.317390    3968 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:05:57.317407    3968 status.go:330] multinode-419000 host status = "Stopped" (err=<nil>)
	I0307 14:05:57.317421    3968 status.go:343] host is not running, skipping remaining checks
	I0307 14:05:57.317428    3968 status.go:257] multinode-419000 status: &{Name:multinode-419000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:191: failed to decode json from status: args "out/minikube-darwin-amd64 -p multinode-419000 status --output json --alsologtostderr": json: cannot unmarshal object into Go value of type []cmd.Status
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000: exit status 7 (71.737899ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/CopyFile (0.15s)

                                                
                                    
x
+
TestMultiNode/serial/StopNode (0.37s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopNode
multinode_test.go:248: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 node stop m03
multinode_test.go:248: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 node stop m03: exit status 85 (153.00571ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	* 
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_295f67d8757edd996fe5c1e7ccde72c355ccf4dc_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯

                                                
                                                
** /stderr **
multinode_test.go:250: node stop returned an error. args "out/minikube-darwin-amd64 -p multinode-419000 node stop m03": exit status 85
multinode_test.go:254: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 status
multinode_test.go:254: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 status: exit status 7 (73.139776ms)

                                                
                                                
-- stdout --
	multinode-419000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:261: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 status --alsologtostderr
multinode_test.go:261: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 status --alsologtostderr: exit status 7 (73.409678ms)

                                                
                                                
-- stdout --
	multinode-419000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:05:57.678092    3979 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:05:57.678269    3979 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:05:57.678274    3979 out.go:304] Setting ErrFile to fd 2...
	I0307 14:05:57.678278    3979 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:05:57.678462    3979 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:05:57.678656    3979 out.go:298] Setting JSON to false
	I0307 14:05:57.678676    3979 mustload.go:65] Loading cluster: multinode-419000
	I0307 14:05:57.678723    3979 notify.go:220] Checking for updates...
	I0307 14:05:57.679979    3979 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:05:57.680002    3979 status.go:255] checking status of multinode-419000 ...
	I0307 14:05:57.680346    3979 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:05:57.680388    3979 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:05:57.688605    3979 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50386
	I0307 14:05:57.688949    3979 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:05:57.689366    3979 main.go:141] libmachine: Using API Version  1
	I0307 14:05:57.689384    3979 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:05:57.689578    3979 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:05:57.689686    3979 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:05:57.689775    3979 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:05:57.689793    3979 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:05:57.689803    3979 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:05:57.689844    3979 status.go:330] multinode-419000 host status = "Stopped" (err=<nil>)
	I0307 14:05:57.689855    3979 status.go:343] host is not running, skipping remaining checks
	I0307 14:05:57.689861    3979 status.go:257] multinode-419000 status: &{Name:multinode-419000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:267: incorrect number of running kubelets: args "out/minikube-darwin-amd64 -p multinode-419000 status --alsologtostderr": multinode-419000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000: exit status 7 (72.259687ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopNode (0.37s)

                                                
                                    
x
+
TestMultiNode/serial/StartAfterStop (42.69s)

                                                
                                                
=== RUN   TestMultiNode/serial/StartAfterStop
multinode_test.go:282: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 node start m03 -v=7 --alsologtostderr
multinode_test.go:282: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 node start m03 -v=7 --alsologtostderr: exit status 85 (155.730702ms)

                                                
                                                
-- stdout --
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:05:57.824633    3985 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:05:57.824910    3985 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:05:57.824916    3985 out.go:304] Setting ErrFile to fd 2...
	I0307 14:05:57.824920    3985 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:05:57.825084    3985 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:05:57.825403    3985 mustload.go:65] Loading cluster: multinode-419000
	I0307 14:05:57.825695    3985 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:05:57.846955    3985 out.go:177] 
	W0307 14:05:57.867607    3985 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
	W0307 14:05:57.867645    3985 out.go:239] * 
	* 
	W0307 14:05:57.870433    3985 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
	│                                                                                                                         │
	│    * If the above advice does not help, please let us know:                                                             │
	│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
	│                                                                                                                         │
	│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
	│    * Please also attach the following file to the GitHub issue:                                                         │
	│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
	│                                                                                                                         │
	╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
	I0307 14:05:57.897689    3985 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:284: I0307 14:05:57.824633    3985 out.go:291] Setting OutFile to fd 1 ...
I0307 14:05:57.824910    3985 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 14:05:57.824916    3985 out.go:304] Setting ErrFile to fd 2...
I0307 14:05:57.824920    3985 out.go:338] TERM=,COLORTERM=, which probably does not support color
I0307 14:05:57.825084    3985 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
I0307 14:05:57.825403    3985 mustload.go:65] Loading cluster: multinode-419000
I0307 14:05:57.825695    3985 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
I0307 14:05:57.846955    3985 out.go:177] 
W0307 14:05:57.867607    3985 out.go:239] X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
X Exiting due to GUEST_NODE_RETRIEVE: retrieving node: Could not find node m03
W0307 14:05:57.867645    3985 out.go:239] * 
* 
W0307 14:05:57.870433    3985 out.go:239] ╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                         │
│    * If the above advice does not help, please let us know:                                                             │
│      https://github.com/kubernetes/minikube/issues/new/choose                                                           │
│                                                                                                                         │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    * Please also attach the following file to the GitHub issue:                                                         │
│    * - /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube_node_1c3a1297795327375b61f3ff5a4ef34c9b2fc69b_0.log    │
│                                                                                                                         │
╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
I0307 14:05:57.897689    3985 out.go:177] 
multinode_test.go:285: node start returned an error. args "out/minikube-darwin-amd64 -p multinode-419000 node start m03 -v=7 --alsologtostderr": exit status 85
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr: exit status 7 (72.922219ms)

                                                
                                                
-- stdout --
	multinode-419000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:05:57.979727    3987 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:05:57.980012    3987 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:05:57.980018    3987 out.go:304] Setting ErrFile to fd 2...
	I0307 14:05:57.980022    3987 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:05:57.980198    3987 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:05:57.980373    3987 out.go:298] Setting JSON to false
	I0307 14:05:57.980394    3987 mustload.go:65] Loading cluster: multinode-419000
	I0307 14:05:57.980437    3987 notify.go:220] Checking for updates...
	I0307 14:05:57.981604    3987 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:05:57.981627    3987 status.go:255] checking status of multinode-419000 ...
	I0307 14:05:57.981974    3987 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:05:57.982018    3987 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:05:57.990171    3987 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50392
	I0307 14:05:57.990537    3987 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:05:57.990939    3987 main.go:141] libmachine: Using API Version  1
	I0307 14:05:57.990948    3987 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:05:57.991205    3987 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:05:57.991334    3987 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:05:57.991419    3987 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:05:57.991433    3987 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:05:57.991450    3987 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:05:57.991470    3987 status.go:330] multinode-419000 host status = "Stopped" (err=<nil>)
	I0307 14:05:57.991485    3987 status.go:343] host is not running, skipping remaining checks
	I0307 14:05:57.991491    3987 status.go:257] multinode-419000 status: &{Name:multinode-419000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr: exit status 7 (74.441269ms)

                                                
                                                
-- stdout --
	multinode-419000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:05:59.023447    3990 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:05:59.023705    3990 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:05:59.023711    3990 out.go:304] Setting ErrFile to fd 2...
	I0307 14:05:59.023714    3990 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:05:59.023910    3990 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:05:59.024087    3990 out.go:298] Setting JSON to false
	I0307 14:05:59.024108    3990 mustload.go:65] Loading cluster: multinode-419000
	I0307 14:05:59.024156    3990 notify.go:220] Checking for updates...
	I0307 14:05:59.024391    3990 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:05:59.024408    3990 status.go:255] checking status of multinode-419000 ...
	I0307 14:05:59.024812    3990 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:05:59.024881    3990 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:05:59.033119    3990 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50395
	I0307 14:05:59.033465    3990 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:05:59.034032    3990 main.go:141] libmachine: Using API Version  1
	I0307 14:05:59.034052    3990 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:05:59.034253    3990 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:05:59.034370    3990 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:05:59.034459    3990 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:05:59.034484    3990 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:05:59.034493    3990 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:05:59.034512    3990 status.go:330] multinode-419000 host status = "Stopped" (err=<nil>)
	I0307 14:05:59.034523    3990 status.go:343] host is not running, skipping remaining checks
	I0307 14:05:59.034531    3990 status.go:257] multinode-419000 status: &{Name:multinode-419000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr: exit status 7 (75.97692ms)

                                                
                                                
-- stdout --
	multinode-419000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:06:00.455700    3993 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:06:00.455982    3993 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:00.455988    3993 out.go:304] Setting ErrFile to fd 2...
	I0307 14:06:00.455991    3993 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:00.456188    3993 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:06:00.456361    3993 out.go:298] Setting JSON to false
	I0307 14:06:00.456382    3993 mustload.go:65] Loading cluster: multinode-419000
	I0307 14:06:00.456418    3993 notify.go:220] Checking for updates...
	I0307 14:06:00.456671    3993 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:06:00.456689    3993 status.go:255] checking status of multinode-419000 ...
	I0307 14:06:00.457065    3993 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:00.457115    3993 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:06:00.465465    3993 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50398
	I0307 14:06:00.465788    3993 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:06:00.466199    3993 main.go:141] libmachine: Using API Version  1
	I0307 14:06:00.466223    3993 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:06:00.466422    3993 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:06:00.466518    3993 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:06:00.466594    3993 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:06:00.466615    3993 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:06:00.466622    3993 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:06:00.466690    3993 status.go:330] multinode-419000 host status = "Stopped" (err=<nil>)
	I0307 14:06:00.466707    3993 status.go:343] host is not running, skipping remaining checks
	I0307 14:06:00.466717    3993 status.go:257] multinode-419000 status: &{Name:multinode-419000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr: exit status 7 (74.030008ms)

                                                
                                                
-- stdout --
	multinode-419000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:06:03.009734    3996 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:06:03.009997    3996 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:03.010003    3996 out.go:304] Setting ErrFile to fd 2...
	I0307 14:06:03.010006    3996 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:03.010184    3996 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:06:03.010360    3996 out.go:298] Setting JSON to false
	I0307 14:06:03.010381    3996 mustload.go:65] Loading cluster: multinode-419000
	I0307 14:06:03.010419    3996 notify.go:220] Checking for updates...
	I0307 14:06:03.010638    3996 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:06:03.010657    3996 status.go:255] checking status of multinode-419000 ...
	I0307 14:06:03.011028    3996 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:03.011065    3996 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:06:03.019039    3996 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50401
	I0307 14:06:03.019370    3996 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:06:03.019774    3996 main.go:141] libmachine: Using API Version  1
	I0307 14:06:03.019792    3996 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:06:03.020034    3996 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:06:03.020157    3996 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:06:03.020244    3996 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:06:03.020259    3996 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:06:03.020272    3996 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:06:03.020311    3996 status.go:330] multinode-419000 host status = "Stopped" (err=<nil>)
	I0307 14:06:03.020324    3996 status.go:343] host is not running, skipping remaining checks
	I0307 14:06:03.020330    3996 status.go:257] multinode-419000 status: &{Name:multinode-419000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr: exit status 7 (73.645104ms)

                                                
                                                
-- stdout --
	multinode-419000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:06:07.099436    3999 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:06:07.099695    3999 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:07.099701    3999 out.go:304] Setting ErrFile to fd 2...
	I0307 14:06:07.099705    3999 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:07.099895    3999 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:06:07.100065    3999 out.go:298] Setting JSON to false
	I0307 14:06:07.100104    3999 mustload.go:65] Loading cluster: multinode-419000
	I0307 14:06:07.100140    3999 notify.go:220] Checking for updates...
	I0307 14:06:07.100365    3999 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:06:07.100383    3999 status.go:255] checking status of multinode-419000 ...
	I0307 14:06:07.100726    3999 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:07.100766    3999 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:06:07.108621    3999 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50404
	I0307 14:06:07.108974    3999 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:06:07.109403    3999 main.go:141] libmachine: Using API Version  1
	I0307 14:06:07.109415    3999 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:06:07.109654    3999 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:06:07.109760    3999 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:06:07.109841    3999 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:06:07.109857    3999 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:06:07.109865    3999 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:06:07.109905    3999 status.go:330] multinode-419000 host status = "Stopped" (err=<nil>)
	I0307 14:06:07.109918    3999 status.go:343] host is not running, skipping remaining checks
	I0307 14:06:07.109924    3999 status.go:257] multinode-419000 status: &{Name:multinode-419000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr: exit status 7 (77.691161ms)

                                                
                                                
-- stdout --
	multinode-419000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:06:13.448726    4004 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:06:13.448989    4004 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:13.448994    4004 out.go:304] Setting ErrFile to fd 2...
	I0307 14:06:13.448998    4004 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:13.449177    4004 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:06:13.449885    4004 out.go:298] Setting JSON to false
	I0307 14:06:13.449930    4004 mustload.go:65] Loading cluster: multinode-419000
	I0307 14:06:13.450139    4004 notify.go:220] Checking for updates...
	I0307 14:06:13.450472    4004 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:06:13.450499    4004 status.go:255] checking status of multinode-419000 ...
	I0307 14:06:13.450843    4004 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:13.450890    4004 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:06:13.459399    4004 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50407
	I0307 14:06:13.459763    4004 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:06:13.460178    4004 main.go:141] libmachine: Using API Version  1
	I0307 14:06:13.460188    4004 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:06:13.460379    4004 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:06:13.460473    4004 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:06:13.460554    4004 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:06:13.460597    4004 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:06:13.460610    4004 status.go:330] multinode-419000 host status = "Stopped" (err=<nil>)
	I0307 14:06:13.460616    4004 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:06:13.460618    4004 status.go:343] host is not running, skipping remaining checks
	I0307 14:06:13.460625    4004 status.go:257] multinode-419000 status: &{Name:multinode-419000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr: exit status 7 (73.784548ms)

                                                
                                                
-- stdout --
	multinode-419000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:06:23.661917    4012 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:06:23.662770    4012 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:23.662779    4012 out.go:304] Setting ErrFile to fd 2...
	I0307 14:06:23.662785    4012 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:23.663323    4012 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:06:23.663506    4012 out.go:298] Setting JSON to false
	I0307 14:06:23.663529    4012 mustload.go:65] Loading cluster: multinode-419000
	I0307 14:06:23.663576    4012 notify.go:220] Checking for updates...
	I0307 14:06:23.663791    4012 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:06:23.663808    4012 status.go:255] checking status of multinode-419000 ...
	I0307 14:06:23.664148    4012 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:23.664185    4012 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:06:23.672357    4012 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50410
	I0307 14:06:23.672708    4012 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:06:23.673112    4012 main.go:141] libmachine: Using API Version  1
	I0307 14:06:23.673121    4012 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:06:23.673343    4012 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:06:23.673450    4012 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:06:23.673530    4012 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:06:23.673548    4012 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:06:23.673560    4012 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:06:23.673568    4012 status.go:330] multinode-419000 host status = "Stopped" (err=<nil>)
	I0307 14:06:23.673577    4012 status.go:343] host is not running, skipping remaining checks
	I0307 14:06:23.673586    4012 status.go:257] multinode-419000 status: &{Name:multinode-419000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:290: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr
multinode_test.go:290: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr: exit status 7 (73.262259ms)

                                                
                                                
-- stdout --
	multinode-419000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:06:40.377866    4017 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:06:40.378036    4017 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:40.378042    4017 out.go:304] Setting ErrFile to fd 2...
	I0307 14:06:40.378046    4017 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:40.378217    4017 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:06:40.378407    4017 out.go:298] Setting JSON to false
	I0307 14:06:40.378428    4017 mustload.go:65] Loading cluster: multinode-419000
	I0307 14:06:40.378466    4017 notify.go:220] Checking for updates...
	I0307 14:06:40.378694    4017 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:06:40.378716    4017 status.go:255] checking status of multinode-419000 ...
	I0307 14:06:40.379064    4017 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:40.379116    4017 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:06:40.387023    4017 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50413
	I0307 14:06:40.387335    4017 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:06:40.387758    4017 main.go:141] libmachine: Using API Version  1
	I0307 14:06:40.387769    4017 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:06:40.387964    4017 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:06:40.388052    4017 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:06:40.388129    4017 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:06:40.388208    4017 status.go:330] multinode-419000 host status = "Stopped" (err=<nil>)
	I0307 14:06:40.388216    4017 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:06:40.388224    4017 status.go:343] host is not running, skipping remaining checks
	I0307 14:06:40.388234    4017 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:06:40.388233    4017 status.go:257] multinode-419000 status: &{Name:multinode-419000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:294: failed to run minikube status. args "out/minikube-darwin-amd64 -p multinode-419000 status -v=7 --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000: exit status 7 (72.884695ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StartAfterStop (42.69s)

                                                
                                    
x
+
TestMultiNode/serial/RestartKeepsNodes (10.08s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartKeepsNodes
multinode_test.go:314: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-419000
multinode_test.go:321: (dbg) Run:  out/minikube-darwin-amd64 stop -p multinode-419000
multinode_test.go:321: (dbg) Done: out/minikube-darwin-amd64 stop -p multinode-419000: (4.023062128s)
multinode_test.go:326: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-419000 --wait=true -v=8 --alsologtostderr
multinode_test.go:326: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-419000 --wait=true -v=8 --alsologtostderr: exit status 60 (5.861995694s)

                                                
                                                
-- stdout --
	* [multinode-419000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "multinode-419000" primary control-plane node in "multinode-419000" cluster
	* Restarting existing hyperkit VM for "multinode-419000" ...
	* Restarting existing hyperkit VM for "multinode-419000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:06:44.608677    4050 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:06:44.608927    4050 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:44.608933    4050 out.go:304] Setting ErrFile to fd 2...
	I0307 14:06:44.608936    4050 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:44.609102    4050 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:06:44.610444    4050 out.go:298] Setting JSON to false
	I0307 14:06:44.632465    4050 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2175,"bootTime":1709847029,"procs":489,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:06:44.632558    4050 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:06:44.653927    4050 out.go:177] * [multinode-419000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:06:44.696548    4050 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:06:44.696605    4050 notify.go:220] Checking for updates...
	I0307 14:06:44.739684    4050 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:06:44.760613    4050 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:06:44.781589    4050 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:06:44.802620    4050 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:06:44.844694    4050 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:06:44.866526    4050 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:06:44.866699    4050 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:06:44.867336    4050 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:44.867400    4050 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:06:44.876088    4050 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50430
	I0307 14:06:44.876456    4050 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:06:44.876868    4050 main.go:141] libmachine: Using API Version  1
	I0307 14:06:44.876884    4050 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:06:44.877156    4050 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:06:44.877279    4050 main.go:141] libmachine: (multinode-419000) Calling .DriverName
	I0307 14:06:44.905456    4050 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 14:06:44.947734    4050 start.go:297] selected driver: hyperkit
	I0307 14:06:44.947763    4050 start.go:901] validating driver "hyperkit" against &{Name:multinode-419000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-419000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:06:44.947949    4050 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:06:44.948138    4050 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:06:44.948311    4050 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:06:44.957295    4050 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:06:44.961065    4050 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:44.961091    4050 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 14:06:44.963768    4050 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:06:44.963842    4050 cni.go:84] Creating CNI manager for ""
	I0307 14:06:44.963863    4050 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0307 14:06:44.963945    4050 start.go:340] cluster config:
	{Name:multinode-419000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-419000 Namespace:default APIServ
erHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disable
Metrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:06:44.964033    4050 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:06:45.006491    4050 out.go:177] * Starting "multinode-419000" primary control-plane node in "multinode-419000" cluster
	I0307 14:06:45.027630    4050 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:06:45.027724    4050 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:06:45.027753    4050 cache.go:56] Caching tarball of preloaded images
	I0307 14:06:45.027978    4050 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:06:45.027997    4050 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:06:45.028127    4050 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/multinode-419000/config.json ...
	I0307 14:06:45.028976    4050 start.go:360] acquireMachinesLock for multinode-419000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:06:45.029095    4050 start.go:364] duration metric: took 93.539µs to acquireMachinesLock for "multinode-419000"
	I0307 14:06:45.029130    4050 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:06:45.029164    4050 fix.go:54] fixHost starting: 
	I0307 14:06:45.029589    4050 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:45.029629    4050 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:06:45.038057    4050 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50432
	I0307 14:06:45.038405    4050 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:06:45.038742    4050 main.go:141] libmachine: Using API Version  1
	I0307 14:06:45.038753    4050 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:06:45.039011    4050 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:06:45.039138    4050 main.go:141] libmachine: (multinode-419000) Calling .DriverName
	I0307 14:06:45.039239    4050 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:06:45.039323    4050 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:06:45.039340    4050 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:06:45.039355    4050 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:06:45.039381    4050 fix.go:112] recreateIfNeeded on multinode-419000: state=Stopped err=<nil>
	I0307 14:06:45.039395    4050 main.go:141] libmachine: (multinode-419000) Calling .DriverName
	W0307 14:06:45.039473    4050 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:06:45.060485    4050 out.go:177] * Restarting existing hyperkit VM for "multinode-419000" ...
	I0307 14:06:45.103693    4050 main.go:141] libmachine: (multinode-419000) Calling .Start
	I0307 14:06:45.103974    4050 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:06:45.104003    4050 main.go:141] libmachine: (multinode-419000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.pid
	I0307 14:06:45.104042    4050 main.go:141] libmachine: (multinode-419000) DBG | Using UUID a293e975-e73b-4082-bd57-dd1c23566e3c
	I0307 14:06:45.141710    4050 main.go:141] libmachine: (multinode-419000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:06:45.141818    4050 fix.go:56] duration metric: took 112.664805ms for fixHost
	I0307 14:06:45.141829    4050 start.go:83] releasing machines lock for "multinode-419000", held for 112.713932ms
	W0307 14:06:45.141860    4050 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 14:06:45.141922    4050 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:06:45.141929    4050 start.go:728] Will try again in 5 seconds ...
	I0307 14:06:50.143892    4050 start.go:360] acquireMachinesLock for multinode-419000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:06:50.144074    4050 start.go:364] duration metric: took 112.798µs to acquireMachinesLock for "multinode-419000"
	I0307 14:06:50.144109    4050 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:06:50.144117    4050 fix.go:54] fixHost starting: 
	I0307 14:06:50.144561    4050 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:50.144625    4050 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:06:50.153682    4050 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50434
	I0307 14:06:50.154010    4050 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:06:50.154377    4050 main.go:141] libmachine: Using API Version  1
	I0307 14:06:50.154393    4050 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:06:50.154597    4050 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:06:50.154703    4050 main.go:141] libmachine: (multinode-419000) Calling .DriverName
	I0307 14:06:50.154785    4050 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:06:50.154871    4050 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:06:50.154902    4050 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:06:50.154909    4050 fix.go:112] recreateIfNeeded on multinode-419000: state=Stopped err=<nil>
	I0307 14:06:50.154915    4050 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:06:50.154920    4050 main.go:141] libmachine: (multinode-419000) Calling .DriverName
	W0307 14:06:50.154997    4050 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:06:50.176714    4050 out.go:177] * Restarting existing hyperkit VM for "multinode-419000" ...
	I0307 14:06:50.219355    4050 main.go:141] libmachine: (multinode-419000) Calling .Start
	I0307 14:06:50.219605    4050 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:06:50.219627    4050 main.go:141] libmachine: (multinode-419000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.pid
	I0307 14:06:50.219695    4050 main.go:141] libmachine: (multinode-419000) DBG | Using UUID a293e975-e73b-4082-bd57-dd1c23566e3c
	I0307 14:06:50.221431    4050 main.go:141] libmachine: (multinode-419000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:06:50.221526    4050 fix.go:56] duration metric: took 77.402927ms for fixHost
	I0307 14:06:50.221538    4050 start.go:83] releasing machines lock for "multinode-419000", held for 77.444919ms
	W0307 14:06:50.221612    4050 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-419000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-419000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:06:50.263495    4050 out.go:177] 
	W0307 14:06:50.284643    4050 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:06:50.284698    4050 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:06:50.284713    4050 out.go:239] * Related issues:
	* Related issues:
	W0307 14:06:50.284741    4050 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:06:50.284770    4050 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:06:50.327268    4050 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:328: failed to run minikube start. args "out/minikube-darwin-amd64 node list -p multinode-419000" : exit status 60
multinode_test.go:331: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-419000
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000: exit status 7 (72.885293ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartKeepsNodes (10.08s)

                                                
                                    
x
+
TestMultiNode/serial/DeleteNode (0.28s)

                                                
                                                
=== RUN   TestMultiNode/serial/DeleteNode
multinode_test.go:416: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 node delete m03
multinode_test.go:416: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 node delete m03: exit status 83 (136.922884ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-419000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-419000"

                                                
                                                
-- /stdout --
multinode_test.go:418: node delete returned an error. args "out/minikube-darwin-amd64 -p multinode-419000 node delete m03": exit status 83
multinode_test.go:422: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 status --alsologtostderr
multinode_test.go:422: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 status --alsologtostderr: exit status 7 (73.059671ms)

                                                
                                                
-- stdout --
	multinode-419000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:06:50.745367    4070 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:06:50.746105    4070 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:50.746114    4070 out.go:304] Setting ErrFile to fd 2...
	I0307 14:06:50.746120    4070 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:50.746708    4070 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:06:50.746897    4070 out.go:298] Setting JSON to false
	I0307 14:06:50.746922    4070 mustload.go:65] Loading cluster: multinode-419000
	I0307 14:06:50.746957    4070 notify.go:220] Checking for updates...
	I0307 14:06:50.747174    4070 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:06:50.747192    4070 status.go:255] checking status of multinode-419000 ...
	I0307 14:06:50.747514    4070 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:50.747561    4070 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:06:50.755655    4070 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50442
	I0307 14:06:50.755971    4070 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:06:50.756364    4070 main.go:141] libmachine: Using API Version  1
	I0307 14:06:50.756374    4070 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:06:50.756589    4070 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:06:50.756688    4070 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:06:50.756779    4070 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:06:50.756798    4070 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:06:50.756803    4070 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:06:50.756854    4070 status.go:330] multinode-419000 host status = "Stopped" (err=<nil>)
	I0307 14:06:50.756864    4070 status.go:343] host is not running, skipping remaining checks
	I0307 14:06:50.756871    4070 status.go:257] multinode-419000 status: &{Name:multinode-419000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:424: failed to run minikube status. args "out/minikube-darwin-amd64 -p multinode-419000 status --alsologtostderr" : exit status 7
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000: exit status 7 (72.537691ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/DeleteNode (0.28s)

                                                
                                    
x
+
TestMultiNode/serial/StopMultiNode (4.26s)

                                                
                                                
=== RUN   TestMultiNode/serial/StopMultiNode
multinode_test.go:345: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 stop
multinode_test.go:345: (dbg) Done: out/minikube-darwin-amd64 -p multinode-419000 stop: (4.036282248s)
multinode_test.go:351: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 status
multinode_test.go:351: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 status: exit status 7 (72.981187ms)

                                                
                                                
-- stdout --
	multinode-419000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
multinode_test.go:358: (dbg) Run:  out/minikube-darwin-amd64 -p multinode-419000 status --alsologtostderr
multinode_test.go:358: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p multinode-419000 status --alsologtostderr: exit status 7 (72.990856ms)

                                                
                                                
-- stdout --
	multinode-419000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:06:55.000767    4100 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:06:55.000937    4100 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:55.000943    4100 out.go:304] Setting ErrFile to fd 2...
	I0307 14:06:55.000947    4100 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:55.001135    4100 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:06:55.001313    4100 out.go:298] Setting JSON to false
	I0307 14:06:55.001335    4100 mustload.go:65] Loading cluster: multinode-419000
	I0307 14:06:55.001372    4100 notify.go:220] Checking for updates...
	I0307 14:06:55.002514    4100 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:06:55.002692    4100 status.go:255] checking status of multinode-419000 ...
	I0307 14:06:55.003073    4100 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:55.003120    4100 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:06:55.011184    4100 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50462
	I0307 14:06:55.011540    4100 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:06:55.011944    4100 main.go:141] libmachine: Using API Version  1
	I0307 14:06:55.011953    4100 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:06:55.012159    4100 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:06:55.012254    4100 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:06:55.012328    4100 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:06:55.012349    4100 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:06:55.012367    4100 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:06:55.012381    4100 status.go:330] multinode-419000 host status = "Stopped" (err=<nil>)
	I0307 14:06:55.012395    4100 status.go:343] host is not running, skipping remaining checks
	I0307 14:06:55.012401    4100 status.go:257] multinode-419000 status: &{Name:multinode-419000 Host:Stopped Kubelet:Stopped APIServer:Stopped Kubeconfig:Stopped Worker:false TimeToStop: DockerEnv: PodManEnv:}

                                                
                                                
** /stderr **
multinode_test.go:364: incorrect number of stopped hosts: args "out/minikube-darwin-amd64 -p multinode-419000 status --alsologtostderr": multinode-419000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
multinode_test.go:368: incorrect number of stopped kubelets: args "out/minikube-darwin-amd64 -p multinode-419000 status --alsologtostderr": multinode-419000
type: Control Plane
host: Stopped
kubelet: Stopped
apiserver: Stopped
kubeconfig: Stopped

                                                
                                                
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000: exit status 7 (72.370346ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/StopMultiNode (4.26s)

                                                
                                    
x
+
TestMultiNode/serial/RestartMultiNode (5.98s)

                                                
                                                
=== RUN   TestMultiNode/serial/RestartMultiNode
multinode_test.go:376: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-419000 --wait=true -v=8 --alsologtostderr --driver=hyperkit 
multinode_test.go:376: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-419000 --wait=true -v=8 --alsologtostderr --driver=hyperkit : exit status 60 (5.906182514s)

                                                
                                                
-- stdout --
	* [multinode-419000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "multinode-419000" primary control-plane node in "multinode-419000" cluster
	* Restarting existing hyperkit VM for "multinode-419000" ...
	* Restarting existing hyperkit VM for "multinode-419000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:06:55.145180    4106 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:06:55.145906    4106 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:55.145916    4106 out.go:304] Setting ErrFile to fd 2...
	I0307 14:06:55.145922    4106 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:06:55.146464    4106 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:06:55.147895    4106 out.go:298] Setting JSON to false
	I0307 14:06:55.169934    4106 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2186,"bootTime":1709847029,"procs":493,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:06:55.170036    4106 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:06:55.191401    4106 out.go:177] * [multinode-419000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:06:55.234220    4106 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:06:55.234262    4106 notify.go:220] Checking for updates...
	I0307 14:06:55.277057    4106 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:06:55.298099    4106 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:06:55.340251    4106 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:06:55.361330    4106 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:06:55.382915    4106 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:06:55.404744    4106 config.go:182] Loaded profile config "multinode-419000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:06:55.405251    4106 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:55.405308    4106 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:06:55.413723    4106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50468
	I0307 14:06:55.414065    4106 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:06:55.414477    4106 main.go:141] libmachine: Using API Version  1
	I0307 14:06:55.414489    4106 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:06:55.414747    4106 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:06:55.414875    4106 main.go:141] libmachine: (multinode-419000) Calling .DriverName
	I0307 14:06:55.415058    4106 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:06:55.415306    4106 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:55.415339    4106 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:06:55.422938    4106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50470
	I0307 14:06:55.423260    4106 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:06:55.423609    4106 main.go:141] libmachine: Using API Version  1
	I0307 14:06:55.423627    4106 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:06:55.423836    4106 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:06:55.423941    4106 main.go:141] libmachine: (multinode-419000) Calling .DriverName
	I0307 14:06:55.452294    4106 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 14:06:55.494180    4106 start.go:297] selected driver: hyperkit
	I0307 14:06:55.494202    4106 start.go:901] validating driver "hyperkit" against &{Name:multinode-419000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig
:{KubernetesVersion:v1.28.4 ClusterName:multinode-419000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPo
rt:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:06:55.494353    4106 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:06:55.494513    4106 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:06:55.494638    4106 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:06:55.502898    4106 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:06:55.506670    4106 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:55.506698    4106 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 14:06:55.509386    4106 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:06:55.509466    4106 cni.go:84] Creating CNI manager for ""
	I0307 14:06:55.509475    4106 cni.go:136] multinode detected (1 nodes found), recommending kindnet
	I0307 14:06:55.509557    4106 start.go:340] cluster config:
	{Name:multinode-419000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:multinode-419000 Namespace:default APIServ
erHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:true ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false Disable
Metrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:06:55.509662    4106 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:06:55.552169    4106 out.go:177] * Starting "multinode-419000" primary control-plane node in "multinode-419000" cluster
	I0307 14:06:55.573002    4106 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:06:55.573035    4106 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:06:55.573051    4106 cache.go:56] Caching tarball of preloaded images
	I0307 14:06:55.573134    4106 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:06:55.573143    4106 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:06:55.573216    4106 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/multinode-419000/config.json ...
	I0307 14:06:55.573642    4106 start.go:360] acquireMachinesLock for multinode-419000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:06:55.573686    4106 start.go:364] duration metric: took 31.642µs to acquireMachinesLock for "multinode-419000"
	I0307 14:06:55.573702    4106 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:06:55.573712    4106 fix.go:54] fixHost starting: 
	I0307 14:06:55.573921    4106 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:06:55.573942    4106 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:06:55.581763    4106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50472
	I0307 14:06:55.582100    4106 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:06:55.582466    4106 main.go:141] libmachine: Using API Version  1
	I0307 14:06:55.582479    4106 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:06:55.582689    4106 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:06:55.582830    4106 main.go:141] libmachine: (multinode-419000) Calling .DriverName
	I0307 14:06:55.582935    4106 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:06:55.583019    4106 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:06:55.583053    4106 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:06:55.583072    4106 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:06:55.583068    4106 fix.go:112] recreateIfNeeded on multinode-419000: state=Stopped err=<nil>
	I0307 14:06:55.583082    4106 main.go:141] libmachine: (multinode-419000) Calling .DriverName
	W0307 14:06:55.583165    4106 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:06:55.625054    4106 out.go:177] * Restarting existing hyperkit VM for "multinode-419000" ...
	I0307 14:06:55.646172    4106 main.go:141] libmachine: (multinode-419000) Calling .Start
	I0307 14:06:55.646483    4106 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:06:55.646590    4106 main.go:141] libmachine: (multinode-419000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.pid
	I0307 14:06:55.646629    4106 main.go:141] libmachine: (multinode-419000) DBG | Using UUID a293e975-e73b-4082-bd57-dd1c23566e3c
	I0307 14:06:55.648912    4106 main.go:141] libmachine: (multinode-419000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:06:55.648981    4106 fix.go:56] duration metric: took 75.263128ms for fixHost
	I0307 14:06:55.648994    4106 start.go:83] releasing machines lock for "multinode-419000", held for 75.298606ms
	W0307 14:06:55.649014    4106 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 14:06:55.649069    4106 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:06:55.649078    4106 start.go:728] Will try again in 5 seconds ...
	I0307 14:07:00.649692    4106 start.go:360] acquireMachinesLock for multinode-419000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:07:00.649870    4106 start.go:364] duration metric: took 141.473µs to acquireMachinesLock for "multinode-419000"
	I0307 14:07:00.649909    4106 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:07:00.649917    4106 fix.go:54] fixHost starting: 
	I0307 14:07:00.650394    4106 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:07:00.650439    4106 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:07:00.659547    4106 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50474
	I0307 14:07:00.659900    4106 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:07:00.660222    4106 main.go:141] libmachine: Using API Version  1
	I0307 14:07:00.660234    4106 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:07:00.660455    4106 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:07:00.660563    4106 main.go:141] libmachine: (multinode-419000) Calling .DriverName
	I0307 14:07:00.660657    4106 main.go:141] libmachine: (multinode-419000) Calling .GetState
	I0307 14:07:00.660730    4106 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:07:00.660784    4106 main.go:141] libmachine: (multinode-419000) DBG | hyperkit pid from json: 0
	I0307 14:07:00.660792    4106 fix.go:112] recreateIfNeeded on multinode-419000: state=Stopped err=<nil>
	I0307 14:07:00.660801    4106 main.go:141] libmachine: (multinode-419000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.json: no such file or directory
	I0307 14:07:00.660801    4106 main.go:141] libmachine: (multinode-419000) Calling .DriverName
	W0307 14:07:00.660887    4106 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:07:00.735382    4106 out.go:177] * Restarting existing hyperkit VM for "multinode-419000" ...
	I0307 14:07:00.756267    4106 main.go:141] libmachine: (multinode-419000) Calling .Start
	I0307 14:07:00.756458    4106 main.go:141] libmachine: (multinode-419000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:07:00.756474    4106 main.go:141] libmachine: (multinode-419000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/multinode-419000/hyperkit.pid
	I0307 14:07:00.756515    4106 main.go:141] libmachine: (multinode-419000) DBG | Using UUID a293e975-e73b-4082-bd57-dd1c23566e3c
	I0307 14:07:00.799341    4106 main.go:141] libmachine: (multinode-419000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:07:00.799437    4106 fix.go:56] duration metric: took 149.514795ms for fixHost
	I0307 14:07:00.799457    4106 start.go:83] releasing machines lock for "multinode-419000", held for 149.557688ms
	W0307 14:07:00.799516    4106 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p multinode-419000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-419000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:07:00.843642    4106 out.go:177] 
	W0307 14:07:00.865450    4106 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:07:00.865495    4106 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:07:00.865514    4106 out.go:239] * Related issues:
	* Related issues:
	W0307 14:07:00.865553    4106 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:07:00.865575    4106 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:07:00.908553    4106 out.go:177] 

                                                
                                                
** /stderr **
multinode_test.go:378: failed to start cluster. args "out/minikube-darwin-amd64 start -p multinode-419000 --wait=true -v=8 --alsologtostderr --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000: exit status 7 (73.644522ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/RestartMultiNode (5.98s)

                                                
                                    
x
+
TestMultiNode/serial/ValidateNameConflict (23.03s)

                                                
                                                
=== RUN   TestMultiNode/serial/ValidateNameConflict
multinode_test.go:455: (dbg) Run:  out/minikube-darwin-amd64 node list -p multinode-419000
multinode_test.go:464: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-419000-m01 --driver=hyperkit 
multinode_test.go:464: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-419000-m01 --driver=hyperkit : exit status 60 (11.303983251s)

                                                
                                                
-- stdout --
	* [multinode-419000-m01] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "multinode-419000-m01" primary control-plane node in "multinode-419000-m01" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "multinode-419000-m01" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-419000-m01" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
multinode_test.go:472: (dbg) Run:  out/minikube-darwin-amd64 start -p multinode-419000-m02 --driver=hyperkit 
multinode_test.go:472: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p multinode-419000-m02 --driver=hyperkit : exit status 60 (11.193363924s)

                                                
                                                
-- stdout --
	* [multinode-419000-m02] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "multinode-419000-m02" primary control-plane node in "multinode-419000-m02" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "multinode-419000-m02" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p multinode-419000-m02" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
multinode_test.go:474: failed to start profile. args "out/minikube-darwin-amd64 start -p multinode-419000-m02 --driver=hyperkit " : exit status 60
multinode_test.go:479: (dbg) Run:  out/minikube-darwin-amd64 node add -p multinode-419000
multinode_test.go:479: (dbg) Non-zero exit: out/minikube-darwin-amd64 node add -p multinode-419000: exit status 83 (136.562656ms)

                                                
                                                
-- stdout --
	* The control-plane node multinode-419000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p multinode-419000"

                                                
                                                
-- /stdout --
multinode_test.go:484: (dbg) Run:  out/minikube-darwin-amd64 delete -p multinode-419000-m02
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p multinode-419000 -n multinode-419000: exit status 7 (73.062001ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "multinode-419000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestMultiNode/serial/ValidateNameConflict (23.03s)

                                                
                                    
x
+
TestPreload (11.34s)

                                                
                                                
=== RUN   TestPreload
preload_test.go:44: (dbg) Run:  out/minikube-darwin-amd64 start -p test-preload-008000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4
preload_test.go:44: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p test-preload-008000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4: exit status 60 (11.002757401s)

                                                
                                                
-- stdout --
	* [test-preload-008000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "test-preload-008000" primary control-plane node in "test-preload-008000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "test-preload-008000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:07:24.481566    4183 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:07:24.481836    4183 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:07:24.481841    4183 out.go:304] Setting ErrFile to fd 2...
	I0307 14:07:24.481845    4183 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:07:24.482029    4183 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:07:24.483519    4183 out.go:298] Setting JSON to false
	I0307 14:07:24.506059    4183 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2215,"bootTime":1709847029,"procs":494,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:07:24.506146    4183 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:07:24.528577    4183 out.go:177] * [test-preload-008000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:07:24.569749    4183 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:07:24.569808    4183 notify.go:220] Checking for updates...
	I0307 14:07:24.613657    4183 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:07:24.634253    4183 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:07:24.655454    4183 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:07:24.676645    4183 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:07:24.697368    4183 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:07:24.719038    4183 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:07:24.719181    4183 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:07:24.748431    4183 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:07:24.790559    4183 start.go:297] selected driver: hyperkit
	I0307 14:07:24.790581    4183 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:07:24.790596    4183 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:07:24.794049    4183 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:07:24.794154    4183 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:07:24.801737    4183 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:07:24.805469    4183 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:07:24.805489    4183 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 14:07:24.805522    4183 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:07:24.805732    4183 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:07:24.805793    4183 cni.go:84] Creating CNI manager for ""
	I0307 14:07:24.805810    4183 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:07:24.805816    4183 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 14:07:24.805873    4183 start.go:340] cluster config:
	{Name:test-preload-008000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-008000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Co
ntainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAu
thSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:07:24.805952    4183 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:07:24.848233    4183 out.go:177] * Starting "test-preload-008000" primary control-plane node in "test-preload-008000" cluster
	I0307 14:07:24.869548    4183 preload.go:132] Checking if preload exists for k8s version v1.24.4 and runtime docker
	I0307 14:07:24.869709    4183 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/test-preload-008000/config.json ...
	I0307 14:07:24.869752    4183 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/test-preload-008000/config.json: {Name:mka72d78f0f00c958d76a12c04df3886280fa64d Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:07:24.869804    4183 cache.go:107] acquiring lock: {Name:mk1ac25b3018c901a8ea805b4b4b1d8a2bd65b42 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:07:24.869854    4183 cache.go:107] acquiring lock: {Name:mk881532395343d2233d0c1f0253ca52ed14c0c7 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:07:24.869875    4183 cache.go:107] acquiring lock: {Name:mk75184c592bafa0d1166823a916024c2650eb4c Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:07:24.869804    4183 cache.go:107] acquiring lock: {Name:mk069966db05c69227f21aa62f22a2cadb8a5c03 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:07:24.869991    4183 cache.go:107] acquiring lock: {Name:mk2feec3728003726a4f4596d39803df3bc2383d Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:07:24.869985    4183 cache.go:107] acquiring lock: {Name:mk21660f26172bb6525c75b8bf57a7b6f603629b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:07:24.870030    4183 cache.go:107] acquiring lock: {Name:mk9aa9b349674a6598bbbcec47f08dd7be74df8b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:07:24.870050    4183 cache.go:107] acquiring lock: {Name:mkb5eabb6a4b221a8abf487dcd199f524b79cae1 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:07:24.870526    4183 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.24.4
	I0307 14:07:24.870524    4183 start.go:360] acquireMachinesLock for test-preload-008000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:07:24.870540    4183 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.3-0
	I0307 14:07:24.870554    4183 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.24.4
	I0307 14:07:24.870516    4183 image.go:134] retrieving image: registry.k8s.io/pause:3.7
	I0307 14:07:24.870614    4183 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.8.6
	I0307 14:07:24.870642    4183 start.go:364] duration metric: took 90.5µs to acquireMachinesLock for "test-preload-008000"
	I0307 14:07:24.870671    4183 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.24.4
	I0307 14:07:24.870669    4183 image.go:134] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0307 14:07:24.870692    4183 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.24.4
	I0307 14:07:24.870698    4183 start.go:93] Provisioning new machine with config: &{Name:test-preload-008000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCon
fig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-008000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]
MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:07:24.870783    4183 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:07:24.892659    4183 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:07:24.892912    4183 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:07:24.893007    4183 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:07:24.902606    4183 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50514
	I0307 14:07:24.902933    4183 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:07:24.903365    4183 main.go:141] libmachine: Using API Version  1
	I0307 14:07:24.903375    4183 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:07:24.903597    4183 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:07:24.903707    4183 main.go:141] libmachine: (test-preload-008000) Calling .GetMachineName
	I0307 14:07:24.903791    4183 main.go:141] libmachine: (test-preload-008000) Calling .DriverName
	I0307 14:07:24.903880    4183 start.go:159] libmachine.API.Create for "test-preload-008000" (driver="hyperkit")
	I0307 14:07:24.903902    4183 client.go:168] LocalClient.Create starting
	I0307 14:07:24.903941    4183 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:07:24.903986    4183 main.go:141] libmachine: Decoding PEM data...
	I0307 14:07:24.904000    4183 main.go:141] libmachine: Parsing certificate...
	I0307 14:07:24.904065    4183 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:07:24.904107    4183 main.go:141] libmachine: Decoding PEM data...
	I0307 14:07:24.904118    4183 main.go:141] libmachine: Parsing certificate...
	I0307 14:07:24.904141    4183 main.go:141] libmachine: Running pre-create checks...
	I0307 14:07:24.904148    4183 main.go:141] libmachine: (test-preload-008000) Calling .PreCreateCheck
	I0307 14:07:24.904217    4183 main.go:141] libmachine: (test-preload-008000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:07:24.904377    4183 main.go:141] libmachine: (test-preload-008000) Calling .GetConfigRaw
	I0307 14:07:24.913574    4183 main.go:141] libmachine: Creating machine...
	I0307 14:07:24.913588    4183 main.go:141] libmachine: (test-preload-008000) Calling .Create
	I0307 14:07:24.913720    4183 main.go:141] libmachine: (test-preload-008000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:07:24.913918    4183 main.go:141] libmachine: (test-preload-008000) DBG | I0307 14:07:24.913721    4191 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:07:24.914004    4183 main.go:141] libmachine: (test-preload-008000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:07:24.924200    4183 image.go:177] daemon lookup for registry.k8s.io/pause:3.7: Error response from daemon: No such image: registry.k8s.io/pause:3.7
	I0307 14:07:24.924281    4183 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.24.4
	I0307 14:07:24.924396    4183 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.3-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.3-0
	I0307 14:07:24.927166    4183 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.24.4
	I0307 14:07:24.927202    4183 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.24.4
	I0307 14:07:24.927283    4183 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.8.6: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.8.6
	I0307 14:07:24.927300    4183 image.go:177] daemon lookup for gcr.io/k8s-minikube/storage-provisioner:v5: Error response from daemon: No such image: gcr.io/k8s-minikube/storage-provisioner:v5
	I0307 14:07:24.927359    4183 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.24.4: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.24.4
	I0307 14:07:25.096926    4183 main.go:141] libmachine: (test-preload-008000) DBG | I0307 14:07:25.096790    4191 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/test-preload-008000/id_rsa...
	I0307 14:07:25.139114    4183 main.go:141] libmachine: (test-preload-008000) DBG | I0307 14:07:25.139043    4191 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/test-preload-008000/test-preload-008000.rawdisk...
	I0307 14:07:25.139141    4183 main.go:141] libmachine: (test-preload-008000) DBG | Writing magic tar header
	I0307 14:07:25.139163    4183 main.go:141] libmachine: (test-preload-008000) DBG | Writing SSH key tar header
	I0307 14:07:25.139445    4183 main.go:141] libmachine: (test-preload-008000) DBG | I0307 14:07:25.139416    4191 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/test-preload-008000 ...
	I0307 14:07:25.500087    4183 main.go:141] libmachine: (test-preload-008000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:07:25.500122    4183 main.go:141] libmachine: (test-preload-008000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/test-preload-008000/hyperkit.pid
	I0307 14:07:25.500133    4183 main.go:141] libmachine: (test-preload-008000) DBG | Using UUID f836ea9f-89ea-41a4-8dd5-e480c0f60f66
	I0307 14:07:25.536450    4183 main.go:141] libmachine: (test-preload-008000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:07:25.536548    4183 client.go:171] duration metric: took 632.630073ms to LocalClient.Create
	I0307 14:07:26.842103    4183 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4
	I0307 14:07:26.987415    4183 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7
	I0307 14:07:26.988943    4183 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6
	I0307 14:07:26.992289    4183 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4
	I0307 14:07:26.993860    4183 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4
	I0307 14:07:27.002294    4183 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.3-0
	I0307 14:07:27.013517    4183 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4
	I0307 14:07:27.085129    4183 cache.go:157] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7 exists
	I0307 14:07:27.085153    4183 cache.go:96] cache image "registry.k8s.io/pause:3.7" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7" took 2.215293209s
	I0307 14:07:27.085165    4183 cache.go:80] save to tar file registry.k8s.io/pause:3.7 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/pause_3.7 succeeded
	I0307 14:07:27.536721    4183 start.go:128] duration metric: took 2.665887862s to createHost
	I0307 14:07:27.536735    4183 start.go:83] releasing machines lock for "test-preload-008000", held for 2.666049264s
	W0307 14:07:27.536754    4183 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:07:27.537040    4183 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:07:27.537063    4183 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:07:27.545135    4183 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50531
	I0307 14:07:27.545456    4183 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:07:27.545777    4183 main.go:141] libmachine: Using API Version  1
	I0307 14:07:27.545790    4183 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:07:27.545997    4183 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:07:27.546356    4183 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:07:27.546380    4183 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:07:27.554249    4183 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50533
	I0307 14:07:27.554553    4183 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:07:27.554909    4183 main.go:141] libmachine: Using API Version  1
	I0307 14:07:27.554926    4183 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:07:27.555164    4183 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:07:27.555308    4183 main.go:141] libmachine: (test-preload-008000) Calling .GetState
	I0307 14:07:27.555406    4183 main.go:141] libmachine: (test-preload-008000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:07:27.555433    4183 main.go:141] libmachine: (test-preload-008000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/test-preload-008000/hyperkit.json: no such file or directory
	I0307 14:07:27.555439    4183 main.go:141] libmachine: (test-preload-008000) DBG | hyperkit pid from json: 0
	I0307 14:07:27.555473    4183 main.go:141] libmachine: (test-preload-008000) Calling .DriverName
	I0307 14:07:27.599163    4183 out.go:177] * Deleting "test-preload-008000" in hyperkit ...
	I0307 14:07:27.621534    4183 main.go:141] libmachine: (test-preload-008000) Calling .Remove
	I0307 14:07:27.621806    4183 main.go:141] libmachine: (test-preload-008000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:07:27.621838    4183 main.go:141] libmachine: (test-preload-008000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/test-preload-008000/hyperkit.json: no such file or directory
	I0307 14:07:27.621851    4183 main.go:141] libmachine: (test-preload-008000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:07:27.621871    4183 main.go:141] libmachine: (test-preload-008000) DBG | hyperkit pid from json: 0
	W0307 14:07:27.635753    4183 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:07:27.635769    4183 start.go:728] Will try again in 5 seconds ...
	I0307 14:07:28.191672    4183 cache.go:157] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6 exists
	I0307 14:07:28.191694    4183 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.8.6" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6" took 3.321803176s
	I0307 14:07:28.191707    4183 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.8.6 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.8.6 succeeded
	I0307 14:07:28.203186    4183 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5
	I0307 14:07:30.165511    4183 cache.go:157] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4 exists
	I0307 14:07:30.165527    4183 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.24.4" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4" took 5.295670342s
	I0307 14:07:30.165535    4183 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.24.4 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.24.4 succeeded
	I0307 14:07:30.374459    4183 cache.go:157] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0307 14:07:30.374474    4183 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 5.504618209s
	I0307 14:07:30.374481    4183 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0307 14:07:32.635941    4183 start.go:360] acquireMachinesLock for test-preload-008000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:07:32.636033    4183 start.go:364] duration metric: took 70.683µs to acquireMachinesLock for "test-preload-008000"
	I0307 14:07:32.636049    4183 start.go:93] Provisioning new machine with config: &{Name:test-preload-008000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesCon
fig:{KubernetesVersion:v1.24.4 ClusterName:test-preload-008000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[]
MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.24.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:07:32.636114    4183 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:07:32.659522    4183 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:07:32.659590    4183 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 14:07:32.659620    4183 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:07:32.668164    4183 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50536
	I0307 14:07:32.668523    4183 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:07:32.668879    4183 main.go:141] libmachine: Using API Version  1
	I0307 14:07:32.668889    4183 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:07:32.669085    4183 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:07:32.669189    4183 main.go:141] libmachine: (test-preload-008000) Calling .GetMachineName
	I0307 14:07:32.669268    4183 main.go:141] libmachine: (test-preload-008000) Calling .DriverName
	I0307 14:07:32.669361    4183 start.go:159] libmachine.API.Create for "test-preload-008000" (driver="hyperkit")
	I0307 14:07:32.669374    4183 client.go:168] LocalClient.Create starting
	I0307 14:07:32.669408    4183 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:07:32.669453    4183 main.go:141] libmachine: Decoding PEM data...
	I0307 14:07:32.669462    4183 main.go:141] libmachine: Parsing certificate...
	I0307 14:07:32.669512    4183 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:07:32.669551    4183 main.go:141] libmachine: Decoding PEM data...
	I0307 14:07:32.669565    4183 main.go:141] libmachine: Parsing certificate...
	I0307 14:07:32.669577    4183 main.go:141] libmachine: Running pre-create checks...
	I0307 14:07:32.669583    4183 main.go:141] libmachine: (test-preload-008000) Calling .PreCreateCheck
	I0307 14:07:32.669654    4183 main.go:141] libmachine: (test-preload-008000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:07:32.669695    4183 main.go:141] libmachine: (test-preload-008000) Calling .GetConfigRaw
	I0307 14:07:32.670123    4183 main.go:141] libmachine: Creating machine...
	I0307 14:07:32.670130    4183 main.go:141] libmachine: (test-preload-008000) Calling .Create
	I0307 14:07:32.670200    4183 main.go:141] libmachine: (test-preload-008000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:07:32.670327    4183 main.go:141] libmachine: (test-preload-008000) DBG | I0307 14:07:32.670195    4229 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:07:32.670365    4183 main.go:141] libmachine: (test-preload-008000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:07:32.844805    4183 main.go:141] libmachine: (test-preload-008000) DBG | I0307 14:07:32.844697    4229 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/test-preload-008000/id_rsa...
	I0307 14:07:32.845552    4183 cache.go:157] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4 exists
	I0307 14:07:32.845566    4183 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.24.4" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4" took 7.975499054s
	I0307 14:07:32.845574    4183 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.24.4 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.24.4 succeeded
	I0307 14:07:32.883017    4183 main.go:141] libmachine: (test-preload-008000) DBG | I0307 14:07:32.882972    4229 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/test-preload-008000/test-preload-008000.rawdisk...
	I0307 14:07:32.883032    4183 main.go:141] libmachine: (test-preload-008000) DBG | Writing magic tar header
	I0307 14:07:32.883042    4183 main.go:141] libmachine: (test-preload-008000) DBG | Writing SSH key tar header
	I0307 14:07:32.883509    4183 main.go:141] libmachine: (test-preload-008000) DBG | I0307 14:07:32.883477    4229 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/test-preload-008000 ...
	I0307 14:07:32.905426    4183 cache.go:157] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4 exists
	I0307 14:07:32.905442    4183 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.24.4" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4" took 8.035440073s
	I0307 14:07:32.905451    4183 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.24.4 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.24.4 succeeded
	I0307 14:07:33.238956    4183 main.go:141] libmachine: (test-preload-008000) DBG | exe=/Users/jenkins/workspace/out/docker-machine-driver-hyperkit uid=0
	I0307 14:07:33.238987    4183 main.go:141] libmachine: (test-preload-008000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/test-preload-008000/hyperkit.pid
	I0307 14:07:33.239016    4183 main.go:141] libmachine: (test-preload-008000) DBG | Using UUID cfff6cd1-b886-4c32-a673-cd1a353e9e31
	I0307 14:07:33.273621    4183 main.go:141] libmachine: (test-preload-008000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:07:33.273706    4183 client.go:171] duration metric: took 604.318324ms to LocalClient.Create
	I0307 14:07:33.742843    4183 cache.go:157] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4 exists
	I0307 14:07:33.742860    4183 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.24.4" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4" took 8.872804485s
	I0307 14:07:33.742877    4183 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.24.4 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.24.4 succeeded
	I0307 14:07:35.273869    4183 start.go:128] duration metric: took 2.637719692s to createHost
	I0307 14:07:35.273900    4183 start.go:83] releasing machines lock for "test-preload-008000", held for 2.637818744s
	W0307 14:07:35.273985    4183 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p test-preload-008000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p test-preload-008000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:07:35.296399    4183 out.go:177] 
	W0307 14:07:35.317229    4183 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:07:35.317261    4183 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:07:35.317268    4183 out.go:239] * Related issues:
	* Related issues:
	W0307 14:07:35.317282    4183 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:07:35.317309    4183 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:07:35.339375    4183 out.go:177] 

                                                
                                                
** /stderr **
preload_test.go:46: out/minikube-darwin-amd64 start -p test-preload-008000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.24.4 failed: exit status 60
panic.go:626: *** TestPreload FAILED at 2024-03-07 14:07:35.425621 -0800 PST m=+1258.466134652
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p test-preload-008000 -n test-preload-008000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p test-preload-008000 -n test-preload-008000: exit status 7 (72.439206ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "test-preload-008000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "test-preload-008000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p test-preload-008000
--- FAIL: TestPreload (11.34s)

                                                
                                    
x
+
TestScheduledStopUnix (11.53s)

                                                
                                                
=== RUN   TestScheduledStopUnix
scheduled_stop_test.go:128: (dbg) Run:  out/minikube-darwin-amd64 start -p scheduled-stop-260000 --memory=2048 --driver=hyperkit 
scheduled_stop_test.go:128: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p scheduled-stop-260000 --memory=2048 --driver=hyperkit : exit status 60 (11.197634743s)

                                                
                                                
-- stdout --
	* [scheduled-stop-260000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "scheduled-stop-260000" primary control-plane node in "scheduled-stop-260000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "scheduled-stop-260000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p scheduled-stop-260000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
scheduled_stop_test.go:130: starting minikube: exit status 60

                                                
                                                
-- stdout --
	* [scheduled-stop-260000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "scheduled-stop-260000" primary control-plane node in "scheduled-stop-260000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "scheduled-stop-260000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p scheduled-stop-260000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
panic.go:626: *** TestScheduledStopUnix FAILED at 2024-03-07 14:07:46.956394 -0800 PST m=+1269.996804242
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p scheduled-stop-260000 -n scheduled-stop-260000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p scheduled-stop-260000 -n scheduled-stop-260000: exit status 7 (74.35904ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "scheduled-stop-260000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "scheduled-stop-260000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p scheduled-stop-260000
--- FAIL: TestScheduledStopUnix (11.53s)

                                                
                                    
x
+
TestSkaffold (18.47s)

                                                
                                                
=== RUN   TestSkaffold
skaffold_test.go:59: (dbg) Run:  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/skaffold.exe423074046 version
skaffold_test.go:63: skaffold version: v2.10.0
skaffold_test.go:66: (dbg) Run:  out/minikube-darwin-amd64 start -p skaffold-601000 --memory=2600 --driver=hyperkit 
skaffold_test.go:66: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p skaffold-601000 --memory=2600 --driver=hyperkit : exit status 60 (11.42894543s)

                                                
                                                
-- stdout --
	* [skaffold-601000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "skaffold-601000" primary control-plane node in "skaffold-601000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	* Deleting "skaffold-601000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p skaffold-601000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
skaffold_test.go:68: starting minikube: exit status 60

                                                
                                                
-- stdout --
	* [skaffold-601000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "skaffold-601000" primary control-plane node in "skaffold-601000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	* Deleting "skaffold-601000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2600MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p skaffold-601000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
panic.go:626: *** TestSkaffold FAILED at 2024-03-07 14:08:05.422561 -0800 PST m=+1288.462827469
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p skaffold-601000 -n skaffold-601000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p skaffold-601000 -n skaffold-601000: exit status 7 (72.631366ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "skaffold-601000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "skaffold-601000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p skaffold-601000
--- FAIL: TestSkaffold (18.47s)

                                                
                                    
x
+
TestRunningBinaryUpgrade (67.72s)

                                                
                                                
=== RUN   TestRunningBinaryUpgrade
=== PAUSE TestRunningBinaryUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestRunningBinaryUpgrade
version_upgrade_test.go:120: (dbg) Run:  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.26.0.2184181478 start -p running-upgrade-390000 --memory=2200 --vm-driver=hyperkit 
E0307 14:09:45.420905    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
version_upgrade_test.go:120: (dbg) Non-zero exit: /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.26.0.2184181478 start -p running-upgrade-390000 --memory=2200 --vm-driver=hyperkit : exit status 60 (48.685871917s)

                                                
                                                
-- stdout --
	* [running-upgrade-390000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/legacy_kubeconfig2370310331
	* Using the hyperkit driver based on user configuration
	* Downloading VM boot image ...
	* minikube 1.32.0 is available! Download it: https://github.com/kubernetes/minikube/releases/tag/v1.32.0
	* To disable this notice, run: 'minikube config set WantUpdateNotification false'
	
	* Starting control plane node running-upgrade-390000 in cluster running-upgrade-390000
	* Downloading Kubernetes v1.24.1 preload ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "running-upgrade-390000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p running-upgrade-390000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:120: (dbg) Run:  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.26.0.2184181478 start -p running-upgrade-390000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:120: (dbg) Non-zero exit: /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.26.0.2184181478 start -p running-upgrade-390000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.746415722s)

                                                
                                                
-- stdout --
	* [running-upgrade-390000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/legacy_kubeconfig3840712495
	* Using the hyperkit driver based on existing profile
	* Starting control plane node running-upgrade-390000 in cluster running-upgrade-390000
	* Restarting existing hyperkit VM for "running-upgrade-390000" ...
	* Restarting existing hyperkit VM for "running-upgrade-390000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p running-upgrade-390000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:120: (dbg) Run:  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.26.0.2184181478 start -p running-upgrade-390000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:120: (dbg) Non-zero exit: /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.26.0.2184181478 start -p running-upgrade-390000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.845619942s)

                                                
                                                
-- stdout --
	* [running-upgrade-390000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/legacy_kubeconfig807724371
	* Using the hyperkit driver based on existing profile
	* Starting control plane node running-upgrade-390000 in cluster running-upgrade-390000
	* Restarting existing hyperkit VM for "running-upgrade-390000" ...
	* Restarting existing hyperkit VM for "running-upgrade-390000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p running-upgrade-390000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:126: legacy v1.26.0 start failed: exit status 60
panic.go:626: *** TestRunningBinaryUpgrade FAILED at 2024-03-07 14:10:15.118343 -0800 PST m=+1418.157701728
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p running-upgrade-390000 -n running-upgrade-390000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p running-upgrade-390000 -n running-upgrade-390000: exit status 7 (73.717438ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "running-upgrade-390000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "running-upgrade-390000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p running-upgrade-390000
--- FAIL: TestRunningBinaryUpgrade (67.72s)

                                                
                                    
x
+
TestKubernetesUpgrade (21.28s)

                                                
                                                
=== RUN   TestKubernetesUpgrade
=== PAUSE TestKubernetesUpgrade

                                                
                                                

                                                
                                                
=== CONT  TestKubernetesUpgrade
version_upgrade_test.go:222: (dbg) Run:  out/minikube-darwin-amd64 start -p kubernetes-upgrade-094000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=hyperkit 
version_upgrade_test.go:222: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubernetes-upgrade-094000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=hyperkit : exit status 60 (11.048940354s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-094000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "kubernetes-upgrade-094000" primary control-plane node in "kubernetes-upgrade-094000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "kubernetes-upgrade-094000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:10:15.511773    4691 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:10:15.512038    4691 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:10:15.512044    4691 out.go:304] Setting ErrFile to fd 2...
	I0307 14:10:15.512047    4691 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:10:15.512719    4691 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:10:15.514504    4691 out.go:298] Setting JSON to false
	I0307 14:10:15.536947    4691 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2386,"bootTime":1709847029,"procs":494,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:10:15.537044    4691 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:10:15.560091    4691 out.go:177] * [kubernetes-upgrade-094000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:10:15.602600    4691 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:10:15.602615    4691 notify.go:220] Checking for updates...
	I0307 14:10:15.625063    4691 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:10:15.667691    4691 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:10:15.688561    4691 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:10:15.709442    4691 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:10:15.732767    4691 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:10:15.755204    4691 config.go:182] Loaded profile config "cert-expiration-897000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:10:15.755317    4691 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:10:15.755415    4691 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:10:15.784519    4691 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:10:15.826422    4691 start.go:297] selected driver: hyperkit
	I0307 14:10:15.826452    4691 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:10:15.826463    4691 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:10:15.829341    4691 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:10:15.829439    4691 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:10:15.837149    4691 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:10:15.840933    4691 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:10:15.840953    4691 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:10:15.840982    4691 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:10:15.841192    4691 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0307 14:10:15.841245    4691 cni.go:84] Creating CNI manager for ""
	I0307 14:10:15.841261    4691 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0307 14:10:15.841326    4691 start.go:340] cluster config:
	{Name:kubernetes-upgrade-094000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:10:15.841416    4691 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:10:15.862397    4691 out.go:177] * Starting "kubernetes-upgrade-094000" primary control-plane node in "kubernetes-upgrade-094000" cluster
	I0307 14:10:15.883401    4691 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0307 14:10:15.883457    4691 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0307 14:10:15.883480    4691 cache.go:56] Caching tarball of preloaded images
	I0307 14:10:15.883621    4691 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:10:15.883635    4691 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0307 14:10:15.883729    4691 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/kubernetes-upgrade-094000/config.json ...
	I0307 14:10:15.883754    4691 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/kubernetes-upgrade-094000/config.json: {Name:mk7cb488357510a1d31c20aa7a06b8a9d5ce4ec4 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:10:15.884243    4691 start.go:360] acquireMachinesLock for kubernetes-upgrade-094000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:10:15.884334    4691 start.go:364] duration metric: took 66.084µs to acquireMachinesLock for "kubernetes-upgrade-094000"
	I0307 14:10:15.884364    4691 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt
imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:10:15.884412    4691 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:10:15.905592    4691 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:10:15.905857    4691 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:10:15.905928    4691 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:10:15.915131    4691 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50773
	I0307 14:10:15.915509    4691 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:10:15.915959    4691 main.go:141] libmachine: Using API Version  1
	I0307 14:10:15.915969    4691 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:10:15.916198    4691 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:10:15.916292    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .GetMachineName
	I0307 14:10:15.916390    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .DriverName
	I0307 14:10:15.916502    4691 start.go:159] libmachine.API.Create for "kubernetes-upgrade-094000" (driver="hyperkit")
	I0307 14:10:15.916532    4691 client.go:168] LocalClient.Create starting
	I0307 14:10:15.916563    4691 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:10:15.916609    4691 main.go:141] libmachine: Decoding PEM data...
	I0307 14:10:15.916625    4691 main.go:141] libmachine: Parsing certificate...
	I0307 14:10:15.916704    4691 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:10:15.916741    4691 main.go:141] libmachine: Decoding PEM data...
	I0307 14:10:15.916749    4691 main.go:141] libmachine: Parsing certificate...
	I0307 14:10:15.916765    4691 main.go:141] libmachine: Running pre-create checks...
	I0307 14:10:15.916777    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .PreCreateCheck
	I0307 14:10:15.916867    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:10:15.917057    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .GetConfigRaw
	I0307 14:10:15.917575    4691 main.go:141] libmachine: Creating machine...
	I0307 14:10:15.917583    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .Create
	I0307 14:10:15.917666    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:10:15.917781    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | I0307 14:10:15.917656    4699 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:10:15.917864    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:10:16.091286    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | I0307 14:10:16.091220    4699 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubernetes-upgrade-094000/id_rsa...
	I0307 14:10:16.190900    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | I0307 14:10:16.190824    4699 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubernetes-upgrade-094000/kubernetes-upgrade-094000.rawdisk...
	I0307 14:10:16.190913    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | Writing magic tar header
	I0307 14:10:16.190922    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | Writing SSH key tar header
	I0307 14:10:16.191659    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | I0307 14:10:16.191568    4699 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubernetes-upgrade-094000 ...
	I0307 14:10:16.550264    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:10:16.550284    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubernetes-upgrade-094000/hyperkit.pid
	I0307 14:10:16.550381    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | Using UUID 636d415c-e305-418b-99bb-c1b528dbaf51
	I0307 14:10:16.586325    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:10:16.586399    4691 client.go:171] duration metric: took 669.853602ms to LocalClient.Create
	I0307 14:10:18.586751    4691 start.go:128] duration metric: took 2.702306812s to createHost
	I0307 14:10:18.586773    4691 start.go:83] releasing machines lock for "kubernetes-upgrade-094000", held for 2.702412057s
	W0307 14:10:18.586798    4691 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:10:18.587247    4691 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:10:18.587285    4691 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:10:18.596318    4691 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50775
	I0307 14:10:18.596650    4691 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:10:18.597017    4691 main.go:141] libmachine: Using API Version  1
	I0307 14:10:18.597029    4691 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:10:18.597248    4691 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:10:18.597611    4691 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:10:18.597638    4691 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:10:18.605486    4691 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50777
	I0307 14:10:18.605801    4691 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:10:18.606154    4691 main.go:141] libmachine: Using API Version  1
	I0307 14:10:18.606173    4691 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:10:18.606355    4691 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:10:18.606450    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .GetState
	I0307 14:10:18.606541    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:10:18.606582    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubernetes-upgrade-094000/hyperkit.json: no such file or directory
	I0307 14:10:18.606594    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | hyperkit pid from json: 0
	I0307 14:10:18.606680    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .DriverName
	I0307 14:10:18.649358    4691 out.go:177] * Deleting "kubernetes-upgrade-094000" in hyperkit ...
	I0307 14:10:18.672390    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .Remove
	I0307 14:10:18.672698    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:10:18.672725    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:10:18.672773    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubernetes-upgrade-094000/hyperkit.json: no such file or directory
	I0307 14:10:18.672794    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | hyperkit pid from json: 0
	W0307 14:10:18.688233    4691 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:10:18.688247    4691 start.go:728] Will try again in 5 seconds ...
	I0307 14:10:23.690216    4691 start.go:360] acquireMachinesLock for kubernetes-upgrade-094000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:10:23.690353    4691 start.go:364] duration metric: took 109.25µs to acquireMachinesLock for "kubernetes-upgrade-094000"
	I0307 14:10:23.690381    4691 start.go:93] Provisioning new machine with config: &{Name:kubernetes-upgrade-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt
imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:10:23.690514    4691 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:10:23.714078    4691 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:10:23.714286    4691 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:10:23.714350    4691 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:10:23.723085    4691 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50779
	I0307 14:10:23.723431    4691 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:10:23.723799    4691 main.go:141] libmachine: Using API Version  1
	I0307 14:10:23.723813    4691 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:10:23.724034    4691 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:10:23.724128    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .GetMachineName
	I0307 14:10:23.724224    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .DriverName
	I0307 14:10:23.724335    4691 start.go:159] libmachine.API.Create for "kubernetes-upgrade-094000" (driver="hyperkit")
	I0307 14:10:23.724350    4691 client.go:168] LocalClient.Create starting
	I0307 14:10:23.724374    4691 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:10:23.724420    4691 main.go:141] libmachine: Decoding PEM data...
	I0307 14:10:23.724433    4691 main.go:141] libmachine: Parsing certificate...
	I0307 14:10:23.724471    4691 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:10:23.724506    4691 main.go:141] libmachine: Decoding PEM data...
	I0307 14:10:23.724519    4691 main.go:141] libmachine: Parsing certificate...
	I0307 14:10:23.724531    4691 main.go:141] libmachine: Running pre-create checks...
	I0307 14:10:23.724536    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .PreCreateCheck
	I0307 14:10:23.724616    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:10:23.724643    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .GetConfigRaw
	I0307 14:10:23.725103    4691 main.go:141] libmachine: Creating machine...
	I0307 14:10:23.725112    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .Create
	I0307 14:10:23.725183    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:10:23.725297    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | I0307 14:10:23.725173    4706 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:10:23.725343    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:10:23.898009    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | I0307 14:10:23.897950    4706 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubernetes-upgrade-094000/id_rsa...
	I0307 14:10:23.953329    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | I0307 14:10:23.953279    4706 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubernetes-upgrade-094000/kubernetes-upgrade-094000.rawdisk...
	I0307 14:10:23.953343    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | Writing magic tar header
	I0307 14:10:23.953384    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | Writing SSH key tar header
	I0307 14:10:23.954095    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | I0307 14:10:23.954004    4706 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubernetes-upgrade-094000 ...
	I0307 14:10:24.313338    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:10:24.313361    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubernetes-upgrade-094000/hyperkit.pid
	I0307 14:10:24.313372    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | Using UUID fedfe125-f8d6-4203-a1c1-63b12fe2404a
	I0307 14:10:24.348831    4691 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:10:24.348916    4691 client.go:171] duration metric: took 624.555431ms to LocalClient.Create
	I0307 14:10:26.349211    4691 start.go:128] duration metric: took 2.658666374s to createHost
	I0307 14:10:26.349234    4691 start.go:83] releasing machines lock for "kubernetes-upgrade-094000", held for 2.658851277s
	W0307 14:10:26.349324    4691 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-094000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:10:26.371057    4691 out.go:177] 
	W0307 14:10:26.393050    4691 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:10:26.393152    4691 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:10:26.393182    4691 out.go:239] * Related issues:
	* Related issues:
	W0307 14:10:26.393277    4691 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:10:26.393308    4691 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:10:26.438754    4691 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:224: failed to start minikube HEAD with oldest k8s version: out/minikube-darwin-amd64 start -p kubernetes-upgrade-094000 --memory=2200 --kubernetes-version=v1.20.0 --alsologtostderr -v=1 --driver=hyperkit : exit status 60
version_upgrade_test.go:227: (dbg) Run:  out/minikube-darwin-amd64 stop -p kubernetes-upgrade-094000
version_upgrade_test.go:227: (dbg) Done: out/minikube-darwin-amd64 stop -p kubernetes-upgrade-094000: (3.874940677s)
version_upgrade_test.go:232: (dbg) Run:  out/minikube-darwin-amd64 -p kubernetes-upgrade-094000 status --format={{.Host}}
version_upgrade_test.go:232: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p kubernetes-upgrade-094000 status --format={{.Host}}: exit status 7 (73.89219ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
version_upgrade_test.go:234: status error: exit status 7 (may be ok)
version_upgrade_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 start -p kubernetes-upgrade-094000 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=hyperkit 
version_upgrade_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubernetes-upgrade-094000 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=hyperkit : exit status 60 (5.903791926s)

                                                
                                                
-- stdout --
	* [kubernetes-upgrade-094000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "kubernetes-upgrade-094000" primary control-plane node in "kubernetes-upgrade-094000" cluster
	* Restarting existing hyperkit VM for "kubernetes-upgrade-094000" ...
	* Restarting existing hyperkit VM for "kubernetes-upgrade-094000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:10:30.512187    4732 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:10:30.512352    4732 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:10:30.512357    4732 out.go:304] Setting ErrFile to fd 2...
	I0307 14:10:30.512361    4732 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:10:30.512534    4732 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:10:30.513862    4732 out.go:298] Setting JSON to false
	I0307 14:10:30.536071    4732 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2401,"bootTime":1709847029,"procs":491,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:10:30.536191    4732 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:10:30.558195    4732 out.go:177] * [kubernetes-upgrade-094000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:10:30.600380    4732 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:10:30.600482    4732 notify.go:220] Checking for updates...
	I0307 14:10:30.621971    4732 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:10:30.643374    4732 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:10:30.689110    4732 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:10:30.748317    4732 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:10:30.822895    4732 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:10:30.845646    4732 config.go:182] Loaded profile config "kubernetes-upgrade-094000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0307 14:10:30.846167    4732 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:10:30.846222    4732 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:10:30.854787    4732 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50796
	I0307 14:10:30.855197    4732 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:10:30.855601    4732 main.go:141] libmachine: Using API Version  1
	I0307 14:10:30.855609    4732 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:10:30.855817    4732 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:10:30.855925    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .DriverName
	I0307 14:10:30.856120    4732 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:10:30.856364    4732 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:10:30.856392    4732 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:10:30.863961    4732 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50798
	I0307 14:10:30.864304    4732 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:10:30.864657    4732 main.go:141] libmachine: Using API Version  1
	I0307 14:10:30.864676    4732 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:10:30.864871    4732 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:10:30.864964    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .DriverName
	I0307 14:10:30.892945    4732 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 14:10:30.935960    4732 start.go:297] selected driver: hyperkit
	I0307 14:10:30.935975    4732 start.go:901] validating driver "hyperkit" against &{Name:kubernetes-upgrade-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.20.0 ClusterName:kubernetes-upgrade-094000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOpt
imizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:10:30.936057    4732 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:10:30.939015    4732 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:10:30.939111    4732 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:10:30.946939    4732 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:10:30.950763    4732 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:10:30.950798    4732 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:10:30.950992    4732 cni.go:84] Creating CNI manager for ""
	I0307 14:10:30.951009    4732 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:10:30.951049    4732 start.go:340] cluster config:
	{Name:kubernetes-upgrade-094000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:kubernetes-upgrade-094000 Na
mespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMne
tClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:10:30.951161    4732 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:10:30.993073    4732 out.go:177] * Starting "kubernetes-upgrade-094000" primary control-plane node in "kubernetes-upgrade-094000" cluster
	I0307 14:10:31.013952    4732 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 14:10:31.014024    4732 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0307 14:10:31.014055    4732 cache.go:56] Caching tarball of preloaded images
	I0307 14:10:31.014273    4732 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:10:31.014294    4732 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0307 14:10:31.014421    4732 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/kubernetes-upgrade-094000/config.json ...
	I0307 14:10:31.015277    4732 start.go:360] acquireMachinesLock for kubernetes-upgrade-094000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:10:31.015371    4732 start.go:364] duration metric: took 67.996µs to acquireMachinesLock for "kubernetes-upgrade-094000"
	I0307 14:10:31.015403    4732 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:10:31.015420    4732 fix.go:54] fixHost starting: 
	I0307 14:10:31.015788    4732 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:10:31.015817    4732 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:10:31.024195    4732 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50800
	I0307 14:10:31.024547    4732 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:10:31.024928    4732 main.go:141] libmachine: Using API Version  1
	I0307 14:10:31.024944    4732 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:10:31.025158    4732 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:10:31.025287    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .DriverName
	I0307 14:10:31.025383    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .GetState
	I0307 14:10:31.025470    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:10:31.025501    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubernetes-upgrade-094000/hyperkit.json: no such file or directory
	I0307 14:10:31.025520    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | hyperkit pid from json: 0
	I0307 14:10:31.025524    4732 fix.go:112] recreateIfNeeded on kubernetes-upgrade-094000: state=Stopped err=<nil>
	I0307 14:10:31.025544    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .DriverName
	W0307 14:10:31.025631    4732 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:10:31.067868    4732 out.go:177] * Restarting existing hyperkit VM for "kubernetes-upgrade-094000" ...
	I0307 14:10:31.089056    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .Start
	I0307 14:10:31.089319    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:10:31.089373    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubernetes-upgrade-094000/hyperkit.pid
	I0307 14:10:31.089463    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | Using UUID fedfe125-f8d6-4203-a1c1-63b12fe2404a
	I0307 14:10:31.091344    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:10:31.091463    4732 fix.go:56] duration metric: took 76.045115ms for fixHost
	I0307 14:10:31.091477    4732 start.go:83] releasing machines lock for "kubernetes-upgrade-094000", held for 76.095381ms
	W0307 14:10:31.091496    4732 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 14:10:31.091555    4732 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:10:31.091564    4732 start.go:728] Will try again in 5 seconds ...
	I0307 14:10:36.091736    4732 start.go:360] acquireMachinesLock for kubernetes-upgrade-094000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:10:36.091854    4732 start.go:364] duration metric: took 96.431µs to acquireMachinesLock for "kubernetes-upgrade-094000"
	I0307 14:10:36.091875    4732 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:10:36.091881    4732 fix.go:54] fixHost starting: 
	I0307 14:10:36.092124    4732 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:10:36.092144    4732 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:10:36.100409    4732 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50802
	I0307 14:10:36.100769    4732 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:10:36.101158    4732 main.go:141] libmachine: Using API Version  1
	I0307 14:10:36.101173    4732 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:10:36.101408    4732 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:10:36.101530    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .DriverName
	I0307 14:10:36.101610    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .GetState
	I0307 14:10:36.101685    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:10:36.101712    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | hyperkit pid from json: 0
	I0307 14:10:36.101724    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubernetes-upgrade-094000/hyperkit.json: no such file or directory
	I0307 14:10:36.101751    4732 fix.go:112] recreateIfNeeded on kubernetes-upgrade-094000: state=Stopped err=<nil>
	I0307 14:10:36.101759    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .DriverName
	W0307 14:10:36.101842    4732 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:10:36.123337    4732 out.go:177] * Restarting existing hyperkit VM for "kubernetes-upgrade-094000" ...
	I0307 14:10:36.144289    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) Calling .Start
	I0307 14:10:36.144555    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:10:36.144595    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubernetes-upgrade-094000/hyperkit.pid
	I0307 14:10:36.144728    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | Using UUID fedfe125-f8d6-4203-a1c1-63b12fe2404a
	I0307 14:10:36.183644    4732 main.go:141] libmachine: (kubernetes-upgrade-094000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:10:36.183746    4732 fix.go:56] duration metric: took 91.862633ms for fixHost
	I0307 14:10:36.183755    4732 start.go:83] releasing machines lock for "kubernetes-upgrade-094000", held for 91.893012ms
	W0307 14:10:36.183812    4732 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-094000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubernetes-upgrade-094000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:10:36.227207    4732 out.go:177] 
	W0307 14:10:36.250423    4732 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:10:36.250499    4732 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:10:36.250517    4732 out.go:239] * Related issues:
	* Related issues:
	W0307 14:10:36.250539    4732 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:10:36.250565    4732 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:10:36.293064    4732 out.go:177] 

                                                
                                                
** /stderr **
version_upgrade_test.go:245: failed to upgrade with newest k8s version. args: out/minikube-darwin-amd64 start -p kubernetes-upgrade-094000 --memory=2200 --kubernetes-version=v1.29.0-rc.2 --alsologtostderr -v=1 --driver=hyperkit  : exit status 60
version_upgrade_test.go:248: (dbg) Run:  kubectl --context kubernetes-upgrade-094000 version --output=json
version_upgrade_test.go:248: (dbg) Non-zero exit: kubectl --context kubernetes-upgrade-094000 version --output=json: exit status 1 (37.132512ms)

                                                
                                                
** stderr ** 
	error: context "kubernetes-upgrade-094000" does not exist

                                                
                                                
** /stderr **
version_upgrade_test.go:250: error running kubectl: exit status 1
panic.go:626: *** TestKubernetesUpgrade FAILED at 2024-03-07 14:10:36.394336 -0800 PST m=+1439.433547198
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p kubernetes-upgrade-094000 -n kubernetes-upgrade-094000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p kubernetes-upgrade-094000 -n kubernetes-upgrade-094000: exit status 7 (73.502928ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "kubernetes-upgrade-094000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:175: Cleaning up "kubernetes-upgrade-094000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p kubernetes-upgrade-094000
--- FAIL: TestKubernetesUpgrade (21.28s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Upgrade (25.51s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Upgrade
version_upgrade_test.go:183: (dbg) Run:  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.26.0.3674305739 start -p stopped-upgrade-253000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:183: (dbg) Non-zero exit: /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.26.0.3674305739 start -p stopped-upgrade-253000 --memory=2200 --vm-driver=hyperkit : exit status 60 (11.523405874s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-253000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/legacy_kubeconfig1651410759
	* Using the hyperkit driver based on user configuration
	* Starting control plane node stopped-upgrade-253000 in cluster stopped-upgrade-253000
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "stopped-upgrade-253000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-253000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:183: (dbg) Run:  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.26.0.3674305739 start -p stopped-upgrade-253000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:183: (dbg) Non-zero exit: /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.26.0.3674305739 start -p stopped-upgrade-253000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.850600641s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-253000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/legacy_kubeconfig2963130720
	* Using the hyperkit driver based on existing profile
	* Starting control plane node stopped-upgrade-253000 in cluster stopped-upgrade-253000
	* Restarting existing hyperkit VM for "stopped-upgrade-253000" ...
	* Restarting existing hyperkit VM for "stopped-upgrade-253000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-253000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:183: (dbg) Run:  /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.26.0.3674305739 start -p stopped-upgrade-253000 --memory=2200 --vm-driver=hyperkit 
version_upgrade_test.go:183: (dbg) Non-zero exit: /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/minikube-v1.26.0.3674305739 start -p stopped-upgrade-253000 --memory=2200 --vm-driver=hyperkit : exit status 60 (5.848431402s)

                                                
                                                
-- stdout --
	* [stopped-upgrade-253000] minikube v1.26.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	  - KUBECONFIG=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/legacy_kubeconfig4242125000
	* Using the hyperkit driver based on existing profile
	* Starting control plane node stopped-upgrade-253000 in cluster stopped-upgrade-253000
	* Restarting existing hyperkit VM for "stopped-upgrade-253000" ...
	* Restarting existing hyperkit VM for "stopped-upgrade-253000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-253000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
version_upgrade_test.go:189: legacy v1.26.0 start failed: exit status 60
--- FAIL: TestStoppedBinaryUpgrade/Upgrade (25.51s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/MinikubeLogs (0.32s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/MinikubeLogs
version_upgrade_test.go:206: (dbg) Run:  out/minikube-darwin-amd64 logs -p stopped-upgrade-253000
version_upgrade_test.go:206: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p stopped-upgrade-253000: exit status 83 (318.984331ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| Command |                         Args                         |          Profile          |  User   | Version |     Start Time      |      End Time       |
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	| ssh     | -p cilium-903000 sudo cat                            | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | /etc/hosts                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo cat                            | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | /etc/resolv.conf                                     |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo crictl                         | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | pods                                                 |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo crictl                         | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | ps --all                                             |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo find                           | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | /etc/cni -type f -exec sh -c                         |                           |         |         |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo ip a s                         | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	| ssh     | -p cilium-903000 sudo ip r s                         | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	| ssh     | -p cilium-903000 sudo                                | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | iptables-save                                        |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo iptables                       | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | -t nat -L -n -v                                      |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo                                | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | systemctl status kubelet --all                       |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo                                | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | systemctl cat kubelet                                |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo                                | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | journalctl -xeu kubelet --all                        |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo cat                            | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | /etc/kubernetes/kubelet.conf                         |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo cat                            | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | /var/lib/kubelet/config.yaml                         |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo                                | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | systemctl status docker --all                        |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo                                | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | systemctl cat docker                                 |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo cat                            | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | /etc/docker/daemon.json                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo docker                         | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | system info                                          |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo                                | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | systemctl status cri-docker                          |                           |         |         |                     |                     |
	|         | --all --full --no-pager                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo                                | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | systemctl cat cri-docker                             |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo cat                            | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | /etc/systemd/system/cri-docker.service.d/10-cni.conf |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo cat                            | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | /usr/lib/systemd/system/cri-docker.service           |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo                                | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | cri-dockerd --version                                |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo                                | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | systemctl status containerd                          |                           |         |         |                     |                     |
	|         | --all --full --no-pager                              |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo                                | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | systemctl cat containerd                             |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo cat                            | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | /lib/systemd/system/containerd.service               |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo cat                            | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | /etc/containerd/config.toml                          |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo                                | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | containerd config dump                               |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo                                | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | systemctl status crio --all                          |                           |         |         |                     |                     |
	|         | --full --no-pager                                    |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo                                | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | systemctl cat crio --no-pager                        |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo find                           | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | /etc/crio -type f -exec sh -c                        |                           |         |         |                     |                     |
	|         | 'echo {}; cat {}' \;                                 |                           |         |         |                     |                     |
	| ssh     | -p cilium-903000 sudo crio                           | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | config                                               |                           |         |         |                     |                     |
	| delete  | -p cilium-903000                                     | cilium-903000             | jenkins | v1.32.0 | 07 Mar 24 14:08 PST | 07 Mar 24 14:08 PST |
	| delete  | -p offline-docker-900000                             | offline-docker-900000     | jenkins | v1.32.0 | 07 Mar 24 14:08 PST | 07 Mar 24 14:08 PST |
	| start   | -p force-systemd-env-254000                          | force-systemd-env-254000  | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| start   | -p force-systemd-flag-929000                         | force-systemd-flag-929000 | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | --memory=2048 --force-systemd                        |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | force-systemd-env-254000                             | force-systemd-env-254000  | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | ssh docker info --format                             |                           |         |         |                     |                     |
	|         | {{.CgroupDriver}}                                    |                           |         |         |                     |                     |
	| delete  | -p force-systemd-env-254000                          | force-systemd-env-254000  | jenkins | v1.32.0 | 07 Mar 24 14:08 PST | 07 Mar 24 14:08 PST |
	| start   | -p docker-flags-094000                               | docker-flags-094000       | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | --cache-images=false                                 |                           |         |         |                     |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --install-addons=false                               |                           |         |         |                     |                     |
	|         | --wait=false                                         |                           |         |         |                     |                     |
	|         | --docker-env=FOO=BAR                                 |                           |         |         |                     |                     |
	|         | --docker-env=BAZ=BAT                                 |                           |         |         |                     |                     |
	|         | --docker-opt=debug                                   |                           |         |         |                     |                     |
	|         | --docker-opt=icc=true                                |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=5                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | force-systemd-flag-929000                            | force-systemd-flag-929000 | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | ssh docker info --format                             |                           |         |         |                     |                     |
	|         | {{.CgroupDriver}}                                    |                           |         |         |                     |                     |
	| delete  | -p force-systemd-flag-929000                         | force-systemd-flag-929000 | jenkins | v1.32.0 | 07 Mar 24 14:08 PST | 07 Mar 24 14:08 PST |
	| start   | -p cert-expiration-897000                            | cert-expiration-897000    | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --cert-expiration=3m                                 |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | docker-flags-094000 ssh                              | docker-flags-094000       | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | sudo systemctl show docker                           |                           |         |         |                     |                     |
	|         | --property=Environment                               |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| ssh     | docker-flags-094000 ssh                              | docker-flags-094000       | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | sudo systemctl show docker                           |                           |         |         |                     |                     |
	|         | --property=ExecStart                                 |                           |         |         |                     |                     |
	|         | --no-pager                                           |                           |         |         |                     |                     |
	| delete  | -p docker-flags-094000                               | docker-flags-094000       | jenkins | v1.32.0 | 07 Mar 24 14:08 PST | 07 Mar 24 14:08 PST |
	| start   | -p cert-options-850000                               | cert-options-850000       | jenkins | v1.32.0 | 07 Mar 24 14:08 PST |                     |
	|         | --memory=2048                                        |                           |         |         |                     |                     |
	|         | --apiserver-ips=127.0.0.1                            |                           |         |         |                     |                     |
	|         | --apiserver-ips=192.168.15.15                        |                           |         |         |                     |                     |
	|         | --apiserver-names=localhost                          |                           |         |         |                     |                     |
	|         | --apiserver-names=www.google.com                     |                           |         |         |                     |                     |
	|         | --apiserver-port=8555                                |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| ssh     | cert-options-850000 ssh                              | cert-options-850000       | jenkins | v1.32.0 | 07 Mar 24 14:09 PST |                     |
	|         | openssl x509 -text -noout -in                        |                           |         |         |                     |                     |
	|         | /var/lib/minikube/certs/apiserver.crt                |                           |         |         |                     |                     |
	| ssh     | -p cert-options-850000 -- sudo                       | cert-options-850000       | jenkins | v1.32.0 | 07 Mar 24 14:09 PST |                     |
	|         | cat /etc/kubernetes/admin.conf                       |                           |         |         |                     |                     |
	| delete  | -p cert-options-850000                               | cert-options-850000       | jenkins | v1.32.0 | 07 Mar 24 14:09 PST | 07 Mar 24 14:09 PST |
	| start   | -p running-upgrade-390000                            | minikube                  | jenkins | v1.26.0 | 07 Mar 24 14:09 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p running-upgrade-390000                            | minikube                  | jenkins | v1.26.0 | 07 Mar 24 14:10 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p running-upgrade-390000                            | minikube                  | jenkins | v1.26.0 | 07 Mar 24 14:10 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| delete  | -p running-upgrade-390000                            | running-upgrade-390000    | jenkins | v1.32.0 | 07 Mar 24 14:10 PST | 07 Mar 24 14:10 PST |
	| start   | -p kubernetes-upgrade-094000                         | kubernetes-upgrade-094000 | jenkins | v1.32.0 | 07 Mar 24 14:10 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0                         |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| stop    | -p kubernetes-upgrade-094000                         | kubernetes-upgrade-094000 | jenkins | v1.32.0 | 07 Mar 24 14:10 PST | 07 Mar 24 14:10 PST |
	| start   | -p kubernetes-upgrade-094000                         | kubernetes-upgrade-094000 | jenkins | v1.32.0 | 07 Mar 24 14:10 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --kubernetes-version=v1.29.0-rc.2                    |                           |         |         |                     |                     |
	|         | --alsologtostderr -v=1                               |                           |         |         |                     |                     |
	|         | --driver=hyperkit                                    |                           |         |         |                     |                     |
	| delete  | -p kubernetes-upgrade-094000                         | kubernetes-upgrade-094000 | jenkins | v1.32.0 | 07 Mar 24 14:10 PST | 07 Mar 24 14:10 PST |
	| start   | -p stopped-upgrade-253000                            | minikube                  | jenkins | v1.26.0 | 07 Mar 24 14:10 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p stopped-upgrade-253000                            | minikube                  | jenkins | v1.26.0 | 07 Mar 24 14:10 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	| start   | -p stopped-upgrade-253000                            | minikube                  | jenkins | v1.26.0 | 07 Mar 24 14:11 PST |                     |
	|         | --memory=2200                                        |                           |         |         |                     |                     |
	|         | --vm-driver=hyperkit                                 |                           |         |         |                     |                     |
	|---------|------------------------------------------------------|---------------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/07 14:11:01
	Running on machine: MacOS-Agent-4
	Binary: Built with gc go1.18.3 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0307 14:11:01.786311    4790 out.go:296] Setting OutFile to fd 1 ...
	I0307 14:11:01.786484    4790 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0307 14:11:01.786486    4790 out.go:309] Setting ErrFile to fd 2...
	I0307 14:11:01.786489    4790 out.go:343] TERM=,COLORTERM=, which probably does not support color
	I0307 14:11:01.786814    4790 root.go:329] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:11:01.787045    4790 out.go:303] Setting JSON to false
	I0307 14:11:01.808914    4790 start.go:115] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2432,"bootTime":1709847029,"procs":491,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:11:01.809001    4790 start.go:123] gopshost.Virtualization returned error: not implemented yet
	I0307 14:11:01.831176    4790 out.go:177] * [stopped-upgrade-253000] minikube v1.26.0 on Darwin 14.3.1
	I0307 14:11:01.873949    4790 notify.go:193] Checking for updates...
	I0307 14:11:01.895934    4790 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:11:01.917055    4790 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:11:01.938310    4790 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:11:01.960064    4790 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:11:01.981046    4790 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:11:02.002028    4790 out.go:177]   - KUBECONFIG=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/legacy_kubeconfig4242125000
	I0307 14:11:02.023469    4790 config.go:178] Loaded profile config "stopped-upgrade-253000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.24.1
	I0307 14:11:02.024091    4790 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:11:02.024145    4790 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0307 14:11:02.031998    4790 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:50838
	I0307 14:11:02.032320    4790 main.go:134] libmachine: () Calling .GetVersion
	I0307 14:11:02.032751    4790 main.go:134] libmachine: Using API Version  1
	I0307 14:11:02.032760    4790 main.go:134] libmachine: () Calling .SetConfigRaw
	I0307 14:11:02.033010    4790 main.go:134] libmachine: () Calling .GetMachineName
	I0307 14:11:02.033137    4790 main.go:134] libmachine: (stopped-upgrade-253000) Calling .DriverName
	I0307 14:11:02.033253    4790 driver.go:360] Setting default libvirt URI to qemu:///system
	I0307 14:11:02.033501    4790 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:11:02.033524    4790 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0307 14:11:02.041192    4790 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:50840
	I0307 14:11:02.041523    4790 main.go:134] libmachine: () Calling .GetVersion
	I0307 14:11:02.041884    4790 main.go:134] libmachine: Using API Version  1
	I0307 14:11:02.041895    4790 main.go:134] libmachine: () Calling .SetConfigRaw
	I0307 14:11:02.042088    4790 main.go:134] libmachine: () Calling .GetMachineName
	I0307 14:11:02.042177    4790 main.go:134] libmachine: (stopped-upgrade-253000) Calling .DriverName
	I0307 14:11:02.070096    4790 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 14:11:02.112006    4790 start.go:284] selected driver: hyperkit
	I0307 14:11:02.112024    4790 start.go:805] validating driver "hyperkit" against &{Name:stopped-upgrade-253000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:s
topped-upgrade-253000 Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false
CustomQemuFirmwarePath:}
	I0307 14:11:02.112180    4790 start.go:816] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:11:02.116909    4790 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:11:02.117018    4790 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:11:02.124833    4790 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:11:02.128379    4790 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:11:02.128393    4790 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:11:02.128474    4790 cni.go:95] Creating CNI manager for ""
	I0307 14:11:02.128482    4790 cni.go:169] CNI unnecessary in this configuration, recommending no CNI
	I0307 14:11:02.128497    4790 start_flags.go:310] config:
	{Name:stopped-upgrade-253000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.26.0-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.32@sha256:9190bd2393eae887316c97a74370b7d5dad8f0b2ef91ac2662bc36f7ef8e0b95 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:0 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.24.1 ClusterName:stopped-upgrade-253000 Namespace:default APIServerName:minikubeCA APIServerNames:[]
APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.24.1 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath:}
	I0307 14:11:02.128617    4790 iso.go:128] acquiring lock: {Name:mkb8d6cdfaf2502d60ac0cde79c768aea6ef7923 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:11:02.171079    4790 out.go:177] * Starting control plane node stopped-upgrade-253000 in cluster stopped-upgrade-253000
	I0307 14:11:02.191712    4790 preload.go:132] Checking if preload exists for k8s version v1.24.1 and runtime docker
	I0307 14:11:02.191740    4790 preload.go:148] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4
	I0307 14:11:02.191753    4790 cache.go:57] Caching tarball of preloaded images
	I0307 14:11:02.191834    4790 preload.go:174] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.24.1-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:11:02.191842    4790 cache.go:60] Finished verifying existence of preloaded tar for  v1.24.1 on docker
	I0307 14:11:02.191918    4790 profile.go:148] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/stopped-upgrade-253000/config.json ...
	I0307 14:11:02.192325    4790 cache.go:208] Successfully downloaded all kic artifacts
	I0307 14:11:02.192348    4790 start.go:352] acquiring machines lock for stopped-upgrade-253000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:11:02.192390    4790 start.go:356] acquired machines lock for "stopped-upgrade-253000" in 31.996µs
	I0307 14:11:02.192410    4790 start.go:94] Skipping create...Using existing machine configuration
	I0307 14:11:02.192416    4790 fix.go:55] fixHost starting: 
	I0307 14:11:02.192637    4790 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:11:02.192657    4790 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0307 14:11:02.200243    4790 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:50842
	I0307 14:11:02.200540    4790 main.go:134] libmachine: () Calling .GetVersion
	I0307 14:11:02.200846    4790 main.go:134] libmachine: Using API Version  1
	I0307 14:11:02.200854    4790 main.go:134] libmachine: () Calling .SetConfigRaw
	I0307 14:11:02.201067    4790 main.go:134] libmachine: () Calling .GetMachineName
	I0307 14:11:02.201179    4790 main.go:134] libmachine: (stopped-upgrade-253000) Calling .DriverName
	I0307 14:11:02.201264    4790 main.go:134] libmachine: (stopped-upgrade-253000) Calling .GetState
	I0307 14:11:02.201335    4790 main.go:134] libmachine: (stopped-upgrade-253000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:11:02.201347    4790 main.go:134] libmachine: (stopped-upgrade-253000) DBG | hyperkit pid from json: 0
	I0307 14:11:02.201355    4790 main.go:134] libmachine: (stopped-upgrade-253000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/stopped-upgrade-253000/hyperkit.json: no such file or directory
	I0307 14:11:02.201378    4790 fix.go:103] recreateIfNeeded on stopped-upgrade-253000: state=Stopped err=<nil>
	I0307 14:11:02.201388    4790 main.go:134] libmachine: (stopped-upgrade-253000) Calling .DriverName
	W0307 14:11:02.201459    4790 fix.go:129] unexpected machine state, will restart: <nil>
	I0307 14:11:02.245069    4790 out.go:177] * Restarting existing hyperkit VM for "stopped-upgrade-253000" ...
	I0307 14:11:02.265763    4790 main.go:134] libmachine: (stopped-upgrade-253000) Calling .Start
	I0307 14:11:02.265964    4790 main.go:134] libmachine: (stopped-upgrade-253000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:11:02.266020    4790 main.go:134] libmachine: (stopped-upgrade-253000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/stopped-upgrade-253000/hyperkit.pid
	I0307 14:11:02.266040    4790 main.go:134] libmachine: (stopped-upgrade-253000) DBG | Using UUID 8ed9daf2-dccf-11ee-a47b-149d997fca88
	I0307 14:11:02.303269    4790 main.go:134] libmachine: (stopped-upgrade-253000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:11:02.303374    4790 fix.go:57] fixHost completed within 110.954816ms
	I0307 14:11:02.303380    4790 start.go:81] releasing machines lock for "stopped-upgrade-253000", held for 110.985548ms
	W0307 14:11:02.303392    4790 start.go:599] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 14:11:02.303501    4790 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:11:02.303510    4790 start.go:614] Will try again in 5 seconds ...
	I0307 14:11:07.305051    4790 start.go:352] acquiring machines lock for stopped-upgrade-253000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:11:07.305227    4790 start.go:356] acquired machines lock for "stopped-upgrade-253000" in 156.982µs
	I0307 14:11:07.305254    4790 start.go:94] Skipping create...Using existing machine configuration
	I0307 14:11:07.305259    4790 fix.go:55] fixHost starting: 
	I0307 14:11:07.305763    4790 main.go:134] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:11:07.305799    4790 main.go:134] libmachine: Launching plugin server for driver hyperkit
	I0307 14:11:07.314716    4790 main.go:134] libmachine: Plugin server listening at address 127.0.0.1:50844
	I0307 14:11:07.315049    4790 main.go:134] libmachine: () Calling .GetVersion
	I0307 14:11:07.315376    4790 main.go:134] libmachine: Using API Version  1
	I0307 14:11:07.315387    4790 main.go:134] libmachine: () Calling .SetConfigRaw
	I0307 14:11:07.315587    4790 main.go:134] libmachine: () Calling .GetMachineName
	I0307 14:11:07.315692    4790 main.go:134] libmachine: (stopped-upgrade-253000) Calling .DriverName
	I0307 14:11:07.315789    4790 main.go:134] libmachine: (stopped-upgrade-253000) Calling .GetState
	I0307 14:11:07.315874    4790 main.go:134] libmachine: (stopped-upgrade-253000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:11:07.315899    4790 main.go:134] libmachine: (stopped-upgrade-253000) DBG | hyperkit pid from json: 0
	I0307 14:11:07.315920    4790 main.go:134] libmachine: (stopped-upgrade-253000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/stopped-upgrade-253000/hyperkit.json: no such file or directory
	I0307 14:11:07.315950    4790 fix.go:103] recreateIfNeeded on stopped-upgrade-253000: state=Stopped err=<nil>
	I0307 14:11:07.315985    4790 main.go:134] libmachine: (stopped-upgrade-253000) Calling .DriverName
	W0307 14:11:07.316080    4790 fix.go:129] unexpected machine state, will restart: <nil>
	I0307 14:11:07.360697    4790 out.go:177] * Restarting existing hyperkit VM for "stopped-upgrade-253000" ...
	I0307 14:11:07.383642    4790 main.go:134] libmachine: (stopped-upgrade-253000) Calling .Start
	I0307 14:11:07.383906    4790 main.go:134] libmachine: (stopped-upgrade-253000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:11:07.383930    4790 main.go:134] libmachine: (stopped-upgrade-253000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/stopped-upgrade-253000/hyperkit.pid
	I0307 14:11:07.383992    4790 main.go:134] libmachine: (stopped-upgrade-253000) DBG | Using UUID 8ed9daf2-dccf-11ee-a47b-149d997fca88
	I0307 14:11:07.385442    4790 main.go:134] libmachine: (stopped-upgrade-253000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:11:07.385517    4790 fix.go:57] fixHost completed within 80.25692ms
	I0307 14:11:07.385522    4790 start.go:81] releasing machines lock for "stopped-upgrade-253000", held for 80.28701ms
	W0307 14:11:07.385636    4790 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p stopped-upgrade-253000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:11:07.427417    4790 out.go:177] 
	W0307 14:11:07.448873    4790 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:11:07.449138    4790 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:11:07.449181    4790 out.go:239] * Related issues:
	W0307 14:11:07.449387    4790 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:11:07.449607    4790 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:11:07.512754    4790 out.go:177] 
	
	
	* The control-plane node stopped-upgrade-253000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p stopped-upgrade-253000"

                                                
                                                
-- /stdout --
version_upgrade_test.go:208: `minikube logs` after upgrade to HEAD from v1.26.0 failed: exit status 83
--- FAIL: TestStoppedBinaryUpgrade/MinikubeLogs (0.32s)

                                                
                                    
x
+
TestPause/serial/Start (11.29s)

                                                
                                                
=== RUN   TestPause/serial/Start
pause_test.go:80: (dbg) Run:  out/minikube-darwin-amd64 start -p pause-572000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit 
pause_test.go:80: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p pause-572000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit : exit status 60 (11.218868563s)

                                                
                                                
-- stdout --
	* [pause-572000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "pause-572000" primary control-plane node in "pause-572000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	* Deleting "pause-572000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2048MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p pause-572000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
pause_test.go:82: failed to start minikube with args: "out/minikube-darwin-amd64 start -p pause-572000 --memory=2048 --install-addons=false --wait=all --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p pause-572000 -n pause-572000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p pause-572000 -n pause-572000: exit status 7 (74.437703ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "pause-572000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestPause/serial/Start (11.29s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithK8s (11.35s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithK8s
no_kubernetes_test.go:95: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-189000 --driver=hyperkit 
no_kubernetes_test.go:95: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-189000 --driver=hyperkit : exit status 60 (11.280600559s)

                                                
                                                
-- stdout --
	* [NoKubernetes-189000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "NoKubernetes-189000" primary control-plane node in "NoKubernetes-189000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	* Deleting "NoKubernetes-189000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-189000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:97: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-189000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-189000 -n NoKubernetes-189000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-189000 -n NoKubernetes-189000: exit status 7 (72.51733ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-189000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithK8s (11.35s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartWithStopK8s (6.25s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartWithStopK8s
no_kubernetes_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-189000 --no-kubernetes --driver=hyperkit 
no_kubernetes_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-189000 --no-kubernetes --driver=hyperkit : exit status 60 (6.176044161s)

                                                
                                                
-- stdout --
	* [NoKubernetes-189000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-189000
	* Restarting existing hyperkit VM for "NoKubernetes-189000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-189000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-189000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:114: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-189000 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-189000 -n NoKubernetes-189000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-189000 -n NoKubernetes-189000: exit status 7 (73.51005ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-189000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartWithStopK8s (6.25s)

                                                
                                    
x
+
TestNoKubernetes/serial/Start (6.29s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Start
no_kubernetes_test.go:136: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-189000 --no-kubernetes --driver=hyperkit 
no_kubernetes_test.go:136: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-189000 --no-kubernetes --driver=hyperkit : exit status 60 (6.215446802s)

                                                
                                                
-- stdout --
	* [NoKubernetes-189000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-189000
	* Restarting existing hyperkit VM for "NoKubernetes-189000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-189000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-189000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:138: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-189000 --no-kubernetes --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-189000 -n NoKubernetes-189000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-189000 -n NoKubernetes-189000: exit status 7 (72.700107ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-189000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/Start (6.29s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoArgs (6.31s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoArgs
no_kubernetes_test.go:191: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-189000 --driver=hyperkit 
no_kubernetes_test.go:191: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-189000 --driver=hyperkit : exit status 60 (6.235508699s)

                                                
                                                
-- stdout --
	* [NoKubernetes-189000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting minikube without Kubernetes in cluster NoKubernetes-189000
	* Restarting existing hyperkit VM for "NoKubernetes-189000" ...
	* Restarting existing hyperkit VM for "NoKubernetes-189000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p NoKubernetes-189000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Related issues:
	  - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/5594

                                                
                                                
** /stderr **
no_kubernetes_test.go:193: failed to start minikube with args: "out/minikube-darwin-amd64 start -p NoKubernetes-189000 --driver=hyperkit " : exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-189000 -n NoKubernetes-189000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p NoKubernetes-189000 -n NoKubernetes-189000: exit status 7 (73.63482ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "NoKubernetes-189000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestNoKubernetes/serial/StartNoArgs (6.31s)

                                                
                                    
x
+
TestNetworkPlugins/group/auto/Start (11.59s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/auto/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p auto-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p auto-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --driver=hyperkit : exit status 60 (11.590931311s)

                                                
                                                
-- stdout --
	* [auto-903000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "auto-903000" primary control-plane node in "auto-903000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "auto-903000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:11:54.829567    4968 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:11:54.830186    4968 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:11:54.830241    4968 out.go:304] Setting ErrFile to fd 2...
	I0307 14:11:54.830267    4968 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:11:54.830804    4968 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:11:54.832389    4968 out.go:298] Setting JSON to false
	I0307 14:11:54.855440    4968 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2485,"bootTime":1709847029,"procs":492,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:11:54.855548    4968 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:11:54.878515    4968 out.go:177] * [auto-903000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:11:54.920750    4968 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:11:54.920770    4968 notify.go:220] Checking for updates...
	I0307 14:11:54.965608    4968 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:11:54.987584    4968 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:11:55.008734    4968 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:11:55.029712    4968 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:11:55.051549    4968 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:11:55.075617    4968 config.go:182] Loaded profile config "cert-expiration-897000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:11:55.075809    4968 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:11:55.075990    4968 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:11:55.105623    4968 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:11:55.147552    4968 start.go:297] selected driver: hyperkit
	I0307 14:11:55.147577    4968 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:11:55.147598    4968 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:11:55.151796    4968 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:11:55.151914    4968 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:11:55.159668    4968 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:11:55.163618    4968 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:11:55.163647    4968 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:11:55.163683    4968 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:11:55.163893    4968 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:11:55.163951    4968 cni.go:84] Creating CNI manager for ""
	I0307 14:11:55.163968    4968 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:11:55.163976    4968 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 14:11:55.164029    4968 start.go:340] cluster config:
	{Name:auto-903000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:auto-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:d
ocker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgen
tPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:11:55.164116    4968 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:11:55.207472    4968 out.go:177] * Starting "auto-903000" primary control-plane node in "auto-903000" cluster
	I0307 14:11:55.228803    4968 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:11:55.228879    4968 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:11:55.228908    4968 cache.go:56] Caching tarball of preloaded images
	I0307 14:11:55.229110    4968 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:11:55.229129    4968 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:11:55.229283    4968 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/auto-903000/config.json ...
	I0307 14:11:55.229318    4968 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/auto-903000/config.json: {Name:mk16a3610925f11117035da946a8a4cee27c83e3 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:11:55.229872    4968 start.go:360] acquireMachinesLock for auto-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:11:55.229944    4968 start.go:364] duration metric: took 57.857µs to acquireMachinesLock for "auto-903000"
	I0307 14:11:55.229972    4968 start.go:93] Provisioning new machine with config: &{Name:auto-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.28.4 ClusterName:auto-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mou
ntType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:11:55.230036    4968 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:11:55.251806    4968 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:11:55.252010    4968 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:11:55.252062    4968 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:11:55.262326    4968 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50955
	I0307 14:11:55.262692    4968 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:11:55.263131    4968 main.go:141] libmachine: Using API Version  1
	I0307 14:11:55.263142    4968 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:11:55.263400    4968 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:11:55.263523    4968 main.go:141] libmachine: (auto-903000) Calling .GetMachineName
	I0307 14:11:55.263612    4968 main.go:141] libmachine: (auto-903000) Calling .DriverName
	I0307 14:11:55.263706    4968 start.go:159] libmachine.API.Create for "auto-903000" (driver="hyperkit")
	I0307 14:11:55.263756    4968 client.go:168] LocalClient.Create starting
	I0307 14:11:55.263794    4968 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:11:55.263846    4968 main.go:141] libmachine: Decoding PEM data...
	I0307 14:11:55.263863    4968 main.go:141] libmachine: Parsing certificate...
	I0307 14:11:55.263914    4968 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:11:55.263949    4968 main.go:141] libmachine: Decoding PEM data...
	I0307 14:11:55.263960    4968 main.go:141] libmachine: Parsing certificate...
	I0307 14:11:55.263972    4968 main.go:141] libmachine: Running pre-create checks...
	I0307 14:11:55.263981    4968 main.go:141] libmachine: (auto-903000) Calling .PreCreateCheck
	I0307 14:11:55.264046    4968 main.go:141] libmachine: (auto-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:11:55.264225    4968 main.go:141] libmachine: (auto-903000) Calling .GetConfigRaw
	I0307 14:11:55.273879    4968 main.go:141] libmachine: Creating machine...
	I0307 14:11:55.273896    4968 main.go:141] libmachine: (auto-903000) Calling .Create
	I0307 14:11:55.274087    4968 main.go:141] libmachine: (auto-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:11:55.274315    4968 main.go:141] libmachine: (auto-903000) DBG | I0307 14:11:55.274066    4978 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:11:55.274410    4968 main.go:141] libmachine: (auto-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:11:55.446529    4968 main.go:141] libmachine: (auto-903000) DBG | I0307 14:11:55.446465    4978 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/auto-903000/id_rsa...
	I0307 14:11:55.738352    4968 main.go:141] libmachine: (auto-903000) DBG | I0307 14:11:55.738262    4978 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/auto-903000/auto-903000.rawdisk...
	I0307 14:11:55.738366    4968 main.go:141] libmachine: (auto-903000) DBG | Writing magic tar header
	I0307 14:11:55.738374    4968 main.go:141] libmachine: (auto-903000) DBG | Writing SSH key tar header
	I0307 14:11:55.739107    4968 main.go:141] libmachine: (auto-903000) DBG | I0307 14:11:55.739015    4978 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/auto-903000 ...
	I0307 14:11:56.096875    4968 main.go:141] libmachine: (auto-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:11:56.096907    4968 main.go:141] libmachine: (auto-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/auto-903000/hyperkit.pid
	I0307 14:11:56.096924    4968 main.go:141] libmachine: (auto-903000) DBG | Using UUID 54ea15ff-fc52-49db-8f58-096746c40a2e
	I0307 14:11:56.134513    4968 main.go:141] libmachine: (auto-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:11:56.134594    4968 client.go:171] duration metric: took 870.822737ms to LocalClient.Create
	I0307 14:11:58.134883    4968 start.go:128] duration metric: took 2.90480835s to createHost
	I0307 14:11:58.134909    4968 start.go:83] releasing machines lock for "auto-903000", held for 2.904935819s
	W0307 14:11:58.134940    4968 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:11:58.135524    4968 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:11:58.135574    4968 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:11:58.144902    4968 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50963
	I0307 14:11:58.145349    4968 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:11:58.145750    4968 main.go:141] libmachine: Using API Version  1
	I0307 14:11:58.145762    4968 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:11:58.146009    4968 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:11:58.146376    4968 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:11:58.146401    4968 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:11:58.154260    4968 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50966
	I0307 14:11:58.154605    4968 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:11:58.154941    4968 main.go:141] libmachine: Using API Version  1
	I0307 14:11:58.154958    4968 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:11:58.155184    4968 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:11:58.155280    4968 main.go:141] libmachine: (auto-903000) Calling .GetState
	I0307 14:11:58.155371    4968 main.go:141] libmachine: (auto-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:11:58.155397    4968 main.go:141] libmachine: (auto-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/auto-903000/hyperkit.json: no such file or directory
	I0307 14:11:58.155406    4968 main.go:141] libmachine: (auto-903000) DBG | hyperkit pid from json: 0
	I0307 14:11:58.155469    4968 main.go:141] libmachine: (auto-903000) Calling .DriverName
	I0307 14:11:58.211836    4968 out.go:177] * Deleting "auto-903000" in hyperkit ...
	I0307 14:11:58.233759    4968 main.go:141] libmachine: (auto-903000) Calling .Remove
	I0307 14:11:58.234060    4968 main.go:141] libmachine: (auto-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:11:58.234087    4968 main.go:141] libmachine: (auto-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:11:58.234123    4968 main.go:141] libmachine: (auto-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/auto-903000/hyperkit.json: no such file or directory
	I0307 14:11:58.234191    4968 main.go:141] libmachine: (auto-903000) DBG | hyperkit pid from json: 0
	W0307 14:11:58.252309    4968 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:11:58.252324    4968 start.go:728] Will try again in 5 seconds ...
	I0307 14:12:03.252546    4968 start.go:360] acquireMachinesLock for auto-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:12:03.252670    4968 start.go:364] duration metric: took 95.283µs to acquireMachinesLock for "auto-903000"
	I0307 14:12:03.252695    4968 start.go:93] Provisioning new machine with config: &{Name:auto-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Kub
ernetesVersion:v1.28.4 ClusterName:auto-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 Mou
ntType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:12:03.252778    4968 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:12:03.296022    4968 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:12:03.296177    4968 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:03.296217    4968 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:03.305804    4968 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50968
	I0307 14:12:03.306169    4968 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:03.306490    4968 main.go:141] libmachine: Using API Version  1
	I0307 14:12:03.306507    4968 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:03.306729    4968 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:03.306837    4968 main.go:141] libmachine: (auto-903000) Calling .GetMachineName
	I0307 14:12:03.306937    4968 main.go:141] libmachine: (auto-903000) Calling .DriverName
	I0307 14:12:03.307031    4968 start.go:159] libmachine.API.Create for "auto-903000" (driver="hyperkit")
	I0307 14:12:03.307045    4968 client.go:168] LocalClient.Create starting
	I0307 14:12:03.307075    4968 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:12:03.307126    4968 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:03.307136    4968 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:03.307183    4968 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:12:03.307219    4968 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:03.307232    4968 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:03.307245    4968 main.go:141] libmachine: Running pre-create checks...
	I0307 14:12:03.307250    4968 main.go:141] libmachine: (auto-903000) Calling .PreCreateCheck
	I0307 14:12:03.307333    4968 main.go:141] libmachine: (auto-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:03.307349    4968 main.go:141] libmachine: (auto-903000) Calling .GetConfigRaw
	I0307 14:12:03.307766    4968 main.go:141] libmachine: Creating machine...
	I0307 14:12:03.307773    4968 main.go:141] libmachine: (auto-903000) Calling .Create
	I0307 14:12:03.307844    4968 main.go:141] libmachine: (auto-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:03.307957    4968 main.go:141] libmachine: (auto-903000) DBG | I0307 14:12:03.307832    4996 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:03.308012    4968 main.go:141] libmachine: (auto-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:12:03.482392    4968 main.go:141] libmachine: (auto-903000) DBG | I0307 14:12:03.482289    4996 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/auto-903000/id_rsa...
	I0307 14:12:03.726966    4968 main.go:141] libmachine: (auto-903000) DBG | I0307 14:12:03.726870    4996 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/auto-903000/auto-903000.rawdisk...
	I0307 14:12:03.726979    4968 main.go:141] libmachine: (auto-903000) DBG | Writing magic tar header
	I0307 14:12:03.726998    4968 main.go:141] libmachine: (auto-903000) DBG | Writing SSH key tar header
	I0307 14:12:03.727768    4968 main.go:141] libmachine: (auto-903000) DBG | I0307 14:12:03.727664    4996 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/auto-903000 ...
	I0307 14:12:04.085972    4968 main.go:141] libmachine: (auto-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:04.085990    4968 main.go:141] libmachine: (auto-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/auto-903000/hyperkit.pid
	I0307 14:12:04.086027    4968 main.go:141] libmachine: (auto-903000) DBG | Using UUID eb2db727-5bae-4c5e-a587-62396a860141
	I0307 14:12:04.123958    4968 main.go:141] libmachine: (auto-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:12:04.124045    4968 client.go:171] duration metric: took 816.987857ms to LocalClient.Create
	I0307 14:12:06.124209    4968 start.go:128] duration metric: took 2.871395536s to createHost
	I0307 14:12:06.124238    4968 start.go:83] releasing machines lock for "auto-903000", held for 2.871537199s
	W0307 14:12:06.124382    4968 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p auto-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p auto-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:12:06.167037    4968 out.go:177] 
	W0307 14:12:06.233825    4968 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:12:06.233883    4968 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:12:06.233895    4968 out.go:239] * Related issues:
	* Related issues:
	W0307 14:12:06.233908    4968 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:12:06.233924    4968 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:12:06.275897    4968 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/auto/Start (11.59s)

                                                
                                    
x
+
TestNetworkPlugins/group/kindnet/Start (12s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kindnet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p kindnet-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kindnet-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=kindnet --driver=hyperkit : exit status 60 (11.999475297s)

                                                
                                                
-- stdout --
	* [kindnet-903000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "kindnet-903000" primary control-plane node in "kindnet-903000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "kindnet-903000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:12:07.036987    5024 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:12:07.057508    5024 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:12:07.057546    5024 out.go:304] Setting ErrFile to fd 2...
	I0307 14:12:07.057556    5024 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:12:07.057902    5024 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:12:07.078725    5024 out.go:298] Setting JSON to false
	I0307 14:12:07.102177    5024 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2498,"bootTime":1709847029,"procs":500,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:12:07.102274    5024 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:12:07.123328    5024 out.go:177] * [kindnet-903000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:12:07.186212    5024 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:12:07.165176    5024 notify.go:220] Checking for updates...
	I0307 14:12:07.228131    5024 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:12:07.291173    5024 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:12:07.333124    5024 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:12:07.356436    5024 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:07.377207    5024 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:12:07.398527    5024 config.go:182] Loaded profile config "auto-903000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:12:07.398681    5024 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:12:07.398801    5024 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:12:07.428270    5024 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:12:07.470393    5024 start.go:297] selected driver: hyperkit
	I0307 14:12:07.470427    5024 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:12:07.470453    5024 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:12:07.474738    5024 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:12:07.474851    5024 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:12:07.482442    5024 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:12:07.486301    5024 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:07.486325    5024 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:12:07.486359    5024 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:12:07.486551    5024 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:12:07.486618    5024 cni.go:84] Creating CNI manager for "kindnet"
	I0307 14:12:07.486626    5024 start_flags.go:319] Found "CNI" CNI - setting NetworkPlugin=cni
	I0307 14:12:07.486692    5024 start.go:340] cluster config:
	{Name:kindnet-903000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:kindnet-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:12:07.486781    5024 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:12:07.566330    5024 out.go:177] * Starting "kindnet-903000" primary control-plane node in "kindnet-903000" cluster
	I0307 14:12:07.587358    5024 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:12:07.587436    5024 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:12:07.587470    5024 cache.go:56] Caching tarball of preloaded images
	I0307 14:12:07.587722    5024 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:12:07.587747    5024 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:12:07.587910    5024 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/kindnet-903000/config.json ...
	I0307 14:12:07.587953    5024 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/kindnet-903000/config.json: {Name:mkdd63600413f2f36da7ac1935eb3d283cd0d52b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:12:07.588641    5024 start.go:360] acquireMachinesLock for kindnet-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:12:07.588779    5024 start.go:364] duration metric: took 115.888µs to acquireMachinesLock for "kindnet-903000"
	I0307 14:12:07.588823    5024 start.go:93] Provisioning new machine with config: &{Name:kindnet-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kindnet-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:12:07.588910    5024 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:12:07.610121    5024 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:12:07.610269    5024 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:07.610311    5024 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:07.618571    5024 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50988
	I0307 14:12:07.618996    5024 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:07.619457    5024 main.go:141] libmachine: Using API Version  1
	I0307 14:12:07.619474    5024 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:07.619684    5024 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:07.619795    5024 main.go:141] libmachine: (kindnet-903000) Calling .GetMachineName
	I0307 14:12:07.619893    5024 main.go:141] libmachine: (kindnet-903000) Calling .DriverName
	I0307 14:12:07.620002    5024 start.go:159] libmachine.API.Create for "kindnet-903000" (driver="hyperkit")
	I0307 14:12:07.620026    5024 client.go:168] LocalClient.Create starting
	I0307 14:12:07.620059    5024 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:12:07.620115    5024 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:07.620129    5024 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:07.620195    5024 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:12:07.620237    5024 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:07.620248    5024 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:07.620259    5024 main.go:141] libmachine: Running pre-create checks...
	I0307 14:12:07.620266    5024 main.go:141] libmachine: (kindnet-903000) Calling .PreCreateCheck
	I0307 14:12:07.620333    5024 main.go:141] libmachine: (kindnet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:07.620523    5024 main.go:141] libmachine: (kindnet-903000) Calling .GetConfigRaw
	I0307 14:12:07.631459    5024 main.go:141] libmachine: Creating machine...
	I0307 14:12:07.631473    5024 main.go:141] libmachine: (kindnet-903000) Calling .Create
	I0307 14:12:07.631619    5024 main.go:141] libmachine: (kindnet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:07.631739    5024 main.go:141] libmachine: (kindnet-903000) DBG | I0307 14:12:07.631601    5042 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:07.631809    5024 main.go:141] libmachine: (kindnet-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:12:07.905423    5024 main.go:141] libmachine: (kindnet-903000) DBG | I0307 14:12:07.905316    5042 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kindnet-903000/id_rsa...
	I0307 14:12:08.003480    5024 main.go:141] libmachine: (kindnet-903000) DBG | I0307 14:12:08.003422    5042 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kindnet-903000/kindnet-903000.rawdisk...
	I0307 14:12:08.003496    5024 main.go:141] libmachine: (kindnet-903000) DBG | Writing magic tar header
	I0307 14:12:08.003506    5024 main.go:141] libmachine: (kindnet-903000) DBG | Writing SSH key tar header
	I0307 14:12:08.004157    5024 main.go:141] libmachine: (kindnet-903000) DBG | I0307 14:12:08.004096    5042 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kindnet-903000 ...
	I0307 14:12:08.410006    5024 main.go:141] libmachine: (kindnet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:08.410026    5024 main.go:141] libmachine: (kindnet-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kindnet-903000/hyperkit.pid
	I0307 14:12:08.410037    5024 main.go:141] libmachine: (kindnet-903000) DBG | Using UUID 8270aeb8-0efa-497f-a56f-39a40a38545c
	I0307 14:12:08.554511    5024 main.go:141] libmachine: (kindnet-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:12:08.554581    5024 client.go:171] duration metric: took 934.53729ms to LocalClient.Create
	I0307 14:12:10.556707    5024 start.go:128] duration metric: took 2.967762163s to createHost
	I0307 14:12:10.556726    5024 start.go:83] releasing machines lock for "kindnet-903000", held for 2.967913955s
	W0307 14:12:10.556756    5024 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:12:10.557060    5024 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:10.557083    5024 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:10.565064    5024 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51024
	I0307 14:12:10.565456    5024 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:10.565781    5024 main.go:141] libmachine: Using API Version  1
	I0307 14:12:10.565793    5024 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:10.566037    5024 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:10.566394    5024 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:10.566417    5024 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:10.574699    5024 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51026
	I0307 14:12:10.575039    5024 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:10.575375    5024 main.go:141] libmachine: Using API Version  1
	I0307 14:12:10.575395    5024 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:10.575591    5024 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:10.575708    5024 main.go:141] libmachine: (kindnet-903000) Calling .GetState
	I0307 14:12:10.575789    5024 main.go:141] libmachine: (kindnet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:10.575808    5024 main.go:141] libmachine: (kindnet-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kindnet-903000/hyperkit.json: no such file or directory
	I0307 14:12:10.575814    5024 main.go:141] libmachine: (kindnet-903000) DBG | hyperkit pid from json: 0
	I0307 14:12:10.575909    5024 main.go:141] libmachine: (kindnet-903000) Calling .DriverName
	I0307 14:12:10.618318    5024 out.go:177] * Deleting "kindnet-903000" in hyperkit ...
	I0307 14:12:10.641243    5024 main.go:141] libmachine: (kindnet-903000) Calling .Remove
	I0307 14:12:10.641571    5024 main.go:141] libmachine: (kindnet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:10.641600    5024 main.go:141] libmachine: (kindnet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:10.641622    5024 main.go:141] libmachine: (kindnet-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kindnet-903000/hyperkit.json: no such file or directory
	I0307 14:12:10.641633    5024 main.go:141] libmachine: (kindnet-903000) DBG | hyperkit pid from json: 0
	W0307 14:12:10.718671    5024 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:12:10.718694    5024 start.go:728] Will try again in 5 seconds ...
	I0307 14:12:15.718996    5024 start.go:360] acquireMachinesLock for kindnet-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:12:15.825868    5024 start.go:364] duration metric: took 106.843718ms to acquireMachinesLock for "kindnet-903000"
	I0307 14:12:15.825919    5024 start.go:93] Provisioning new machine with config: &{Name:kindnet-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kindnet-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:kindnet} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:12:15.826049    5024 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:12:15.860472    5024 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:12:15.860595    5024 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:15.860628    5024 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:15.868907    5024 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51066
	I0307 14:12:15.869319    5024 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:15.869685    5024 main.go:141] libmachine: Using API Version  1
	I0307 14:12:15.869714    5024 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:15.869922    5024 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:15.870030    5024 main.go:141] libmachine: (kindnet-903000) Calling .GetMachineName
	I0307 14:12:15.870111    5024 main.go:141] libmachine: (kindnet-903000) Calling .DriverName
	I0307 14:12:15.870209    5024 start.go:159] libmachine.API.Create for "kindnet-903000" (driver="hyperkit")
	I0307 14:12:15.870223    5024 client.go:168] LocalClient.Create starting
	I0307 14:12:15.870249    5024 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:12:15.870282    5024 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:15.870292    5024 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:15.870340    5024 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:12:15.870365    5024 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:15.870378    5024 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:15.870390    5024 main.go:141] libmachine: Running pre-create checks...
	I0307 14:12:15.870396    5024 main.go:141] libmachine: (kindnet-903000) Calling .PreCreateCheck
	I0307 14:12:15.870480    5024 main.go:141] libmachine: (kindnet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:15.870502    5024 main.go:141] libmachine: (kindnet-903000) Calling .GetConfigRaw
	I0307 14:12:15.905094    5024 main.go:141] libmachine: Creating machine...
	I0307 14:12:15.905108    5024 main.go:141] libmachine: (kindnet-903000) Calling .Create
	I0307 14:12:15.905261    5024 main.go:141] libmachine: (kindnet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:15.905412    5024 main.go:141] libmachine: (kindnet-903000) DBG | I0307 14:12:15.905232    5166 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:15.905431    5024 main.go:141] libmachine: (kindnet-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:12:16.128778    5024 main.go:141] libmachine: (kindnet-903000) DBG | I0307 14:12:16.128688    5166 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kindnet-903000/id_rsa...
	I0307 14:12:16.355860    5024 main.go:141] libmachine: (kindnet-903000) DBG | I0307 14:12:16.355767    5166 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kindnet-903000/kindnet-903000.rawdisk...
	I0307 14:12:16.355873    5024 main.go:141] libmachine: (kindnet-903000) DBG | Writing magic tar header
	I0307 14:12:16.355882    5024 main.go:141] libmachine: (kindnet-903000) DBG | Writing SSH key tar header
	I0307 14:12:16.356797    5024 main.go:141] libmachine: (kindnet-903000) DBG | I0307 14:12:16.356696    5166 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kindnet-903000 ...
	I0307 14:12:16.777428    5024 main.go:141] libmachine: (kindnet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:16.777448    5024 main.go:141] libmachine: (kindnet-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kindnet-903000/hyperkit.pid
	I0307 14:12:16.777463    5024 main.go:141] libmachine: (kindnet-903000) DBG | Using UUID 6bd2dd55-f7a1-4a40-9898-835ba6a687ff
	I0307 14:12:16.814419    5024 main.go:141] libmachine: (kindnet-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:12:16.814500    5024 client.go:171] duration metric: took 944.263461ms to LocalClient.Create
	I0307 14:12:18.816596    5024 start.go:128] duration metric: took 2.990508176s to createHost
	I0307 14:12:18.816627    5024 start.go:83] releasing machines lock for "kindnet-903000", held for 2.990721997s
	W0307 14:12:18.816750    5024 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kindnet-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kindnet-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:12:18.861064    5024 out.go:177] 
	W0307 14:12:18.882248    5024 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:12:18.882338    5024 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:12:18.882355    5024 out.go:239] * Related issues:
	* Related issues:
	W0307 14:12:18.882392    5024 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:12:18.882416    5024 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:12:18.904157    5024 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/kindnet/Start (12.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/calico/Start (11.59s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/calico/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p calico-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p calico-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=calico --driver=hyperkit : exit status 60 (11.587457257s)

                                                
                                                
-- stdout --
	* [calico-903000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "calico-903000" primary control-plane node in "calico-903000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "calico-903000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:12:12.672760    5154 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:12:12.673035    5154 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:12:12.673040    5154 out.go:304] Setting ErrFile to fd 2...
	I0307 14:12:12.673044    5154 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:12:12.673211    5154 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:12:12.674616    5154 out.go:298] Setting JSON to false
	I0307 14:12:12.696719    5154 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2503,"bootTime":1709847029,"procs":530,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:12:12.696814    5154 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:12:12.703316    5154 out.go:177] * [calico-903000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:12:12.747048    5154 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:12:12.747096    5154 notify.go:220] Checking for updates...
	I0307 14:12:12.790806    5154 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:12:12.812958    5154 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:12:12.834674    5154 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:12:12.856039    5154 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:12.877862    5154 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:12:12.899742    5154 config.go:182] Loaded profile config "kindnet-903000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:12:12.899931    5154 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:12:12.900097    5154 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:12:12.929960    5154 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:12:12.971792    5154 start.go:297] selected driver: hyperkit
	I0307 14:12:12.971815    5154 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:12:12.971832    5154 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:12:12.974866    5154 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:12:12.974974    5154 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:12:12.982618    5154 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:12:12.986343    5154 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:12.986364    5154 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:12:12.986399    5154 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:12:12.986623    5154 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:12:12.986683    5154 cni.go:84] Creating CNI manager for "calico"
	I0307 14:12:12.986691    5154 start_flags.go:319] Found "Calico" CNI - setting NetworkPlugin=cni
	I0307 14:12:12.986757    5154 start.go:340] cluster config:
	{Name:calico-903000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:calico-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunti
me:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSoc
k: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:12:12.986854    5154 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:12:13.035008    5154 out.go:177] * Starting "calico-903000" primary control-plane node in "calico-903000" cluster
	I0307 14:12:13.056702    5154 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:12:13.056771    5154 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:12:13.056799    5154 cache.go:56] Caching tarball of preloaded images
	I0307 14:12:13.056994    5154 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:12:13.057013    5154 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:12:13.057153    5154 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/calico-903000/config.json ...
	I0307 14:12:13.057188    5154 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/calico-903000/config.json: {Name:mk00b5b8ab7b095941ae4e824d40045e33c8e380 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:12:13.057922    5154 start.go:360] acquireMachinesLock for calico-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:12:13.058028    5154 start.go:364] duration metric: took 86.175µs to acquireMachinesLock for "calico-903000"
	I0307 14:12:13.058084    5154 start.go:93] Provisioning new machine with config: &{Name:calico-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:calico-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:12:13.058166    5154 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:12:13.079890    5154 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:12:13.080102    5154 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:13.080172    5154 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:13.088448    5154 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51060
	I0307 14:12:13.088830    5154 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:13.089253    5154 main.go:141] libmachine: Using API Version  1
	I0307 14:12:13.089264    5154 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:13.089474    5154 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:13.089571    5154 main.go:141] libmachine: (calico-903000) Calling .GetMachineName
	I0307 14:12:13.089654    5154 main.go:141] libmachine: (calico-903000) Calling .DriverName
	I0307 14:12:13.089748    5154 start.go:159] libmachine.API.Create for "calico-903000" (driver="hyperkit")
	I0307 14:12:13.089773    5154 client.go:168] LocalClient.Create starting
	I0307 14:12:13.089808    5154 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:12:13.089856    5154 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:13.089874    5154 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:13.089923    5154 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:12:13.089958    5154 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:13.089970    5154 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:13.089983    5154 main.go:141] libmachine: Running pre-create checks...
	I0307 14:12:13.089993    5154 main.go:141] libmachine: (calico-903000) Calling .PreCreateCheck
	I0307 14:12:13.090066    5154 main.go:141] libmachine: (calico-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:13.090223    5154 main.go:141] libmachine: (calico-903000) Calling .GetConfigRaw
	I0307 14:12:13.101201    5154 main.go:141] libmachine: Creating machine...
	I0307 14:12:13.101219    5154 main.go:141] libmachine: (calico-903000) Calling .Create
	I0307 14:12:13.101395    5154 main.go:141] libmachine: (calico-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:13.101562    5154 main.go:141] libmachine: (calico-903000) DBG | I0307 14:12:13.101368    5162 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:13.101657    5154 main.go:141] libmachine: (calico-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:12:13.273860    5154 main.go:141] libmachine: (calico-903000) DBG | I0307 14:12:13.273791    5162 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/calico-903000/id_rsa...
	I0307 14:12:13.429537    5154 main.go:141] libmachine: (calico-903000) DBG | I0307 14:12:13.429450    5162 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/calico-903000/calico-903000.rawdisk...
	I0307 14:12:13.429550    5154 main.go:141] libmachine: (calico-903000) DBG | Writing magic tar header
	I0307 14:12:13.429558    5154 main.go:141] libmachine: (calico-903000) DBG | Writing SSH key tar header
	I0307 14:12:13.430369    5154 main.go:141] libmachine: (calico-903000) DBG | I0307 14:12:13.430273    5162 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/calico-903000 ...
	I0307 14:12:13.788209    5154 main.go:141] libmachine: (calico-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:13.788236    5154 main.go:141] libmachine: (calico-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/calico-903000/hyperkit.pid
	I0307 14:12:13.788266    5154 main.go:141] libmachine: (calico-903000) DBG | Using UUID 63caebd9-c233-4008-9293-a021b82809cb
	I0307 14:12:13.824909    5154 main.go:141] libmachine: (calico-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:12:13.824999    5154 client.go:171] duration metric: took 735.211081ms to LocalClient.Create
	I0307 14:12:15.825760    5154 start.go:128] duration metric: took 2.767558289s to createHost
	I0307 14:12:15.825783    5154 start.go:83] releasing machines lock for "calico-903000", held for 2.767723141s
	W0307 14:12:15.825806    5154 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:12:15.826252    5154 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:15.826282    5154 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:15.834540    5154 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51062
	I0307 14:12:15.834922    5154 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:15.835255    5154 main.go:141] libmachine: Using API Version  1
	I0307 14:12:15.835266    5154 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:15.835473    5154 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:15.835829    5154 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:15.835852    5154 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:15.843668    5154 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51064
	I0307 14:12:15.844000    5154 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:15.844315    5154 main.go:141] libmachine: Using API Version  1
	I0307 14:12:15.844327    5154 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:15.844547    5154 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:15.844651    5154 main.go:141] libmachine: (calico-903000) Calling .GetState
	I0307 14:12:15.844732    5154 main.go:141] libmachine: (calico-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:15.844754    5154 main.go:141] libmachine: (calico-903000) DBG | hyperkit pid from json: 0
	I0307 14:12:15.844767    5154 main.go:141] libmachine: (calico-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/calico-903000/hyperkit.json: no such file or directory
	I0307 14:12:15.844829    5154 main.go:141] libmachine: (calico-903000) Calling .DriverName
	I0307 14:12:15.902512    5154 out.go:177] * Deleting "calico-903000" in hyperkit ...
	I0307 14:12:15.925496    5154 main.go:141] libmachine: (calico-903000) Calling .Remove
	I0307 14:12:15.925779    5154 main.go:141] libmachine: (calico-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:15.925806    5154 main.go:141] libmachine: (calico-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:15.925834    5154 main.go:141] libmachine: (calico-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/calico-903000/hyperkit.json: no such file or directory
	I0307 14:12:15.925897    5154 main.go:141] libmachine: (calico-903000) DBG | hyperkit pid from json: 0
	W0307 14:12:15.943612    5154 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:12:15.943626    5154 start.go:728] Will try again in 5 seconds ...
	I0307 14:12:20.943852    5154 start.go:360] acquireMachinesLock for calico-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:12:20.943962    5154 start.go:364] duration metric: took 76.197µs to acquireMachinesLock for "calico-903000"
	I0307 14:12:20.943979    5154 start.go:93] Provisioning new machine with config: &{Name:calico-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:calico-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:calico} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:12:20.944037    5154 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:12:20.985816    5154 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:12:20.986024    5154 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:20.986067    5154 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:20.994972    5154 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51086
	I0307 14:12:20.995348    5154 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:20.995696    5154 main.go:141] libmachine: Using API Version  1
	I0307 14:12:20.995722    5154 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:20.995956    5154 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:20.996065    5154 main.go:141] libmachine: (calico-903000) Calling .GetMachineName
	I0307 14:12:20.996179    5154 main.go:141] libmachine: (calico-903000) Calling .DriverName
	I0307 14:12:20.996307    5154 start.go:159] libmachine.API.Create for "calico-903000" (driver="hyperkit")
	I0307 14:12:20.996324    5154 client.go:168] LocalClient.Create starting
	I0307 14:12:20.996353    5154 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:12:20.996399    5154 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:20.996414    5154 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:20.996457    5154 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:12:20.996500    5154 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:20.996515    5154 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:20.996527    5154 main.go:141] libmachine: Running pre-create checks...
	I0307 14:12:20.996538    5154 main.go:141] libmachine: (calico-903000) Calling .PreCreateCheck
	I0307 14:12:20.996645    5154 main.go:141] libmachine: (calico-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:20.996682    5154 main.go:141] libmachine: (calico-903000) Calling .GetConfigRaw
	I0307 14:12:20.997116    5154 main.go:141] libmachine: Creating machine...
	I0307 14:12:20.997124    5154 main.go:141] libmachine: (calico-903000) Calling .Create
	I0307 14:12:20.997204    5154 main.go:141] libmachine: (calico-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:20.997317    5154 main.go:141] libmachine: (calico-903000) DBG | I0307 14:12:20.997191    5216 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:20.997400    5154 main.go:141] libmachine: (calico-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:12:21.259269    5154 main.go:141] libmachine: (calico-903000) DBG | I0307 14:12:21.259204    5216 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/calico-903000/id_rsa...
	I0307 14:12:21.400826    5154 main.go:141] libmachine: (calico-903000) DBG | I0307 14:12:21.400767    5216 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/calico-903000/calico-903000.rawdisk...
	I0307 14:12:21.400844    5154 main.go:141] libmachine: (calico-903000) DBG | Writing magic tar header
	I0307 14:12:21.400853    5154 main.go:141] libmachine: (calico-903000) DBG | Writing SSH key tar header
	I0307 14:12:21.401480    5154 main.go:141] libmachine: (calico-903000) DBG | I0307 14:12:21.401434    5216 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/calico-903000 ...
	I0307 14:12:21.855235    5154 main.go:141] libmachine: (calico-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:21.855253    5154 main.go:141] libmachine: (calico-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/calico-903000/hyperkit.pid
	I0307 14:12:21.855278    5154 main.go:141] libmachine: (calico-903000) DBG | Using UUID 4e389ffb-c22b-4024-9a25-2b6c7a04fc77
	I0307 14:12:21.987768    5154 main.go:141] libmachine: (calico-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:12:21.987838    5154 client.go:171] duration metric: took 991.501018ms to LocalClient.Create
	I0307 14:12:23.987980    5154 start.go:128] duration metric: took 3.043910278s to createHost
	I0307 14:12:23.987994    5154 start.go:83] releasing machines lock for "calico-903000", held for 3.044003453s
	W0307 14:12:23.988057    5154 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p calico-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p calico-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:12:24.030590    5154 out.go:177] 
	W0307 14:12:24.074503    5154 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:12:24.074574    5154 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:12:24.074596    5154 out.go:239] * Related issues:
	* Related issues:
	W0307 14:12:24.074622    5154 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:12:24.074661    5154 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:12:24.138476    5154 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/calico/Start (11.59s)

                                                
                                    
x
+
TestNetworkPlugins/group/custom-flannel/Start (11.81s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/custom-flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p custom-flannel-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p custom-flannel-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=testdata/kube-flannel.yaml --driver=hyperkit : exit status 60 (11.807602772s)

                                                
                                                
-- stdout --
	* [custom-flannel-903000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "custom-flannel-903000" primary control-plane node in "custom-flannel-903000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "custom-flannel-903000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:12:25.518392    5334 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:12:25.518563    5334 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:12:25.518568    5334 out.go:304] Setting ErrFile to fd 2...
	I0307 14:12:25.518572    5334 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:12:25.518758    5334 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:12:25.520442    5334 out.go:298] Setting JSON to false
	I0307 14:12:25.544680    5334 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2516,"bootTime":1709847029,"procs":531,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:12:25.544775    5334 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:12:25.566849    5334 out.go:177] * [custom-flannel-903000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:12:25.608628    5334 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:12:25.608643    5334 notify.go:220] Checking for updates...
	I0307 14:12:25.650340    5334 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:12:25.671476    5334 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:12:25.692554    5334 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:12:25.713378    5334 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:25.755518    5334 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:12:25.777312    5334 config.go:182] Loaded profile config "calico-903000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:12:25.777520    5334 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:12:25.777679    5334 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:12:25.807646    5334 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:12:25.850427    5334 start.go:297] selected driver: hyperkit
	I0307 14:12:25.850450    5334 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:12:25.850466    5334 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:12:25.853902    5334 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:12:25.854013    5334 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:12:25.861736    5334 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:12:25.865525    5334 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:25.865550    5334 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:12:25.865583    5334 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:12:25.865806    5334 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:12:25.865863    5334 cni.go:84] Creating CNI manager for "testdata/kube-flannel.yaml"
	I0307 14:12:25.865887    5334 start_flags.go:319] Found "testdata/kube-flannel.yaml" CNI - setting NetworkPlugin=cni
	I0307 14:12:25.865954    5334 start.go:340] cluster config:
	{Name:custom-flannel-903000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loca
l ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: S
ocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:12:25.866036    5334 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:12:25.914652    5334 out.go:177] * Starting "custom-flannel-903000" primary control-plane node in "custom-flannel-903000" cluster
	I0307 14:12:25.958772    5334 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:12:25.958872    5334 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:12:25.958891    5334 cache.go:56] Caching tarball of preloaded images
	I0307 14:12:25.959045    5334 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:12:25.959058    5334 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:12:25.959170    5334 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/custom-flannel-903000/config.json ...
	I0307 14:12:25.959199    5334 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/custom-flannel-903000/config.json: {Name:mke0dc9336428baf822efd23a8f10d419b67b21b Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:12:25.980295    5334 start.go:360] acquireMachinesLock for custom-flannel-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:12:25.980436    5334 start.go:364] duration metric: took 99.295µs to acquireMachinesLock for "custom-flannel-903000"
	I0307 14:12:25.980482    5334 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mou
ntMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:12:25.980580    5334 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:12:26.024630    5334 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:12:26.024785    5334 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:26.024828    5334 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:26.033542    5334 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51156
	I0307 14:12:26.033964    5334 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:26.034412    5334 main.go:141] libmachine: Using API Version  1
	I0307 14:12:26.034421    5334 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:26.034693    5334 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:26.034866    5334 main.go:141] libmachine: (custom-flannel-903000) Calling .GetMachineName
	I0307 14:12:26.034968    5334 main.go:141] libmachine: (custom-flannel-903000) Calling .DriverName
	I0307 14:12:26.035071    5334 start.go:159] libmachine.API.Create for "custom-flannel-903000" (driver="hyperkit")
	I0307 14:12:26.035098    5334 client.go:168] LocalClient.Create starting
	I0307 14:12:26.035139    5334 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:12:26.035185    5334 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:26.035202    5334 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:26.035258    5334 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:12:26.035293    5334 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:26.035305    5334 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:26.035320    5334 main.go:141] libmachine: Running pre-create checks...
	I0307 14:12:26.035330    5334 main.go:141] libmachine: (custom-flannel-903000) Calling .PreCreateCheck
	I0307 14:12:26.035410    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:26.035606    5334 main.go:141] libmachine: (custom-flannel-903000) Calling .GetConfigRaw
	I0307 14:12:26.036089    5334 main.go:141] libmachine: Creating machine...
	I0307 14:12:26.036097    5334 main.go:141] libmachine: (custom-flannel-903000) Calling .Create
	I0307 14:12:26.036169    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:26.036297    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | I0307 14:12:26.036161    5352 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:26.036349    5334 main.go:141] libmachine: (custom-flannel-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:12:26.511205    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | I0307 14:12:26.511103    5352 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/custom-flannel-903000/id_rsa...
	I0307 14:12:26.778439    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | I0307 14:12:26.778351    5352 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/custom-flannel-903000/custom-flannel-903000.rawdisk...
	I0307 14:12:26.778453    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | Writing magic tar header
	I0307 14:12:26.778463    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | Writing SSH key tar header
	I0307 14:12:26.779225    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | I0307 14:12:26.779183    5352 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/custom-flannel-903000 ...
	I0307 14:12:27.138976    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:27.138991    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/custom-flannel-903000/hyperkit.pid
	I0307 14:12:27.139037    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | Using UUID fdffbcca-3643-4f15-99eb-b02c677b1b23
	I0307 14:12:27.306642    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:12:27.306686    5334 client.go:171] duration metric: took 1.271570265s to LocalClient.Create
	I0307 14:12:29.306913    5334 start.go:128] duration metric: took 3.326286594s to createHost
	I0307 14:12:29.306933    5334 start.go:83] releasing machines lock for "custom-flannel-903000", held for 3.326460516s
	W0307 14:12:29.306960    5334 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:12:29.307258    5334 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:29.307281    5334 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:29.315313    5334 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51196
	I0307 14:12:29.315719    5334 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:29.316119    5334 main.go:141] libmachine: Using API Version  1
	I0307 14:12:29.316133    5334 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:29.316359    5334 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:29.316709    5334 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:29.316736    5334 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:29.324956    5334 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51198
	I0307 14:12:29.325338    5334 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:29.325724    5334 main.go:141] libmachine: Using API Version  1
	I0307 14:12:29.325738    5334 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:29.325939    5334 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:29.326089    5334 main.go:141] libmachine: (custom-flannel-903000) Calling .GetState
	I0307 14:12:29.326208    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:29.326266    5334 main.go:141] libmachine: (custom-flannel-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/custom-flannel-903000/hyperkit.json: no such file or directory
	I0307 14:12:29.326283    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | hyperkit pid from json: 0
	I0307 14:12:29.326323    5334 main.go:141] libmachine: (custom-flannel-903000) Calling .DriverName
	I0307 14:12:29.368243    5334 out.go:177] * Deleting "custom-flannel-903000" in hyperkit ...
	I0307 14:12:29.389587    5334 main.go:141] libmachine: (custom-flannel-903000) Calling .Remove
	I0307 14:12:29.389934    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:29.389975    5334 main.go:141] libmachine: (custom-flannel-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/custom-flannel-903000/hyperkit.json: no such file or directory
	I0307 14:12:29.389989    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:29.390015    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | hyperkit pid from json: 0
	W0307 14:12:29.467704    5334 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:12:29.467716    5334 start.go:728] Will try again in 5 seconds ...
	I0307 14:12:34.467852    5334 start.go:360] acquireMachinesLock for custom-flannel-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:12:34.467999    5334 start.go:364] duration metric: took 123.357µs to acquireMachinesLock for "custom-flannel-903000"
	I0307 14:12:34.468032    5334 start.go:93] Provisioning new machine with config: &{Name:custom-flannel-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.28.4 ClusterName:custom-flannel-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:testdata/kube-flannel.yaml} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: Mou
ntMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:12:34.468112    5334 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:12:34.489701    5334 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:12:34.489877    5334 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:34.489922    5334 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:34.499891    5334 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51230
	I0307 14:12:34.500409    5334 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:34.500771    5334 main.go:141] libmachine: Using API Version  1
	I0307 14:12:34.500780    5334 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:34.500997    5334 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:34.501108    5334 main.go:141] libmachine: (custom-flannel-903000) Calling .GetMachineName
	I0307 14:12:34.501196    5334 main.go:141] libmachine: (custom-flannel-903000) Calling .DriverName
	I0307 14:12:34.501297    5334 start.go:159] libmachine.API.Create for "custom-flannel-903000" (driver="hyperkit")
	I0307 14:12:34.501312    5334 client.go:168] LocalClient.Create starting
	I0307 14:12:34.501337    5334 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:12:34.501418    5334 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:34.501428    5334 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:34.501506    5334 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:12:34.501569    5334 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:34.501581    5334 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:34.501598    5334 main.go:141] libmachine: Running pre-create checks...
	I0307 14:12:34.501605    5334 main.go:141] libmachine: (custom-flannel-903000) Calling .PreCreateCheck
	I0307 14:12:34.501699    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:34.501735    5334 main.go:141] libmachine: (custom-flannel-903000) Calling .GetConfigRaw
	I0307 14:12:34.502326    5334 main.go:141] libmachine: Creating machine...
	I0307 14:12:34.502335    5334 main.go:141] libmachine: (custom-flannel-903000) Calling .Create
	I0307 14:12:34.502413    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:34.502539    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | I0307 14:12:34.502403    5474 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:34.502579    5334 main.go:141] libmachine: (custom-flannel-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:12:34.676918    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | I0307 14:12:34.676857    5474 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/custom-flannel-903000/id_rsa...
	I0307 14:12:34.741290    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | I0307 14:12:34.741206    5474 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/custom-flannel-903000/custom-flannel-903000.rawdisk...
	I0307 14:12:34.741304    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | Writing magic tar header
	I0307 14:12:34.741318    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | Writing SSH key tar header
	I0307 14:12:34.742221    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | I0307 14:12:34.742115    5474 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/custom-flannel-903000 ...
	I0307 14:12:35.098685    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:35.098701    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/custom-flannel-903000/hyperkit.pid
	I0307 14:12:35.098759    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | Using UUID 6ab8035f-9be3-4d13-994b-26ab1817462b
	I0307 14:12:35.134425    5334 main.go:141] libmachine: (custom-flannel-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:12:35.134508    5334 client.go:171] duration metric: took 633.186107ms to LocalClient.Create
	I0307 14:12:37.136112    5334 start.go:128] duration metric: took 2.667967186s to createHost
	I0307 14:12:37.136142    5334 start.go:83] releasing machines lock for "custom-flannel-903000", held for 2.668113663s
	W0307 14:12:37.136270    5334 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p custom-flannel-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p custom-flannel-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:12:37.158196    5334 out.go:177] 
	W0307 14:12:37.179854    5334 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:12:37.179966    5334 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:12:37.180009    5334 out.go:239] * Related issues:
	* Related issues:
	W0307 14:12:37.180031    5334 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:12:37.180060    5334 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:12:37.201828    5334 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/custom-flannel/Start (11.81s)

                                                
                                    
x
+
TestNetworkPlugins/group/false/Start (11.65s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/false/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p false-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p false-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=false --driver=hyperkit : exit status 60 (11.65017938s)

                                                
                                                
-- stdout --
	* [false-903000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "false-903000" primary control-plane node in "false-903000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "false-903000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:12:30.888999    5460 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:12:30.889667    5460 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:12:30.889675    5460 out.go:304] Setting ErrFile to fd 2...
	I0307 14:12:30.889681    5460 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:12:30.890089    5460 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:12:30.891828    5460 out.go:298] Setting JSON to false
	I0307 14:12:30.914289    5460 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2521,"bootTime":1709847029,"procs":548,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:12:30.914390    5460 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:12:30.936369    5460 out.go:177] * [false-903000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:12:30.978874    5460 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:12:30.978939    5460 notify.go:220] Checking for updates...
	I0307 14:12:31.024093    5460 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:12:31.068695    5460 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:12:31.088901    5460 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:12:31.109835    5460 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:31.130907    5460 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:12:31.152999    5460 config.go:182] Loaded profile config "custom-flannel-903000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:12:31.153201    5460 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:12:31.153348    5460 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:12:31.182833    5460 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:12:31.224818    5460 start.go:297] selected driver: hyperkit
	I0307 14:12:31.224851    5460 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:12:31.224871    5460 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:12:31.229290    5460 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:12:31.229399    5460 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:12:31.237235    5460 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:12:31.241046    5460 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:31.241074    5460 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:12:31.241113    5460 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:12:31.241328    5460 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:12:31.241387    5460 cni.go:84] Creating CNI manager for "false"
	I0307 14:12:31.241468    5460 start.go:340] cluster config:
	{Name:false-903000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:false-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime
:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSH
AgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:12:31.241551    5460 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:12:31.283695    5460 out.go:177] * Starting "false-903000" primary control-plane node in "false-903000" cluster
	I0307 14:12:31.304939    5460 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:12:31.305028    5460 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:12:31.305065    5460 cache.go:56] Caching tarball of preloaded images
	I0307 14:12:31.305255    5460 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:12:31.305273    5460 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:12:31.305405    5460 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/false-903000/config.json ...
	I0307 14:12:31.305438    5460 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/false-903000/config.json: {Name:mk7c86403e9f689656fdb232e6059f54807c2160 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:12:31.306049    5460 start.go:360] acquireMachinesLock for false-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:12:31.306160    5460 start.go:364] duration metric: took 88.472µs to acquireMachinesLock for "false-903000"
	I0307 14:12:31.306203    5460 start.go:93] Provisioning new machine with config: &{Name:false-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Ku
bernetesVersion:v1.28.4 ClusterName:false-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0
MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:12:31.306309    5460 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:12:31.327682    5460 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:12:31.327865    5460 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:31.327921    5460 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:31.336325    5460 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51224
	I0307 14:12:31.336685    5460 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:31.337107    5460 main.go:141] libmachine: Using API Version  1
	I0307 14:12:31.337117    5460 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:31.337314    5460 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:31.337414    5460 main.go:141] libmachine: (false-903000) Calling .GetMachineName
	I0307 14:12:31.337494    5460 main.go:141] libmachine: (false-903000) Calling .DriverName
	I0307 14:12:31.337581    5460 start.go:159] libmachine.API.Create for "false-903000" (driver="hyperkit")
	I0307 14:12:31.337605    5460 client.go:168] LocalClient.Create starting
	I0307 14:12:31.337636    5460 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:12:31.337685    5460 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:31.337699    5460 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:31.337768    5460 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:12:31.337805    5460 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:31.337817    5460 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:31.337829    5460 main.go:141] libmachine: Running pre-create checks...
	I0307 14:12:31.337840    5460 main.go:141] libmachine: (false-903000) Calling .PreCreateCheck
	I0307 14:12:31.337919    5460 main.go:141] libmachine: (false-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:31.338182    5460 main.go:141] libmachine: (false-903000) Calling .GetConfigRaw
	I0307 14:12:31.348947    5460 main.go:141] libmachine: Creating machine...
	I0307 14:12:31.348955    5460 main.go:141] libmachine: (false-903000) Calling .Create
	I0307 14:12:31.349054    5460 main.go:141] libmachine: (false-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:31.349169    5460 main.go:141] libmachine: (false-903000) DBG | I0307 14:12:31.349030    5468 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:31.349214    5460 main.go:141] libmachine: (false-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:12:31.520359    5460 main.go:141] libmachine: (false-903000) DBG | I0307 14:12:31.520305    5468 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/false-903000/id_rsa...
	I0307 14:12:31.661669    5460 main.go:141] libmachine: (false-903000) DBG | I0307 14:12:31.661587    5468 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/false-903000/false-903000.rawdisk...
	I0307 14:12:31.661681    5460 main.go:141] libmachine: (false-903000) DBG | Writing magic tar header
	I0307 14:12:31.661688    5460 main.go:141] libmachine: (false-903000) DBG | Writing SSH key tar header
	I0307 14:12:31.662492    5460 main.go:141] libmachine: (false-903000) DBG | I0307 14:12:31.662397    5468 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/false-903000 ...
	I0307 14:12:32.077335    5460 main.go:141] libmachine: (false-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:32.077356    5460 main.go:141] libmachine: (false-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/false-903000/hyperkit.pid
	I0307 14:12:32.077387    5460 main.go:141] libmachine: (false-903000) DBG | Using UUID cf96d8dd-1395-4e29-843f-a8f881a22803
	I0307 14:12:32.114686    5460 main.go:141] libmachine: (false-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:12:32.114772    5460 client.go:171] duration metric: took 777.151696ms to LocalClient.Create
	I0307 14:12:34.117034    5460 start.go:128] duration metric: took 2.8106665s to createHost
	I0307 14:12:34.117063    5460 start.go:83] releasing machines lock for "false-903000", held for 2.810870961s
	W0307 14:12:34.117100    5460 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:12:34.117524    5460 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:34.117555    5460 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:34.126484    5460 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51226
	I0307 14:12:34.127007    5460 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:34.127475    5460 main.go:141] libmachine: Using API Version  1
	I0307 14:12:34.127510    5460 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:34.127730    5460 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:34.128082    5460 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:34.128108    5460 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:34.136484    5460 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51228
	I0307 14:12:34.136830    5460 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:34.137181    5460 main.go:141] libmachine: Using API Version  1
	I0307 14:12:34.137192    5460 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:34.137409    5460 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:34.137515    5460 main.go:141] libmachine: (false-903000) Calling .GetState
	I0307 14:12:34.137595    5460 main.go:141] libmachine: (false-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:34.137608    5460 main.go:141] libmachine: (false-903000) DBG | hyperkit pid from json: 0
	I0307 14:12:34.137622    5460 main.go:141] libmachine: (false-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/false-903000/hyperkit.json: no such file or directory
	I0307 14:12:34.137654    5460 main.go:141] libmachine: (false-903000) Calling .DriverName
	I0307 14:12:34.188194    5460 out.go:177] * Deleting "false-903000" in hyperkit ...
	I0307 14:12:34.210155    5460 main.go:141] libmachine: (false-903000) Calling .Remove
	I0307 14:12:34.210468    5460 main.go:141] libmachine: (false-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:34.210496    5460 main.go:141] libmachine: (false-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:34.210515    5460 main.go:141] libmachine: (false-903000) DBG | hyperkit pid from json: 0
	I0307 14:12:34.210550    5460 main.go:141] libmachine: (false-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/false-903000/hyperkit.json: no such file or directory
	W0307 14:12:34.226664    5460 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:12:34.226678    5460 start.go:728] Will try again in 5 seconds ...
	I0307 14:12:39.228271    5460 start.go:360] acquireMachinesLock for false-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:12:39.228452    5460 start.go:364] duration metric: took 123.841µs to acquireMachinesLock for "false-903000"
	I0307 14:12:39.228486    5460 start.go:93] Provisioning new machine with config: &{Name:false-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{Ku
bernetesVersion:v1.28.4 ClusterName:false-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:false} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0
MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:12:39.228570    5460 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:12:39.271161    5460 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:12:39.271240    5460 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:39.271266    5460 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:39.279668    5460 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51250
	I0307 14:12:39.280047    5460 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:39.280412    5460 main.go:141] libmachine: Using API Version  1
	I0307 14:12:39.280423    5460 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:39.280617    5460 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:39.280714    5460 main.go:141] libmachine: (false-903000) Calling .GetMachineName
	I0307 14:12:39.280800    5460 main.go:141] libmachine: (false-903000) Calling .DriverName
	I0307 14:12:39.280896    5460 start.go:159] libmachine.API.Create for "false-903000" (driver="hyperkit")
	I0307 14:12:39.280911    5460 client.go:168] LocalClient.Create starting
	I0307 14:12:39.280945    5460 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:12:39.280980    5460 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:39.280992    5460 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:39.281029    5460 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:12:39.281056    5460 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:39.281071    5460 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:39.281091    5460 main.go:141] libmachine: Running pre-create checks...
	I0307 14:12:39.281103    5460 main.go:141] libmachine: (false-903000) Calling .PreCreateCheck
	I0307 14:12:39.281177    5460 main.go:141] libmachine: (false-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:39.281201    5460 main.go:141] libmachine: (false-903000) Calling .GetConfigRaw
	I0307 14:12:39.281624    5460 main.go:141] libmachine: Creating machine...
	I0307 14:12:39.281632    5460 main.go:141] libmachine: (false-903000) Calling .Create
	I0307 14:12:39.281711    5460 main.go:141] libmachine: (false-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:39.281825    5460 main.go:141] libmachine: (false-903000) DBG | I0307 14:12:39.281700    5526 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:39.281904    5460 main.go:141] libmachine: (false-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:12:39.553755    5460 main.go:141] libmachine: (false-903000) DBG | I0307 14:12:39.553691    5526 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/false-903000/id_rsa...
	I0307 14:12:39.816844    5460 main.go:141] libmachine: (false-903000) DBG | I0307 14:12:39.816718    5526 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/false-903000/false-903000.rawdisk...
	I0307 14:12:39.816905    5460 main.go:141] libmachine: (false-903000) DBG | Writing magic tar header
	I0307 14:12:39.816935    5460 main.go:141] libmachine: (false-903000) DBG | Writing SSH key tar header
	I0307 14:12:39.838704    5460 main.go:141] libmachine: (false-903000) DBG | I0307 14:12:39.838582    5526 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/false-903000 ...
	I0307 14:12:40.308970    5460 main.go:141] libmachine: (false-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:40.308991    5460 main.go:141] libmachine: (false-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/false-903000/hyperkit.pid
	I0307 14:12:40.309044    5460 main.go:141] libmachine: (false-903000) DBG | Using UUID 8dec579e-9af7-4a0a-8f06-a2450878f024
	I0307 14:12:40.347469    5460 main.go:141] libmachine: (false-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:12:40.347573    5460 client.go:171] duration metric: took 1.066646511s to LocalClient.Create
	I0307 14:12:42.349780    5460 start.go:128] duration metric: took 3.12117102s to createHost
	I0307 14:12:42.349837    5460 start.go:83] releasing machines lock for "false-903000", held for 3.121349697s
	W0307 14:12:42.349981    5460 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p false-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p false-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:12:42.375684    5460 out.go:177] 
	W0307 14:12:42.396646    5460 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:12:42.396682    5460 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:12:42.396692    5460 out.go:239] * Related issues:
	* Related issues:
	W0307 14:12:42.396719    5460 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:12:42.396738    5460 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:12:42.417819    5460 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/false/Start (11.65s)

                                                
                                    
x
+
TestNetworkPlugins/group/enable-default-cni/Start (12.11s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/enable-default-cni/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p enable-default-cni-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p enable-default-cni-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --enable-default-cni=true --driver=hyperkit : exit status 60 (12.104558744s)

                                                
                                                
-- stdout --
	* [enable-default-cni-903000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "enable-default-cni-903000" primary control-plane node in "enable-default-cni-903000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "enable-default-cni-903000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:12:43.967426    5654 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:12:43.968226    5654 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:12:43.968236    5654 out.go:304] Setting ErrFile to fd 2...
	I0307 14:12:43.968242    5654 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:12:43.968856    5654 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:12:43.970598    5654 out.go:298] Setting JSON to false
	I0307 14:12:43.994564    5654 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2534,"bootTime":1709847029,"procs":536,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:12:43.994667    5654 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:12:44.016046    5654 out.go:177] * [enable-default-cni-903000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:12:44.058460    5654 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:12:44.058494    5654 notify.go:220] Checking for updates...
	I0307 14:12:44.080525    5654 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:12:44.101539    5654 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:12:44.143719    5654 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:12:44.201868    5654 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:44.264570    5654 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:12:44.307539    5654 config.go:182] Loaded profile config "false-903000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:12:44.307780    5654 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:12:44.307925    5654 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:12:44.348435    5654 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:12:44.390603    5654 start.go:297] selected driver: hyperkit
	I0307 14:12:44.390614    5654 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:12:44.390626    5654 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:12:44.393729    5654 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:12:44.393849    5654 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:12:44.401478    5654 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:12:44.405491    5654 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:44.405512    5654 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:12:44.405549    5654 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	E0307 14:12:44.405744    5654 start_flags.go:464] Found deprecated --enable-default-cni flag, setting --cni=bridge
	I0307 14:12:44.405766    5654 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:12:44.405822    5654 cni.go:84] Creating CNI manager for "bridge"
	I0307 14:12:44.405829    5654 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 14:12:44.405901    5654 start.go:340] cluster config:
	{Name:enable-default-cni-903000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:clus
ter.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPa
th: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:12:44.405988    5654 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:12:44.466732    5654 out.go:177] * Starting "enable-default-cni-903000" primary control-plane node in "enable-default-cni-903000" cluster
	I0307 14:12:44.509525    5654 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:12:44.509565    5654 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:12:44.509587    5654 cache.go:56] Caching tarball of preloaded images
	I0307 14:12:44.509696    5654 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:12:44.509705    5654 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:12:44.509785    5654 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/enable-default-cni-903000/config.json ...
	I0307 14:12:44.509803    5654 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/enable-default-cni-903000/config.json: {Name:mk1574d51f9dbb677174e3843769f2ab1c760c4c Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:12:44.530971    5654 start.go:360] acquireMachinesLock for enable-default-cni-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:12:44.531071    5654 start.go:364] duration metric: took 74.442µs to acquireMachinesLock for "enable-default-cni-903000"
	I0307 14:12:44.531106    5654 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:12:44.531179    5654 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:12:44.573433    5654 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:12:44.573580    5654 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:44.573616    5654 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:44.582668    5654 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51326
	I0307 14:12:44.583125    5654 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:44.583704    5654 main.go:141] libmachine: Using API Version  1
	I0307 14:12:44.583727    5654 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:44.583989    5654 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:44.584122    5654 main.go:141] libmachine: (enable-default-cni-903000) Calling .GetMachineName
	I0307 14:12:44.584261    5654 main.go:141] libmachine: (enable-default-cni-903000) Calling .DriverName
	I0307 14:12:44.584369    5654 start.go:159] libmachine.API.Create for "enable-default-cni-903000" (driver="hyperkit")
	I0307 14:12:44.584403    5654 client.go:168] LocalClient.Create starting
	I0307 14:12:44.584440    5654 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:12:44.584502    5654 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:44.584520    5654 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:44.584580    5654 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:12:44.584622    5654 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:44.584632    5654 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:44.584644    5654 main.go:141] libmachine: Running pre-create checks...
	I0307 14:12:44.584660    5654 main.go:141] libmachine: (enable-default-cni-903000) Calling .PreCreateCheck
	I0307 14:12:44.584743    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:44.584950    5654 main.go:141] libmachine: (enable-default-cni-903000) Calling .GetConfigRaw
	I0307 14:12:44.585390    5654 main.go:141] libmachine: Creating machine...
	I0307 14:12:44.585399    5654 main.go:141] libmachine: (enable-default-cni-903000) Calling .Create
	I0307 14:12:44.585479    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:44.585601    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | I0307 14:12:44.585468    5672 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:44.585660    5654 main.go:141] libmachine: (enable-default-cni-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:12:45.036625    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | I0307 14:12:45.036545    5672 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/enable-default-cni-903000/id_rsa...
	I0307 14:12:45.301252    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | I0307 14:12:45.301075    5672 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/enable-default-cni-903000/enable-default-cni-903000.rawdisk...
	I0307 14:12:45.301289    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | Writing magic tar header
	I0307 14:12:45.301344    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | Writing SSH key tar header
	I0307 14:12:45.302192    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | I0307 14:12:45.302082    5672 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/enable-default-cni-903000 ...
	I0307 14:12:45.689601    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:45.689620    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/enable-default-cni-903000/hyperkit.pid
	I0307 14:12:45.689640    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | Using UUID 511b2e1f-3fc1-4fd6-9297-d3745f632c5f
	I0307 14:12:45.887396    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:12:45.887482    5654 client.go:171] duration metric: took 1.303059491s to LocalClient.Create
	I0307 14:12:47.887760    5654 start.go:128] duration metric: took 3.356540508s to createHost
	I0307 14:12:47.887778    5654 start.go:83] releasing machines lock for "enable-default-cni-903000", held for 3.356674717s
	W0307 14:12:47.887814    5654 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:12:47.888229    5654 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:47.888262    5654 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:47.896694    5654 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51370
	I0307 14:12:47.897077    5654 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:47.897403    5654 main.go:141] libmachine: Using API Version  1
	I0307 14:12:47.897415    5654 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:47.897632    5654 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:47.897975    5654 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:47.898001    5654 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:47.905669    5654 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51372
	I0307 14:12:47.906031    5654 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:47.906364    5654 main.go:141] libmachine: Using API Version  1
	I0307 14:12:47.906389    5654 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:47.906599    5654 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:47.906702    5654 main.go:141] libmachine: (enable-default-cni-903000) Calling .GetState
	I0307 14:12:47.906782    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:47.906810    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | hyperkit pid from json: 0
	I0307 14:12:47.906823    5654 main.go:141] libmachine: (enable-default-cni-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/enable-default-cni-903000/hyperkit.json: no such file or directory
	I0307 14:12:47.906878    5654 main.go:141] libmachine: (enable-default-cni-903000) Calling .DriverName
	I0307 14:12:47.967116    5654 out.go:177] * Deleting "enable-default-cni-903000" in hyperkit ...
	I0307 14:12:47.988120    5654 main.go:141] libmachine: (enable-default-cni-903000) Calling .Remove
	I0307 14:12:47.988281    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:47.988293    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:47.988306    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | hyperkit pid from json: 0
	I0307 14:12:47.988372    5654 main.go:141] libmachine: (enable-default-cni-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/enable-default-cni-903000/hyperkit.json: no such file or directory
	W0307 14:12:48.065812    5654 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:12:48.065829    5654 start.go:728] Will try again in 5 seconds ...
	I0307 14:12:53.066814    5654 start.go:360] acquireMachinesLock for enable-default-cni-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:12:53.067012    5654 start.go:364] duration metric: took 168.519µs to acquireMachinesLock for "enable-default-cni-903000"
	I0307 14:12:53.067083    5654 start.go:93] Provisioning new machine with config: &{Name:enable-default-cni-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kuberne
tesConfig:{KubernetesVersion:v1.28.4 ClusterName:enable-default-cni-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:2621
44 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:12:53.067193    5654 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:12:53.088141    5654 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:12:53.088299    5654 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:53.088341    5654 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:53.098219    5654 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51398
	I0307 14:12:53.098632    5654 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:53.098968    5654 main.go:141] libmachine: Using API Version  1
	I0307 14:12:53.098978    5654 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:53.099199    5654 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:53.099295    5654 main.go:141] libmachine: (enable-default-cni-903000) Calling .GetMachineName
	I0307 14:12:53.099399    5654 main.go:141] libmachine: (enable-default-cni-903000) Calling .DriverName
	I0307 14:12:53.099495    5654 start.go:159] libmachine.API.Create for "enable-default-cni-903000" (driver="hyperkit")
	I0307 14:12:53.099516    5654 client.go:168] LocalClient.Create starting
	I0307 14:12:53.099546    5654 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:12:53.099591    5654 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:53.099602    5654 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:53.099640    5654 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:12:53.099675    5654 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:53.099686    5654 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:53.099698    5654 main.go:141] libmachine: Running pre-create checks...
	I0307 14:12:53.099704    5654 main.go:141] libmachine: (enable-default-cni-903000) Calling .PreCreateCheck
	I0307 14:12:53.099797    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:53.099839    5654 main.go:141] libmachine: (enable-default-cni-903000) Calling .GetConfigRaw
	I0307 14:12:53.100327    5654 main.go:141] libmachine: Creating machine...
	I0307 14:12:53.100344    5654 main.go:141] libmachine: (enable-default-cni-903000) Calling .Create
	I0307 14:12:53.100413    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:53.100538    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | I0307 14:12:53.100403    5781 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:53.100587    5654 main.go:141] libmachine: (enable-default-cni-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:12:53.274918    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | I0307 14:12:53.274851    5781 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/enable-default-cni-903000/id_rsa...
	I0307 14:12:53.441538    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | I0307 14:12:53.441445    5781 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/enable-default-cni-903000/enable-default-cni-903000.rawdisk...
	I0307 14:12:53.441551    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | Writing magic tar header
	I0307 14:12:53.441564    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | Writing SSH key tar header
	I0307 14:12:53.442137    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | I0307 14:12:53.442098    5781 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/enable-default-cni-903000 ...
	I0307 14:12:53.800840    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:53.800858    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/enable-default-cni-903000/hyperkit.pid
	I0307 14:12:53.800879    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | Using UUID 1c7f528a-d841-4c66-9182-9edcf3d097f3
	I0307 14:12:53.838570    5654 main.go:141] libmachine: (enable-default-cni-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:12:53.838645    5654 client.go:171] duration metric: took 739.11749ms to LocalClient.Create
	I0307 14:12:55.838947    5654 start.go:128] duration metric: took 2.771716661s to createHost
	I0307 14:12:55.838968    5654 start.go:83] releasing machines lock for "enable-default-cni-903000", held for 2.771927756s
	W0307 14:12:55.839060    5654 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p enable-default-cni-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p enable-default-cni-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:12:55.884463    5654 out.go:177] 
	W0307 14:12:55.906458    5654 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:12:55.906486    5654 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:12:55.906496    5654 out.go:239] * Related issues:
	* Related issues:
	W0307 14:12:55.906518    5654 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:12:55.906528    5654 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:12:55.927402    5654 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/enable-default-cni/Start (12.11s)

                                                
                                    
x
+
TestNetworkPlugins/group/flannel/Start (11.38s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/flannel/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p flannel-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p flannel-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=flannel --driver=hyperkit : exit status 60 (11.379019117s)

                                                
                                                
-- stdout --
	* [flannel-903000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "flannel-903000" primary control-plane node in "flannel-903000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "flannel-903000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:12:49.032584    5769 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:12:49.032847    5769 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:12:49.032853    5769 out.go:304] Setting ErrFile to fd 2...
	I0307 14:12:49.032857    5769 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:12:49.033045    5769 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:12:49.034487    5769 out.go:298] Setting JSON to false
	I0307 14:12:49.056860    5769 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2540,"bootTime":1709847029,"procs":558,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:12:49.056954    5769 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:12:49.078518    5769 out.go:177] * [flannel-903000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:12:49.120510    5769 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:12:49.120541    5769 notify.go:220] Checking for updates...
	I0307 14:12:49.162501    5769 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:12:49.183628    5769 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:12:49.204655    5769 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:12:49.227409    5769 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:49.247621    5769 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:12:49.269085    5769 config.go:182] Loaded profile config "enable-default-cni-903000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:12:49.269240    5769 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:12:49.269352    5769 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:12:49.298639    5769 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:12:49.340569    5769 start.go:297] selected driver: hyperkit
	I0307 14:12:49.340598    5769 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:12:49.340642    5769 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:12:49.344727    5769 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:12:49.344845    5769 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:12:49.353617    5769 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:12:49.357487    5769 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:49.357512    5769 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:12:49.357549    5769 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:12:49.357781    5769 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:12:49.357843    5769 cni.go:84] Creating CNI manager for "flannel"
	I0307 14:12:49.357855    5769 start_flags.go:319] Found "Flannel" CNI - setting NetworkPlugin=cni
	I0307 14:12:49.357915    5769 start.go:340] cluster config:
	{Name:flannel-903000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:flannel-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuth
Sock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:12:49.358000    5769 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:12:49.400751    5769 out.go:177] * Starting "flannel-903000" primary control-plane node in "flannel-903000" cluster
	I0307 14:12:49.422540    5769 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:12:49.422634    5769 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:12:49.422654    5769 cache.go:56] Caching tarball of preloaded images
	I0307 14:12:49.422776    5769 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:12:49.422788    5769 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:12:49.422876    5769 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/flannel-903000/config.json ...
	I0307 14:12:49.422899    5769 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/flannel-903000/config.json: {Name:mk2563ecbe183c912f1bd4c78dcb7782105fec98 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:12:49.423249    5769 start.go:360] acquireMachinesLock for flannel-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:12:49.423312    5769 start.go:364] duration metric: took 51.056µs to acquireMachinesLock for "flannel-903000"
	I0307 14:12:49.423343    5769 start.go:93] Provisioning new machine with config: &{Name:flannel-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:flannel-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:12:49.423389    5769 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:12:49.466617    5769 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:12:49.466764    5769 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:49.466805    5769 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:49.474642    5769 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51392
	I0307 14:12:49.475038    5769 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:49.475465    5769 main.go:141] libmachine: Using API Version  1
	I0307 14:12:49.475476    5769 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:49.475684    5769 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:49.475785    5769 main.go:141] libmachine: (flannel-903000) Calling .GetMachineName
	I0307 14:12:49.475881    5769 main.go:141] libmachine: (flannel-903000) Calling .DriverName
	I0307 14:12:49.475983    5769 start.go:159] libmachine.API.Create for "flannel-903000" (driver="hyperkit")
	I0307 14:12:49.476008    5769 client.go:168] LocalClient.Create starting
	I0307 14:12:49.476041    5769 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:12:49.476095    5769 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:49.476109    5769 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:49.476172    5769 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:12:49.476208    5769 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:49.476220    5769 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:49.476236    5769 main.go:141] libmachine: Running pre-create checks...
	I0307 14:12:49.476246    5769 main.go:141] libmachine: (flannel-903000) Calling .PreCreateCheck
	I0307 14:12:49.476320    5769 main.go:141] libmachine: (flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:49.476519    5769 main.go:141] libmachine: (flannel-903000) Calling .GetConfigRaw
	I0307 14:12:49.476950    5769 main.go:141] libmachine: Creating machine...
	I0307 14:12:49.476958    5769 main.go:141] libmachine: (flannel-903000) Calling .Create
	I0307 14:12:49.477021    5769 main.go:141] libmachine: (flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:49.477140    5769 main.go:141] libmachine: (flannel-903000) DBG | I0307 14:12:49.477015    5777 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:49.477192    5769 main.go:141] libmachine: (flannel-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:12:49.652802    5769 main.go:141] libmachine: (flannel-903000) DBG | I0307 14:12:49.652751    5777 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/flannel-903000/id_rsa...
	I0307 14:12:49.692209    5769 main.go:141] libmachine: (flannel-903000) DBG | I0307 14:12:49.692134    5777 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/flannel-903000/flannel-903000.rawdisk...
	I0307 14:12:49.692220    5769 main.go:141] libmachine: (flannel-903000) DBG | Writing magic tar header
	I0307 14:12:49.692227    5769 main.go:141] libmachine: (flannel-903000) DBG | Writing SSH key tar header
	I0307 14:12:49.692717    5769 main.go:141] libmachine: (flannel-903000) DBG | I0307 14:12:49.692678    5777 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/flannel-903000 ...
	I0307 14:12:50.053945    5769 main.go:141] libmachine: (flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:50.053967    5769 main.go:141] libmachine: (flannel-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/flannel-903000/hyperkit.pid
	I0307 14:12:50.053977    5769 main.go:141] libmachine: (flannel-903000) DBG | Using UUID 032bba97-54ea-4d9a-bce6-223e82537c9f
	I0307 14:12:50.091029    5769 main.go:141] libmachine: (flannel-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:12:50.091064    5769 client.go:171] duration metric: took 615.04027ms to LocalClient.Create
	I0307 14:12:52.092104    5769 start.go:128] duration metric: took 2.668659432s to createHost
	I0307 14:12:52.092131    5769 start.go:83] releasing machines lock for "flannel-903000", held for 2.668790574s
	W0307 14:12:52.092161    5769 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:12:52.092707    5769 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:52.092776    5769 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:52.101395    5769 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51394
	I0307 14:12:52.101773    5769 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:52.102157    5769 main.go:141] libmachine: Using API Version  1
	I0307 14:12:52.102172    5769 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:52.102392    5769 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:52.102733    5769 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:52.102752    5769 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:52.110673    5769 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51396
	I0307 14:12:52.111034    5769 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:52.111404    5769 main.go:141] libmachine: Using API Version  1
	I0307 14:12:52.111418    5769 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:52.111635    5769 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:52.111748    5769 main.go:141] libmachine: (flannel-903000) Calling .GetState
	I0307 14:12:52.111836    5769 main.go:141] libmachine: (flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:52.111859    5769 main.go:141] libmachine: (flannel-903000) DBG | hyperkit pid from json: 0
	I0307 14:12:52.111871    5769 main.go:141] libmachine: (flannel-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/flannel-903000/hyperkit.json: no such file or directory
	I0307 14:12:52.111894    5769 main.go:141] libmachine: (flannel-903000) Calling .DriverName
	I0307 14:12:52.155258    5769 out.go:177] * Deleting "flannel-903000" in hyperkit ...
	I0307 14:12:52.179341    5769 main.go:141] libmachine: (flannel-903000) Calling .Remove
	I0307 14:12:52.179574    5769 main.go:141] libmachine: (flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:52.179590    5769 main.go:141] libmachine: (flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:52.179604    5769 main.go:141] libmachine: (flannel-903000) DBG | hyperkit pid from json: 0
	I0307 14:12:52.179615    5769 main.go:141] libmachine: (flannel-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/flannel-903000/hyperkit.json: no such file or directory
	W0307 14:12:52.196291    5769 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:12:52.196304    5769 start.go:728] Will try again in 5 seconds ...
	I0307 14:12:57.197025    5769 start.go:360] acquireMachinesLock for flannel-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:12:57.197121    5769 start.go:364] duration metric: took 70.501µs to acquireMachinesLock for "flannel-903000"
	I0307 14:12:57.197159    5769 start.go:93] Provisioning new machine with config: &{Name:flannel-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:flannel-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:flannel} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mo
untPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:12:57.197228    5769 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:12:57.218617    5769 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:12:57.218692    5769 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:12:57.218717    5769 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:12:57.226497    5769 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51410
	I0307 14:12:57.226872    5769 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:12:57.227260    5769 main.go:141] libmachine: Using API Version  1
	I0307 14:12:57.227276    5769 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:12:57.227504    5769 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:12:57.227621    5769 main.go:141] libmachine: (flannel-903000) Calling .GetMachineName
	I0307 14:12:57.227710    5769 main.go:141] libmachine: (flannel-903000) Calling .DriverName
	I0307 14:12:57.227815    5769 start.go:159] libmachine.API.Create for "flannel-903000" (driver="hyperkit")
	I0307 14:12:57.227831    5769 client.go:168] LocalClient.Create starting
	I0307 14:12:57.227860    5769 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:12:57.227900    5769 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:57.227912    5769 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:57.227957    5769 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:12:57.227995    5769 main.go:141] libmachine: Decoding PEM data...
	I0307 14:12:57.228012    5769 main.go:141] libmachine: Parsing certificate...
	I0307 14:12:57.228026    5769 main.go:141] libmachine: Running pre-create checks...
	I0307 14:12:57.228038    5769 main.go:141] libmachine: (flannel-903000) Calling .PreCreateCheck
	I0307 14:12:57.228121    5769 main.go:141] libmachine: (flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:57.228150    5769 main.go:141] libmachine: (flannel-903000) Calling .GetConfigRaw
	I0307 14:12:57.228591    5769 main.go:141] libmachine: Creating machine...
	I0307 14:12:57.228599    5769 main.go:141] libmachine: (flannel-903000) Calling .Create
	I0307 14:12:57.228675    5769 main.go:141] libmachine: (flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:57.228831    5769 main.go:141] libmachine: (flannel-903000) DBG | I0307 14:12:57.228670    5812 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:12:57.228850    5769 main.go:141] libmachine: (flannel-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:12:57.406048    5769 main.go:141] libmachine: (flannel-903000) DBG | I0307 14:12:57.405937    5812 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/flannel-903000/id_rsa...
	I0307 14:12:57.507076    5769 main.go:141] libmachine: (flannel-903000) DBG | I0307 14:12:57.506992    5812 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/flannel-903000/flannel-903000.rawdisk...
	I0307 14:12:57.507093    5769 main.go:141] libmachine: (flannel-903000) DBG | Writing magic tar header
	I0307 14:12:57.507102    5769 main.go:141] libmachine: (flannel-903000) DBG | Writing SSH key tar header
	I0307 14:12:57.507376    5769 main.go:141] libmachine: (flannel-903000) DBG | I0307 14:12:57.507347    5812 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/flannel-903000 ...
	I0307 14:12:57.965317    5769 main.go:141] libmachine: (flannel-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:12:57.965336    5769 main.go:141] libmachine: (flannel-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/flannel-903000/hyperkit.pid
	I0307 14:12:57.965375    5769 main.go:141] libmachine: (flannel-903000) DBG | Using UUID 53966dc9-a91f-454e-a4d7-d635e0a28c08
	I0307 14:12:58.121929    5769 main.go:141] libmachine: (flannel-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:12:58.122019    5769 client.go:171] duration metric: took 894.17445ms to LocalClient.Create
	I0307 14:13:00.122203    5769 start.go:128] duration metric: took 2.924933444s to createHost
	I0307 14:13:00.122236    5769 start.go:83] releasing machines lock for "flannel-903000", held for 2.925082987s
	W0307 14:13:00.122358    5769 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p flannel-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p flannel-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:00.206089    5769 out.go:177] 
	W0307 14:13:00.248018    5769 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:13:00.248044    5769 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:13:00.248054    5769 out.go:239] * Related issues:
	* Related issues:
	W0307 14:13:00.248079    5769 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:13:00.248104    5769 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:13:00.289885    5769 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/flannel/Start (11.38s)

                                                
                                    
x
+
TestNetworkPlugins/group/bridge/Start (11.73s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/bridge/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p bridge-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p bridge-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --cni=bridge --driver=hyperkit : exit status 60 (11.728538963s)

                                                
                                                
-- stdout --
	* [bridge-903000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "bridge-903000" primary control-plane node in "bridge-903000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "bridge-903000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:13:02.489370    5963 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:13:02.490537    5963 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:02.490558    5963 out.go:304] Setting ErrFile to fd 2...
	I0307 14:13:02.490569    5963 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:02.491473    5963 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:13:02.493739    5963 out.go:298] Setting JSON to false
	I0307 14:13:02.516798    5963 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2553,"bootTime":1709847029,"procs":535,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:13:02.516899    5963 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:13:02.538460    5963 out.go:177] * [bridge-903000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:13:02.601422    5963 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:13:02.580830    5963 notify.go:220] Checking for updates...
	I0307 14:13:02.664572    5963 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:13:02.727552    5963 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:13:02.770609    5963 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:13:02.791388    5963 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:02.812644    5963 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:13:02.834026    5963 config.go:182] Loaded profile config "flannel-903000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:13:02.834120    5963 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:13:02.834200    5963 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:13:02.863334    5963 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:13:02.905567    5963 start.go:297] selected driver: hyperkit
	I0307 14:13:02.905583    5963 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:13:02.905596    5963 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:13:02.908583    5963 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:02.908697    5963 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:13:02.916634    5963 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:13:02.920528    5963 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:02.920566    5963 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:13:02.920604    5963 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:13:02.920828    5963 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:13:02.920894    5963 cni.go:84] Creating CNI manager for "bridge"
	I0307 14:13:02.920901    5963 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 14:13:02.920981    5963 start.go:340] cluster config:
	{Name:bridge-903000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:bridge-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRunti
me:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSoc
k: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:13:02.921105    5963 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:02.942426    5963 out.go:177] * Starting "bridge-903000" primary control-plane node in "bridge-903000" cluster
	I0307 14:13:02.963567    5963 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:13:02.963601    5963 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:13:02.963616    5963 cache.go:56] Caching tarball of preloaded images
	I0307 14:13:02.963710    5963 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:13:02.963718    5963 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:13:02.963787    5963 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/bridge-903000/config.json ...
	I0307 14:13:02.963803    5963 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/bridge-903000/config.json: {Name:mk63dc867112df265ba6c479367646a1cc7d39a0 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:13:02.964088    5963 start.go:360] acquireMachinesLock for bridge-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:02.964137    5963 start.go:364] duration metric: took 39.97µs to acquireMachinesLock for "bridge-903000"
	I0307 14:13:02.964157    5963 start.go:93] Provisioning new machine with config: &{Name:bridge-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:bridge-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:13:02.964205    5963 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:13:03.007643    5963 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:13:03.007948    5963 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:03.008028    5963 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:03.017471    5963 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51498
	I0307 14:13:03.017861    5963 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:03.018286    5963 main.go:141] libmachine: Using API Version  1
	I0307 14:13:03.018296    5963 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:03.018514    5963 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:03.018610    5963 main.go:141] libmachine: (bridge-903000) Calling .GetMachineName
	I0307 14:13:03.018704    5963 main.go:141] libmachine: (bridge-903000) Calling .DriverName
	I0307 14:13:03.018794    5963 start.go:159] libmachine.API.Create for "bridge-903000" (driver="hyperkit")
	I0307 14:13:03.018819    5963 client.go:168] LocalClient.Create starting
	I0307 14:13:03.018852    5963 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:13:03.018901    5963 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:03.018915    5963 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:03.018973    5963 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:13:03.019008    5963 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:03.019020    5963 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:03.019034    5963 main.go:141] libmachine: Running pre-create checks...
	I0307 14:13:03.019044    5963 main.go:141] libmachine: (bridge-903000) Calling .PreCreateCheck
	I0307 14:13:03.019113    5963 main.go:141] libmachine: (bridge-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:03.019283    5963 main.go:141] libmachine: (bridge-903000) Calling .GetConfigRaw
	I0307 14:13:03.029513    5963 main.go:141] libmachine: Creating machine...
	I0307 14:13:03.029531    5963 main.go:141] libmachine: (bridge-903000) Calling .Create
	I0307 14:13:03.029756    5963 main.go:141] libmachine: (bridge-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:03.029895    5963 main.go:141] libmachine: (bridge-903000) DBG | I0307 14:13:03.029732    5981 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:03.029967    5963 main.go:141] libmachine: (bridge-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:13:03.380465    5963 main.go:141] libmachine: (bridge-903000) DBG | I0307 14:13:03.380396    5981 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/bridge-903000/id_rsa...
	I0307 14:13:03.522990    5963 main.go:141] libmachine: (bridge-903000) DBG | I0307 14:13:03.522877    5981 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/bridge-903000/bridge-903000.rawdisk...
	I0307 14:13:03.523043    5963 main.go:141] libmachine: (bridge-903000) DBG | Writing magic tar header
	I0307 14:13:03.523127    5963 main.go:141] libmachine: (bridge-903000) DBG | Writing SSH key tar header
	I0307 14:13:03.544534    5963 main.go:141] libmachine: (bridge-903000) DBG | I0307 14:13:03.544395    5981 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/bridge-903000 ...
	I0307 14:13:04.015091    5963 main.go:141] libmachine: (bridge-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:04.015121    5963 main.go:141] libmachine: (bridge-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/bridge-903000/hyperkit.pid
	I0307 14:13:04.015222    5963 main.go:141] libmachine: (bridge-903000) DBG | Using UUID f31b1ad5-6a09-4a81-ab1a-e66b9ac9cdf0
	I0307 14:13:04.116181    5963 main.go:141] libmachine: (bridge-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:04.116284    5963 client.go:171] duration metric: took 1.097447224s to LocalClient.Create
	I0307 14:13:06.116413    5963 start.go:128] duration metric: took 3.152172897s to createHost
	I0307 14:13:06.116429    5963 start.go:83] releasing machines lock for "bridge-903000", held for 3.152264294s
	W0307 14:13:06.116459    5963 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:13:06.116752    5963 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:06.116781    5963 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:06.124944    5963 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51538
	I0307 14:13:06.125332    5963 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:06.125680    5963 main.go:141] libmachine: Using API Version  1
	I0307 14:13:06.125691    5963 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:06.125889    5963 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:06.126259    5963 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:06.126281    5963 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:06.134540    5963 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51540
	I0307 14:13:06.134922    5963 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:06.135298    5963 main.go:141] libmachine: Using API Version  1
	I0307 14:13:06.135312    5963 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:06.135534    5963 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:06.135647    5963 main.go:141] libmachine: (bridge-903000) Calling .GetState
	I0307 14:13:06.135737    5963 main.go:141] libmachine: (bridge-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:06.135759    5963 main.go:141] libmachine: (bridge-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/bridge-903000/hyperkit.json: no such file or directory
	I0307 14:13:06.135769    5963 main.go:141] libmachine: (bridge-903000) DBG | hyperkit pid from json: 0
	I0307 14:13:06.135803    5963 main.go:141] libmachine: (bridge-903000) Calling .DriverName
	I0307 14:13:06.177773    5963 out.go:177] * Deleting "bridge-903000" in hyperkit ...
	I0307 14:13:06.200018    5963 main.go:141] libmachine: (bridge-903000) Calling .Remove
	I0307 14:13:06.200376    5963 main.go:141] libmachine: (bridge-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:06.200405    5963 main.go:141] libmachine: (bridge-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:06.200425    5963 main.go:141] libmachine: (bridge-903000) DBG | hyperkit pid from json: 0
	I0307 14:13:06.200474    5963 main.go:141] libmachine: (bridge-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/bridge-903000/hyperkit.json: no such file or directory
	W0307 14:13:06.291529    5963 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:06.291544    5963 start.go:728] Will try again in 5 seconds ...
	I0307 14:13:11.293194    5963 start.go:360] acquireMachinesLock for bridge-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:11.293407    5963 start.go:364] duration metric: took 138.435µs to acquireMachinesLock for "bridge-903000"
	I0307 14:13:11.293474    5963 start.go:93] Provisioning new machine with config: &{Name:bridge-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{K
ubernetesVersion:v1.28.4 ClusterName:bridge-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:bridge} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:13:11.293579    5963 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:13:11.316415    5963 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:13:11.316547    5963 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:11.316581    5963 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:11.325199    5963 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51566
	I0307 14:13:11.325566    5963 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:11.325890    5963 main.go:141] libmachine: Using API Version  1
	I0307 14:13:11.325900    5963 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:11.326083    5963 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:11.326199    5963 main.go:141] libmachine: (bridge-903000) Calling .GetMachineName
	I0307 14:13:11.326281    5963 main.go:141] libmachine: (bridge-903000) Calling .DriverName
	I0307 14:13:11.326379    5963 start.go:159] libmachine.API.Create for "bridge-903000" (driver="hyperkit")
	I0307 14:13:11.326394    5963 client.go:168] LocalClient.Create starting
	I0307 14:13:11.326420    5963 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:13:11.326473    5963 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:11.326482    5963 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:11.326519    5963 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:13:11.326554    5963 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:11.326569    5963 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:11.326581    5963 main.go:141] libmachine: Running pre-create checks...
	I0307 14:13:11.326586    5963 main.go:141] libmachine: (bridge-903000) Calling .PreCreateCheck
	I0307 14:13:11.326677    5963 main.go:141] libmachine: (bridge-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:11.326708    5963 main.go:141] libmachine: (bridge-903000) Calling .GetConfigRaw
	I0307 14:13:11.327197    5963 main.go:141] libmachine: Creating machine...
	I0307 14:13:11.327205    5963 main.go:141] libmachine: (bridge-903000) Calling .Create
	I0307 14:13:11.327265    5963 main.go:141] libmachine: (bridge-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:11.327384    5963 main.go:141] libmachine: (bridge-903000) DBG | I0307 14:13:11.327260    6092 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:11.327435    5963 main.go:141] libmachine: (bridge-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:13:11.500290    5963 main.go:141] libmachine: (bridge-903000) DBG | I0307 14:13:11.500196    6092 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/bridge-903000/id_rsa...
	I0307 14:13:11.571346    5963 main.go:141] libmachine: (bridge-903000) DBG | I0307 14:13:11.571266    6092 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/bridge-903000/bridge-903000.rawdisk...
	I0307 14:13:11.571359    5963 main.go:141] libmachine: (bridge-903000) DBG | Writing magic tar header
	I0307 14:13:11.571380    5963 main.go:141] libmachine: (bridge-903000) DBG | Writing SSH key tar header
	I0307 14:13:11.571975    5963 main.go:141] libmachine: (bridge-903000) DBG | I0307 14:13:11.571927    6092 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/bridge-903000 ...
	I0307 14:13:11.931927    5963 main.go:141] libmachine: (bridge-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:11.931950    5963 main.go:141] libmachine: (bridge-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/bridge-903000/hyperkit.pid
	I0307 14:13:11.932013    5963 main.go:141] libmachine: (bridge-903000) DBG | Using UUID 0f0746b5-64da-4b6e-b47d-50893ae00e64
	I0307 14:13:11.969371    5963 main.go:141] libmachine: (bridge-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:11.969455    5963 client.go:171] duration metric: took 643.04964ms to LocalClient.Create
	I0307 14:13:13.970789    5963 start.go:128] duration metric: took 2.677176689s to createHost
	I0307 14:13:13.970815    5963 start.go:83] releasing machines lock for "bridge-903000", held for 2.67737666s
	W0307 14:13:13.970921    5963 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p bridge-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p bridge-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:13.992945    5963 out.go:177] 
	W0307 14:13:14.016591    5963 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:13:14.016663    5963 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:13:14.016746    5963 out.go:239] * Related issues:
	* Related issues:
	W0307 14:13:14.016840    5963 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:13:14.016865    5963 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:13:14.081416    5963 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/bridge/Start (11.73s)

                                                
                                    
x
+
TestNetworkPlugins/group/kubenet/Start (11.64s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/kubenet/Start
net_test.go:112: (dbg) Run:  out/minikube-darwin-amd64 start -p kubenet-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=hyperkit 
net_test.go:112: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p kubenet-903000 --memory=3072 --alsologtostderr --wait=true --wait-timeout=15m --network-plugin=kubenet --driver=hyperkit : exit status 60 (11.63414135s)

                                                
                                                
-- stdout --
	* [kubenet-903000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "kubenet-903000" primary control-plane node in "kubenet-903000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	* Deleting "kubenet-903000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:13:07.330402    6080 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:13:07.331117    6080 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:07.331123    6080 out.go:304] Setting ErrFile to fd 2...
	I0307 14:13:07.331127    6080 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:07.331668    6080 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:13:07.333353    6080 out.go:298] Setting JSON to false
	I0307 14:13:07.355629    6080 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2558,"bootTime":1709847029,"procs":561,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:13:07.355730    6080 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:13:07.376742    6080 out.go:177] * [kubenet-903000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:13:07.419398    6080 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:13:07.419471    6080 notify.go:220] Checking for updates...
	I0307 14:13:07.462195    6080 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:13:07.483219    6080 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:13:07.525173    6080 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:13:07.546681    6080 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:07.568408    6080 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:13:07.590292    6080 config.go:182] Loaded profile config "bridge-903000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:13:07.590498    6080 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:13:07.590649    6080 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:13:07.620238    6080 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:13:07.662232    6080 start.go:297] selected driver: hyperkit
	I0307 14:13:07.662251    6080 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:13:07.662265    6080 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:13:07.665676    6080 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:07.665771    6080 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:13:07.673383    6080 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:13:07.677158    6080 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:07.677179    6080 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:13:07.677212    6080 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:13:07.677423    6080 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:13:07.677487    6080 cni.go:80] network plugin configured as "kubenet", returning disabled
	I0307 14:13:07.677553    6080 start.go:340] cluster config:
	{Name:kubenet-903000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:kubenet-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRun
time:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSoc
k: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:13:07.677641    6080 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:07.719408    6080 out.go:177] * Starting "kubenet-903000" primary control-plane node in "kubenet-903000" cluster
	I0307 14:13:07.740185    6080 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:13:07.740237    6080 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:13:07.740263    6080 cache.go:56] Caching tarball of preloaded images
	I0307 14:13:07.740394    6080 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:13:07.740407    6080 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:13:07.740514    6080 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/kubenet-903000/config.json ...
	I0307 14:13:07.740538    6080 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/kubenet-903000/config.json: {Name:mk59f93706cf8e16841d25358c3fc99c4bcbd705 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:13:07.740995    6080 start.go:360] acquireMachinesLock for kubenet-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:07.741066    6080 start.go:364] duration metric: took 56.182µs to acquireMachinesLock for "kubenet-903000"
	I0307 14:13:07.741103    6080 start.go:93] Provisioning new machine with config: &{Name:kubenet-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kubenet-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:13:07.741174    6080 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:13:07.762412    6080 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:13:07.762577    6080 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:07.762651    6080 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:07.770517    6080 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51560
	I0307 14:13:07.770874    6080 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:07.771313    6080 main.go:141] libmachine: Using API Version  1
	I0307 14:13:07.771322    6080 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:07.771510    6080 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:07.771599    6080 main.go:141] libmachine: (kubenet-903000) Calling .GetMachineName
	I0307 14:13:07.771686    6080 main.go:141] libmachine: (kubenet-903000) Calling .DriverName
	I0307 14:13:07.771780    6080 start.go:159] libmachine.API.Create for "kubenet-903000" (driver="hyperkit")
	I0307 14:13:07.771806    6080 client.go:168] LocalClient.Create starting
	I0307 14:13:07.771837    6080 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:13:07.771893    6080 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:07.771907    6080 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:07.771966    6080 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:13:07.772003    6080 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:07.772015    6080 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:07.772027    6080 main.go:141] libmachine: Running pre-create checks...
	I0307 14:13:07.772035    6080 main.go:141] libmachine: (kubenet-903000) Calling .PreCreateCheck
	I0307 14:13:07.772114    6080 main.go:141] libmachine: (kubenet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:07.772336    6080 main.go:141] libmachine: (kubenet-903000) Calling .GetConfigRaw
	I0307 14:13:07.783596    6080 main.go:141] libmachine: Creating machine...
	I0307 14:13:07.783607    6080 main.go:141] libmachine: (kubenet-903000) Calling .Create
	I0307 14:13:07.783753    6080 main.go:141] libmachine: (kubenet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:07.783937    6080 main.go:141] libmachine: (kubenet-903000) DBG | I0307 14:13:07.783728    6088 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:07.783970    6080 main.go:141] libmachine: (kubenet-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:13:07.953519    6080 main.go:141] libmachine: (kubenet-903000) DBG | I0307 14:13:07.953411    6088 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubenet-903000/id_rsa...
	I0307 14:13:08.106084    6080 main.go:141] libmachine: (kubenet-903000) DBG | I0307 14:13:08.106016    6088 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubenet-903000/kubenet-903000.rawdisk...
	I0307 14:13:08.106101    6080 main.go:141] libmachine: (kubenet-903000) DBG | Writing magic tar header
	I0307 14:13:08.106119    6080 main.go:141] libmachine: (kubenet-903000) DBG | Writing SSH key tar header
	I0307 14:13:08.106886    6080 main.go:141] libmachine: (kubenet-903000) DBG | I0307 14:13:08.106785    6088 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubenet-903000 ...
	I0307 14:13:08.466568    6080 main.go:141] libmachine: (kubenet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:08.466599    6080 main.go:141] libmachine: (kubenet-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubenet-903000/hyperkit.pid
	I0307 14:13:08.466632    6080 main.go:141] libmachine: (kubenet-903000) DBG | Using UUID 89ccbcf4-67a6-4c15-8e31-4eb44160ff47
	I0307 14:13:08.504226    6080 main.go:141] libmachine: (kubenet-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:08.504305    6080 client.go:171] duration metric: took 732.488105ms to LocalClient.Create
	I0307 14:13:10.504516    6080 start.go:128] duration metric: took 2.763302016s to createHost
	I0307 14:13:10.504545    6080 start.go:83] releasing machines lock for "kubenet-903000", held for 2.763451364s
	W0307 14:13:10.504620    6080 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:13:10.505198    6080 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:10.505243    6080 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:10.514211    6080 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51562
	I0307 14:13:10.514567    6080 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:10.514944    6080 main.go:141] libmachine: Using API Version  1
	I0307 14:13:10.514961    6080 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:10.515174    6080 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:10.515507    6080 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:10.515539    6080 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:10.523398    6080 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51564
	I0307 14:13:10.523750    6080 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:10.524112    6080 main.go:141] libmachine: Using API Version  1
	I0307 14:13:10.524134    6080 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:10.524329    6080 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:10.524439    6080 main.go:141] libmachine: (kubenet-903000) Calling .GetState
	I0307 14:13:10.524522    6080 main.go:141] libmachine: (kubenet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:10.524536    6080 main.go:141] libmachine: (kubenet-903000) DBG | hyperkit pid from json: 0
	I0307 14:13:10.524567    6080 main.go:141] libmachine: (kubenet-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubenet-903000/hyperkit.json: no such file or directory
	I0307 14:13:10.524591    6080 main.go:141] libmachine: (kubenet-903000) Calling .DriverName
	I0307 14:13:10.576051    6080 out.go:177] * Deleting "kubenet-903000" in hyperkit ...
	I0307 14:13:10.597220    6080 main.go:141] libmachine: (kubenet-903000) Calling .Remove
	I0307 14:13:10.597500    6080 main.go:141] libmachine: (kubenet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:10.597513    6080 main.go:141] libmachine: (kubenet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:10.597525    6080 main.go:141] libmachine: (kubenet-903000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubenet-903000/hyperkit.json: no such file or directory
	I0307 14:13:10.597542    6080 main.go:141] libmachine: (kubenet-903000) DBG | hyperkit pid from json: 0
	W0307 14:13:10.614497    6080 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:10.614511    6080 start.go:728] Will try again in 5 seconds ...
	I0307 14:13:15.616640    6080 start.go:360] acquireMachinesLock for kubenet-903000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:15.616743    6080 start.go:364] duration metric: took 68.987µs to acquireMachinesLock for "kubenet-903000"
	I0307 14:13:15.616818    6080 start.go:93] Provisioning new machine with config: &{Name:kubenet-903000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:3072 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{
KubernetesVersion:v1.28.4 ClusterName:kubenet-903000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:kubenet FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:15m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mount
Port:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:13:15.616901    6080 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:13:15.669453    6080 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=3072MB, Disk=20000MB) ...
	I0307 14:13:15.669556    6080 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:15.669594    6080 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:15.678198    6080 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51580
	I0307 14:13:15.678585    6080 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:15.678943    6080 main.go:141] libmachine: Using API Version  1
	I0307 14:13:15.678956    6080 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:15.679157    6080 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:15.679269    6080 main.go:141] libmachine: (kubenet-903000) Calling .GetMachineName
	I0307 14:13:15.679352    6080 main.go:141] libmachine: (kubenet-903000) Calling .DriverName
	I0307 14:13:15.679457    6080 start.go:159] libmachine.API.Create for "kubenet-903000" (driver="hyperkit")
	I0307 14:13:15.679474    6080 client.go:168] LocalClient.Create starting
	I0307 14:13:15.679499    6080 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:13:15.679533    6080 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:15.679547    6080 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:15.679586    6080 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:13:15.679610    6080 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:15.679628    6080 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:15.679641    6080 main.go:141] libmachine: Running pre-create checks...
	I0307 14:13:15.679646    6080 main.go:141] libmachine: (kubenet-903000) Calling .PreCreateCheck
	I0307 14:13:15.679719    6080 main.go:141] libmachine: (kubenet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:15.679750    6080 main.go:141] libmachine: (kubenet-903000) Calling .GetConfigRaw
	I0307 14:13:15.690448    6080 main.go:141] libmachine: Creating machine...
	I0307 14:13:15.690461    6080 main.go:141] libmachine: (kubenet-903000) Calling .Create
	I0307 14:13:15.690593    6080 main.go:141] libmachine: (kubenet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:15.690748    6080 main.go:141] libmachine: (kubenet-903000) DBG | I0307 14:13:15.690567    6131 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:15.690813    6080 main.go:141] libmachine: (kubenet-903000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:13:16.069584    6080 main.go:141] libmachine: (kubenet-903000) DBG | I0307 14:13:16.069526    6131 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubenet-903000/id_rsa...
	I0307 14:13:16.183975    6080 main.go:141] libmachine: (kubenet-903000) DBG | I0307 14:13:16.183875    6131 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubenet-903000/kubenet-903000.rawdisk...
	I0307 14:13:16.183991    6080 main.go:141] libmachine: (kubenet-903000) DBG | Writing magic tar header
	I0307 14:13:16.184002    6080 main.go:141] libmachine: (kubenet-903000) DBG | Writing SSH key tar header
	I0307 14:13:16.184431    6080 main.go:141] libmachine: (kubenet-903000) DBG | I0307 14:13:16.184387    6131 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubenet-903000 ...
	I0307 14:13:16.627006    6080 main.go:141] libmachine: (kubenet-903000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:16.627022    6080 main.go:141] libmachine: (kubenet-903000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/kubenet-903000/hyperkit.pid
	I0307 14:13:16.627059    6080 main.go:141] libmachine: (kubenet-903000) DBG | Using UUID d2ca871b-7e1e-4629-b99a-ee9630382f08
	I0307 14:13:16.692086    6080 main.go:141] libmachine: (kubenet-903000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:16.692177    6080 client.go:171] duration metric: took 1.012687767s to LocalClient.Create
	I0307 14:13:18.693763    6080 start.go:128] duration metric: took 3.076820317s to createHost
	I0307 14:13:18.693778    6080 start.go:83] releasing machines lock for "kubenet-903000", held for 3.076988003s
	W0307 14:13:18.693844    6080 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p kubenet-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p kubenet-903000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:18.737030    6080 out.go:177] 
	W0307 14:13:18.758117    6080 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:13:18.758143    6080 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:13:18.758153    6080 out.go:239] * Related issues:
	* Related issues:
	W0307 14:13:18.758168    6080 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:13:18.758181    6080 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:13:18.800212    6080 out.go:177] 

                                                
                                                
** /stderr **
net_test.go:114: failed start: exit status 60
--- FAIL: TestNetworkPlugins/group/kubenet/Start (11.64s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/FirstStart (11.91s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p old-k8s-version-202000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-202000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0: exit status 60 (11.838051307s)

                                                
                                                
-- stdout --
	* [old-k8s-version-202000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "old-k8s-version-202000" primary control-plane node in "old-k8s-version-202000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "old-k8s-version-202000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:13:20.589940    6265 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:13:20.610371    6265 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:20.610391    6265 out.go:304] Setting ErrFile to fd 2...
	I0307 14:13:20.610399    6265 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:20.610770    6265 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:13:20.612726    6265 out.go:298] Setting JSON to false
	I0307 14:13:20.636090    6265 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2571,"bootTime":1709847029,"procs":535,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:13:20.636215    6265 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:13:20.657222    6265 out.go:177] * [old-k8s-version-202000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:13:20.721143    6265 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:13:20.699503    6265 notify.go:220] Checking for updates...
	I0307 14:13:20.784483    6265 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:13:20.827285    6265 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:13:20.868956    6265 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:13:20.911163    6265 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:20.952910    6265 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:13:20.974691    6265 config.go:182] Loaded profile config "kubenet-903000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:13:20.974840    6265 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:13:20.974970    6265 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:13:21.016317    6265 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:13:21.057948    6265 start.go:297] selected driver: hyperkit
	I0307 14:13:21.057964    6265 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:13:21.057977    6265 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:13:21.061375    6265 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:21.061477    6265 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:13:21.069174    6265 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:13:21.072987    6265 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:21.073018    6265 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:13:21.073051    6265 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:13:21.073259    6265 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:13:21.073317    6265 cni.go:84] Creating CNI manager for ""
	I0307 14:13:21.073333    6265 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0307 14:13:21.073396    6265 start.go:340] cluster config:
	{Name:old-k8s-version-202000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-202000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.loc
al ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSH
AuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:13:21.073483    6265 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:21.120923    6265 out.go:177] * Starting "old-k8s-version-202000" primary control-plane node in "old-k8s-version-202000" cluster
	I0307 14:13:21.142104    6265 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0307 14:13:21.142135    6265 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0307 14:13:21.142150    6265 cache.go:56] Caching tarball of preloaded images
	I0307 14:13:21.142246    6265 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:13:21.142255    6265 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0307 14:13:21.142323    6265 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/old-k8s-version-202000/config.json ...
	I0307 14:13:21.142341    6265 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/old-k8s-version-202000/config.json: {Name:mke9cf053b4a2d0a58c01559bea24d26a42fec54 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:13:21.142665    6265 start.go:360] acquireMachinesLock for old-k8s-version-202000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:21.142744    6265 start.go:364] duration metric: took 57.313µs to acquireMachinesLock for "old-k8s-version-202000"
	I0307 14:13:21.142773    6265 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-202000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-202000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:13:21.142851    6265 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:13:21.164415    6265 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:13:21.164622    6265 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:21.164669    6265 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:21.173383    6265 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51660
	I0307 14:13:21.173769    6265 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:21.174212    6265 main.go:141] libmachine: Using API Version  1
	I0307 14:13:21.174224    6265 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:21.174471    6265 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:21.174582    6265 main.go:141] libmachine: (old-k8s-version-202000) Calling .GetMachineName
	I0307 14:13:21.174685    6265 main.go:141] libmachine: (old-k8s-version-202000) Calling .DriverName
	I0307 14:13:21.174784    6265 start.go:159] libmachine.API.Create for "old-k8s-version-202000" (driver="hyperkit")
	I0307 14:13:21.174809    6265 client.go:168] LocalClient.Create starting
	I0307 14:13:21.174845    6265 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:13:21.174904    6265 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:21.174920    6265 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:21.174983    6265 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:13:21.175019    6265 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:21.175030    6265 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:21.175042    6265 main.go:141] libmachine: Running pre-create checks...
	I0307 14:13:21.175052    6265 main.go:141] libmachine: (old-k8s-version-202000) Calling .PreCreateCheck
	I0307 14:13:21.175140    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:21.175314    6265 main.go:141] libmachine: (old-k8s-version-202000) Calling .GetConfigRaw
	I0307 14:13:21.186610    6265 main.go:141] libmachine: Creating machine...
	I0307 14:13:21.186629    6265 main.go:141] libmachine: (old-k8s-version-202000) Calling .Create
	I0307 14:13:21.186807    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:21.187008    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | I0307 14:13:21.186785    6281 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:21.187103    6265 main.go:141] libmachine: (old-k8s-version-202000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:13:21.556868    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | I0307 14:13:21.556776    6281 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000/id_rsa...
	I0307 14:13:21.713231    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | I0307 14:13:21.713117    6281 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000/old-k8s-version-202000.rawdisk...
	I0307 14:13:21.713248    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | Writing magic tar header
	I0307 14:13:21.713261    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | Writing SSH key tar header
	I0307 14:13:21.713673    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | I0307 14:13:21.713598    6281 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000 ...
	I0307 14:13:22.176940    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:22.176972    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000/hyperkit.pid
	I0307 14:13:22.177031    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | Using UUID baf32511-bddc-42a0-8898-f526664e5b9c
	I0307 14:13:22.259602    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:22.259693    6265 client.go:171] duration metric: took 1.084867228s to LocalClient.Create
	I0307 14:13:24.260211    6265 start.go:128] duration metric: took 3.117318762s to createHost
	I0307 14:13:24.260258    6265 start.go:83] releasing machines lock for "old-k8s-version-202000", held for 3.117483083s
	W0307 14:13:24.260288    6265 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:13:24.260862    6265 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:24.260913    6265 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:24.270031    6265 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51702
	I0307 14:13:24.270452    6265 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:24.270795    6265 main.go:141] libmachine: Using API Version  1
	I0307 14:13:24.270806    6265 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:24.271025    6265 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:24.271366    6265 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:24.271393    6265 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:24.279253    6265 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51704
	I0307 14:13:24.279619    6265 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:24.279971    6265 main.go:141] libmachine: Using API Version  1
	I0307 14:13:24.279986    6265 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:24.280169    6265 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:24.280261    6265 main.go:141] libmachine: (old-k8s-version-202000) Calling .GetState
	I0307 14:13:24.280356    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:24.280385    6265 main.go:141] libmachine: (old-k8s-version-202000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000/hyperkit.json: no such file or directory
	I0307 14:13:24.280392    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | hyperkit pid from json: 0
	I0307 14:13:24.280452    6265 main.go:141] libmachine: (old-k8s-version-202000) Calling .DriverName
	I0307 14:13:24.324086    6265 out.go:177] * Deleting "old-k8s-version-202000" in hyperkit ...
	I0307 14:13:24.345083    6265 main.go:141] libmachine: (old-k8s-version-202000) Calling .Remove
	I0307 14:13:24.345236    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:24.345247    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:24.345257    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | hyperkit pid from json: 0
	I0307 14:13:24.345270    6265 main.go:141] libmachine: (old-k8s-version-202000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000/hyperkit.json: no such file or directory
	W0307 14:13:24.423036    6265 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:24.423056    6265 start.go:728] Will try again in 5 seconds ...
	I0307 14:13:29.424312    6265 start.go:360] acquireMachinesLock for old-k8s-version-202000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:29.424409    6265 start.go:364] duration metric: took 77.156µs to acquireMachinesLock for "old-k8s-version-202000"
	I0307 14:13:29.424436    6265 start.go:93] Provisioning new machine with config: &{Name:old-k8s-version-202000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-202000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[
] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:13:29.424507    6265 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:13:29.474285    6265 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:13:29.474373    6265 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:29.474407    6265 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:29.482494    6265 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51745
	I0307 14:13:29.482870    6265 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:29.483240    6265 main.go:141] libmachine: Using API Version  1
	I0307 14:13:29.483255    6265 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:29.483455    6265 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:29.483541    6265 main.go:141] libmachine: (old-k8s-version-202000) Calling .GetMachineName
	I0307 14:13:29.483628    6265 main.go:141] libmachine: (old-k8s-version-202000) Calling .DriverName
	I0307 14:13:29.483711    6265 start.go:159] libmachine.API.Create for "old-k8s-version-202000" (driver="hyperkit")
	I0307 14:13:29.483727    6265 client.go:168] LocalClient.Create starting
	I0307 14:13:29.483752    6265 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:13:29.483797    6265 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:29.483806    6265 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:29.483845    6265 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:13:29.483882    6265 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:29.483893    6265 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:29.483906    6265 main.go:141] libmachine: Running pre-create checks...
	I0307 14:13:29.483912    6265 main.go:141] libmachine: (old-k8s-version-202000) Calling .PreCreateCheck
	I0307 14:13:29.483992    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:29.484033    6265 main.go:141] libmachine: (old-k8s-version-202000) Calling .GetConfigRaw
	I0307 14:13:29.484442    6265 main.go:141] libmachine: Creating machine...
	I0307 14:13:29.484450    6265 main.go:141] libmachine: (old-k8s-version-202000) Calling .Create
	I0307 14:13:29.484519    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:29.484644    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | I0307 14:13:29.484511    6417 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:29.484690    6265 main.go:141] libmachine: (old-k8s-version-202000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:13:29.659742    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | I0307 14:13:29.659686    6417 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000/id_rsa...
	I0307 14:13:29.810589    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | I0307 14:13:29.810537    6417 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000/old-k8s-version-202000.rawdisk...
	I0307 14:13:29.810604    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | Writing magic tar header
	I0307 14:13:29.810623    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | Writing SSH key tar header
	I0307 14:13:29.810993    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | I0307 14:13:29.810957    6417 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000 ...
	I0307 14:13:30.174546    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:30.174564    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000/hyperkit.pid
	I0307 14:13:30.174596    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | Using UUID 15c70b91-caf6-4610-8030-a691b88ef107
	I0307 14:13:30.211622    6265 main.go:141] libmachine: (old-k8s-version-202000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:30.211693    6265 client.go:171] duration metric: took 727.953828ms to LocalClient.Create
	I0307 14:13:32.212220    6265 start.go:128] duration metric: took 2.787682671s to createHost
	I0307 14:13:32.212233    6265 start.go:83] releasing machines lock for "old-k8s-version-202000", held for 2.787797046s
	W0307 14:13:32.212292    6265 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-202000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-202000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:32.258784    6265 out.go:177] 
	W0307 14:13:32.279732    6265 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:13:32.279785    6265 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:13:32.279806    6265 out.go:239] * Related issues:
	* Related issues:
	W0307 14:13:32.279846    6265 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:13:32.279902    6265 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:13:32.301455    6265 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p old-k8s-version-202000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000: exit status 7 (74.236719ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-202000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/FirstStart (11.91s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/FirstStart (11.35s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p no-preload-098000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p no-preload-098000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (11.244080878s)

                                                
                                                
-- stdout --
	* [no-preload-098000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "no-preload-098000" primary control-plane node in "no-preload-098000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "no-preload-098000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:13:25.395523    6375 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:13:25.395777    6375 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:25.395782    6375 out.go:304] Setting ErrFile to fd 2...
	I0307 14:13:25.395786    6375 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:25.395952    6375 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:13:25.397398    6375 out.go:298] Setting JSON to false
	I0307 14:13:25.419669    6375 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2576,"bootTime":1709847029,"procs":560,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:13:25.419764    6375 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:13:25.442430    6375 out.go:177] * [no-preload-098000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:13:25.483633    6375 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:13:25.483670    6375 notify.go:220] Checking for updates...
	I0307 14:13:25.526307    6375 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:13:25.547445    6375 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:13:25.568546    6375 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:13:25.589471    6375 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:25.631581    6375 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:13:25.653300    6375 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:13:25.653428    6375 config.go:182] Loaded profile config "old-k8s-version-202000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0307 14:13:25.653518    6375 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:13:25.682386    6375 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:13:25.703748    6375 start.go:297] selected driver: hyperkit
	I0307 14:13:25.703792    6375 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:13:25.703809    6375 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:13:25.707577    6375 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:25.707740    6375 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:13:25.716542    6375 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:13:25.720331    6375 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:25.720353    6375 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:13:25.720385    6375 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:13:25.720599    6375 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:13:25.720660    6375 cni.go:84] Creating CNI manager for ""
	I0307 14:13:25.720677    6375 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:13:25.720688    6375 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 14:13:25.720749    6375 start.go:340] cluster config:
	{Name:no-preload-098000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-098000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP:
SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:13:25.720835    6375 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:25.764567    6375 out.go:177] * Starting "no-preload-098000" primary control-plane node in "no-preload-098000" cluster
	I0307 14:13:25.786707    6375 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 14:13:25.786906    6375 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/no-preload-098000/config.json ...
	I0307 14:13:25.786978    6375 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/no-preload-098000/config.json: {Name:mk92af93e2777f25bfbf0a08fcdd19a9db2c8179 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:13:25.787040    6375 cache.go:107] acquiring lock: {Name:mkd92ad654b3164668ca22a54605d955dabea039 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:25.787083    6375 cache.go:107] acquiring lock: {Name:mk43bcba4d3cc5d962b1021381f8cb1da3d28c9b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:25.787129    6375 cache.go:107] acquiring lock: {Name:mka0a794a9259c18f761087768b28db95a215385 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:25.787041    6375 cache.go:107] acquiring lock: {Name:mk069966db05c69227f21aa62f22a2cadb8a5c03 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:25.787201    6375 cache.go:107] acquiring lock: {Name:mk0879d77b9c49573dee2dfd49f39b41a8014289 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:25.787360    6375 cache.go:107] acquiring lock: {Name:mk4bda4825093c1c7800eccd5ae25053df8ea854 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:25.787364    6375 cache.go:107] acquiring lock: {Name:mk55b7d10f765ca492bfa0e9ff622370b103faa2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:25.787438    6375 cache.go:107] acquiring lock: {Name:mkfce85cf4b77e4174090a227c8e8cf183ac4744 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:25.787518    6375 cache.go:115] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0307 14:13:25.787551    6375 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 505.609µs
	I0307 14:13:25.787608    6375 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0307 14:13:25.787656    6375 image.go:134] retrieving image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
	I0307 14:13:25.787671    6375 image.go:134] retrieving image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
	I0307 14:13:25.787720    6375 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.10-0
	I0307 14:13:25.787864    6375 image.go:134] retrieving image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
	I0307 14:13:25.787936    6375 image.go:134] retrieving image: registry.k8s.io/pause:3.9
	I0307 14:13:25.787996    6375 image.go:134] retrieving image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
	I0307 14:13:25.788047    6375 start.go:360] acquireMachinesLock for no-preload-098000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:25.788235    6375 image.go:134] retrieving image: registry.k8s.io/coredns/coredns:v1.11.1
	I0307 14:13:25.788251    6375 start.go:364] duration metric: took 136.488µs to acquireMachinesLock for "no-preload-098000"
	I0307 14:13:25.788378    6375 start.go:93] Provisioning new machine with config: &{Name:no-preload-098000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-098000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptio
ns:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:13:25.788586    6375 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:13:25.831416    6375 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:13:25.831724    6375 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:25.831801    6375 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:25.835070    6375 image.go:177] daemon lookup for registry.k8s.io/kube-controller-manager:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-controller-manager:v1.29.0-rc.2
	I0307 14:13:25.835065    6375 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.10-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.10-0
	I0307 14:13:25.835095    6375 image.go:177] daemon lookup for registry.k8s.io/coredns/coredns:v1.11.1: Error response from daemon: No such image: registry.k8s.io/coredns/coredns:v1.11.1
	I0307 14:13:25.835110    6375 image.go:177] daemon lookup for registry.k8s.io/pause:3.9: Error response from daemon: No such image: registry.k8s.io/pause:3.9
	I0307 14:13:25.835842    6375 image.go:177] daemon lookup for registry.k8s.io/kube-scheduler:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-scheduler:v1.29.0-rc.2
	I0307 14:13:25.835867    6375 image.go:177] daemon lookup for registry.k8s.io/kube-proxy:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-proxy:v1.29.0-rc.2
	I0307 14:13:25.836114    6375 image.go:177] daemon lookup for registry.k8s.io/kube-apiserver:v1.29.0-rc.2: Error response from daemon: No such image: registry.k8s.io/kube-apiserver:v1.29.0-rc.2
	I0307 14:13:25.841224    6375 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51724
	I0307 14:13:25.841598    6375 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:25.842017    6375 main.go:141] libmachine: Using API Version  1
	I0307 14:13:25.842032    6375 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:25.842233    6375 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:25.842329    6375 main.go:141] libmachine: (no-preload-098000) Calling .GetMachineName
	I0307 14:13:25.842420    6375 main.go:141] libmachine: (no-preload-098000) Calling .DriverName
	I0307 14:13:25.842518    6375 start.go:159] libmachine.API.Create for "no-preload-098000" (driver="hyperkit")
	I0307 14:13:25.842540    6375 client.go:168] LocalClient.Create starting
	I0307 14:13:25.842570    6375 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:13:25.842619    6375 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:25.842633    6375 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:25.842698    6375 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:13:25.842735    6375 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:25.842746    6375 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:25.842758    6375 main.go:141] libmachine: Running pre-create checks...
	I0307 14:13:25.842768    6375 main.go:141] libmachine: (no-preload-098000) Calling .PreCreateCheck
	I0307 14:13:25.842855    6375 main.go:141] libmachine: (no-preload-098000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:25.843097    6375 main.go:141] libmachine: (no-preload-098000) Calling .GetConfigRaw
	I0307 14:13:25.843586    6375 main.go:141] libmachine: Creating machine...
	I0307 14:13:25.843595    6375 main.go:141] libmachine: (no-preload-098000) Calling .Create
	I0307 14:13:25.843668    6375 main.go:141] libmachine: (no-preload-098000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:25.843783    6375 main.go:141] libmachine: (no-preload-098000) DBG | I0307 14:13:25.843657    6383 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:25.843839    6375 main.go:141] libmachine: (no-preload-098000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:13:26.021697    6375 main.go:141] libmachine: (no-preload-098000) DBG | I0307 14:13:26.021619    6383 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000/id_rsa...
	I0307 14:13:26.123697    6375 main.go:141] libmachine: (no-preload-098000) DBG | I0307 14:13:26.123567    6383 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000/no-preload-098000.rawdisk...
	I0307 14:13:26.123723    6375 main.go:141] libmachine: (no-preload-098000) DBG | Writing magic tar header
	I0307 14:13:26.123736    6375 main.go:141] libmachine: (no-preload-098000) DBG | Writing SSH key tar header
	I0307 14:13:26.124255    6375 main.go:141] libmachine: (no-preload-098000) DBG | I0307 14:13:26.124199    6383 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000 ...
	I0307 14:13:26.485997    6375 main.go:141] libmachine: (no-preload-098000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:26.486024    6375 main.go:141] libmachine: (no-preload-098000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000/hyperkit.pid
	I0307 14:13:26.486034    6375 main.go:141] libmachine: (no-preload-098000) DBG | Using UUID 27822d2d-2a13-49c1-b81b-237733c56921
	I0307 14:13:26.522295    6375 main.go:141] libmachine: (no-preload-098000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:26.522376    6375 client.go:171] duration metric: took 679.822498ms to LocalClient.Create
	I0307 14:13:27.788294    6375 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1
	I0307 14:13:27.922893    6375 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2
	I0307 14:13:27.943263    6375 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9
	I0307 14:13:27.961441    6375 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0
	I0307 14:13:27.962404    6375 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2
	I0307 14:13:27.964910    6375 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2
	I0307 14:13:27.991473    6375 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2
	I0307 14:13:28.034926    6375 cache.go:157] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 exists
	I0307 14:13:28.034940    6375 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9" took 2.247823185s
	I0307 14:13:28.034947    6375 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 succeeded
	I0307 14:13:28.522599    6375 start.go:128] duration metric: took 2.7339722s to createHost
	I0307 14:13:28.522613    6375 start.go:83] releasing machines lock for "no-preload-098000", held for 2.734300047s
	W0307 14:13:28.522633    6375 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:13:28.522905    6375 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:28.522920    6375 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:28.531082    6375 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51741
	I0307 14:13:28.531453    6375 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:28.531796    6375 main.go:141] libmachine: Using API Version  1
	I0307 14:13:28.531807    6375 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:28.532012    6375 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:28.532341    6375 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:28.532356    6375 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:28.540198    6375 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51743
	I0307 14:13:28.540522    6375 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:28.541060    6375 main.go:141] libmachine: Using API Version  1
	I0307 14:13:28.541071    6375 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:28.541443    6375 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:28.541551    6375 main.go:141] libmachine: (no-preload-098000) Calling .GetState
	I0307 14:13:28.541636    6375 main.go:141] libmachine: (no-preload-098000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:28.541654    6375 main.go:141] libmachine: (no-preload-098000) DBG | hyperkit pid from json: 0
	I0307 14:13:28.541664    6375 main.go:141] libmachine: (no-preload-098000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000/hyperkit.json: no such file or directory
	I0307 14:13:28.541758    6375 main.go:141] libmachine: (no-preload-098000) Calling .DriverName
	I0307 14:13:28.586173    6375 out.go:177] * Deleting "no-preload-098000" in hyperkit ...
	I0307 14:13:28.609599    6375 main.go:141] libmachine: (no-preload-098000) Calling .Remove
	I0307 14:13:28.609772    6375 main.go:141] libmachine: (no-preload-098000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:28.609798    6375 main.go:141] libmachine: (no-preload-098000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:28.609817    6375 main.go:141] libmachine: (no-preload-098000) DBG | hyperkit pid from json: 0
	I0307 14:13:28.609829    6375 main.go:141] libmachine: (no-preload-098000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000/hyperkit.json: no such file or directory
	W0307 14:13:28.626550    6375 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:28.626564    6375 start.go:728] Will try again in 5 seconds ...
	I0307 14:13:31.729391    6375 cache.go:157] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 exists
	I0307 14:13:31.729411    6375 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1" took 5.942039841s
	I0307 14:13:31.729421    6375 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
	I0307 14:13:31.900609    6375 cache.go:157] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 exists
	I0307 14:13:31.900630    6375 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2" took 6.113375929s
	I0307 14:13:31.900639    6375 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 succeeded
	I0307 14:13:33.626912    6375 start.go:360] acquireMachinesLock for no-preload-098000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:33.627007    6375 start.go:364] duration metric: took 70.582µs to acquireMachinesLock for "no-preload-098000"
	I0307 14:13:33.627033    6375 start.go:93] Provisioning new machine with config: &{Name:no-preload-098000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-098000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptio
ns:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:13:33.627124    6375 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:13:33.650884    6375 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:13:33.650998    6375 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:33.651026    6375 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:33.659511    6375 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51769
	I0307 14:13:33.659888    6375 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:33.660307    6375 main.go:141] libmachine: Using API Version  1
	I0307 14:13:33.660317    6375 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:33.660513    6375 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:33.660628    6375 main.go:141] libmachine: (no-preload-098000) Calling .GetMachineName
	I0307 14:13:33.660715    6375 main.go:141] libmachine: (no-preload-098000) Calling .DriverName
	I0307 14:13:33.660833    6375 start.go:159] libmachine.API.Create for "no-preload-098000" (driver="hyperkit")
	I0307 14:13:33.660848    6375 client.go:168] LocalClient.Create starting
	I0307 14:13:33.660875    6375 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:13:33.660916    6375 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:33.660926    6375 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:33.660969    6375 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:13:33.660998    6375 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:33.661011    6375 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:33.661026    6375 main.go:141] libmachine: Running pre-create checks...
	I0307 14:13:33.661033    6375 main.go:141] libmachine: (no-preload-098000) Calling .PreCreateCheck
	I0307 14:13:33.661129    6375 main.go:141] libmachine: (no-preload-098000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:33.661169    6375 main.go:141] libmachine: (no-preload-098000) Calling .GetConfigRaw
	I0307 14:13:33.661619    6375 main.go:141] libmachine: Creating machine...
	I0307 14:13:33.661628    6375 main.go:141] libmachine: (no-preload-098000) Calling .Create
	I0307 14:13:33.661695    6375 main.go:141] libmachine: (no-preload-098000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:33.661818    6375 main.go:141] libmachine: (no-preload-098000) DBG | I0307 14:13:33.661682    6447 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:33.661891    6375 main.go:141] libmachine: (no-preload-098000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:13:33.835930    6375 main.go:141] libmachine: (no-preload-098000) DBG | I0307 14:13:33.835867    6447 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000/id_rsa...
	I0307 14:13:33.995084    6375 main.go:141] libmachine: (no-preload-098000) DBG | I0307 14:13:33.994979    6447 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000/no-preload-098000.rawdisk...
	I0307 14:13:33.995107    6375 main.go:141] libmachine: (no-preload-098000) DBG | Writing magic tar header
	I0307 14:13:33.995115    6375 main.go:141] libmachine: (no-preload-098000) DBG | Writing SSH key tar header
	I0307 14:13:33.995776    6375 main.go:141] libmachine: (no-preload-098000) DBG | I0307 14:13:33.995715    6447 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000 ...
	I0307 14:13:34.356016    6375 main.go:141] libmachine: (no-preload-098000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:34.356035    6375 main.go:141] libmachine: (no-preload-098000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000/hyperkit.pid
	I0307 14:13:34.356048    6375 main.go:141] libmachine: (no-preload-098000) DBG | Using UUID a4001bf1-ead9-4d65-932b-ae2494c3ee2d
	I0307 14:13:34.394991    6375 main.go:141] libmachine: (no-preload-098000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:34.395089    6375 client.go:171] duration metric: took 734.221079ms to LocalClient.Create
	I0307 14:13:34.440682    6375 cache.go:157] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 exists
	I0307 14:13:34.440701    6375 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2" took 8.653625644s
	I0307 14:13:34.440710    6375 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 succeeded
	I0307 14:13:34.771945    6375 cache.go:157] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 exists
	I0307 14:13:34.771965    6375 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2" took 8.984860419s
	I0307 14:13:34.771974    6375 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 succeeded
	I0307 14:13:35.118982    6375 cache.go:157] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 exists
	I0307 14:13:35.118998    6375 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2" took 9.331670704s
	I0307 14:13:35.119006    6375 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 succeeded
	I0307 14:13:36.395240    6375 start.go:128] duration metric: took 2.768085175s to createHost
	I0307 14:13:36.395256    6375 start.go:83] releasing machines lock for "no-preload-098000", held for 2.768222534s
	W0307 14:13:36.395333    6375 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p no-preload-098000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p no-preload-098000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:36.437451    6375 out.go:177] 
	W0307 14:13:36.474779    6375 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:13:36.474845    6375 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:13:36.474882    6375 out.go:239] * Related issues:
	* Related issues:
	W0307 14:13:36.474897    6375 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:13:36.474907    6375 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:13:36.516504    6375 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p no-preload-098000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000: exit status 7 (99.243287ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-098000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/FirstStart (11.35s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/DeployApp (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context old-k8s-version-202000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context old-k8s-version-202000 create -f testdata/busybox.yaml: exit status 1 (37.092785ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-202000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context old-k8s-version-202000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000: exit status 7 (72.06482ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-202000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000: exit status 7 (72.18873ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-202000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/DeployApp (0.18s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p old-k8s-version-202000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context old-k8s-version-202000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context old-k8s-version-202000 describe deploy/metrics-server -n kube-system: exit status 1 (36.852376ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-202000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context old-k8s-version-202000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000: exit status 7 (72.621332ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-202000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/EnableAddonWhileActive (0.32s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/DeployApp (0.23s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context no-preload-098000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context no-preload-098000 create -f testdata/busybox.yaml: exit status 1 (37.694638ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-098000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context no-preload-098000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000: exit status 7 (113.378394ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-098000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000: exit status 7 (76.624819ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-098000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/DeployApp (0.23s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/SecondStart (6.17s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p old-k8s-version-202000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p old-k8s-version-202000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0: exit status 60 (6.096912729s)

                                                
                                                
-- stdout --
	* [old-k8s-version-202000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
	* Using the hyperkit driver based on existing profile
	* Starting "old-k8s-version-202000" primary control-plane node in "old-k8s-version-202000" cluster
	* Restarting existing hyperkit VM for "old-k8s-version-202000" ...
	* Restarting existing hyperkit VM for "old-k8s-version-202000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:13:36.896913    6477 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:13:36.897118    6477 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:36.897125    6477 out.go:304] Setting ErrFile to fd 2...
	I0307 14:13:36.897129    6477 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:36.897301    6477 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:13:36.898858    6477 out.go:298] Setting JSON to false
	I0307 14:13:36.922273    6477 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2587,"bootTime":1709847029,"procs":506,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:13:36.922372    6477 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:13:36.944252    6477 out.go:177] * [old-k8s-version-202000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:13:37.008172    6477 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:13:36.986201    6477 notify.go:220] Checking for updates...
	I0307 14:13:37.050148    6477 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:13:37.112725    6477 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:13:37.154992    6477 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:13:37.217862    6477 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:37.260102    6477 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:13:37.281739    6477 config.go:182] Loaded profile config "old-k8s-version-202000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0307 14:13:37.282404    6477 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:37.282498    6477 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:37.291496    6477 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51802
	I0307 14:13:37.291880    6477 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:37.292292    6477 main.go:141] libmachine: Using API Version  1
	I0307 14:13:37.292303    6477 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:37.292550    6477 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:37.292665    6477 main.go:141] libmachine: (old-k8s-version-202000) Calling .DriverName
	I0307 14:13:37.327925    6477 out.go:177] * Kubernetes 1.28.4 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.28.4
	I0307 14:13:37.348734    6477 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:13:37.349083    6477 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:37.349108    6477 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:37.357077    6477 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51804
	I0307 14:13:37.357429    6477 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:37.357792    6477 main.go:141] libmachine: Using API Version  1
	I0307 14:13:37.357812    6477 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:37.358066    6477 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:37.358179    6477 main.go:141] libmachine: (old-k8s-version-202000) Calling .DriverName
	I0307 14:13:37.386763    6477 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 14:13:37.444892    6477 start.go:297] selected driver: hyperkit
	I0307 14:13:37.444916    6477 start.go:901] validating driver "hyperkit" against &{Name:old-k8s-version-202000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesC
onfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-202000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 Cert
Expiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:13:37.445131    6477 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:13:37.448812    6477 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:37.448910    6477 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:13:37.456818    6477 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:13:37.460891    6477 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:37.460916    6477 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:13:37.461061    6477 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:13:37.461126    6477 cni.go:84] Creating CNI manager for ""
	I0307 14:13:37.461139    6477 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0307 14:13:37.461179    6477 start.go:340] cluster config:
	{Name:old-k8s-version-202000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:true NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:old-k8s-version-202000 Namespace:defa
ult APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion
:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:13:37.461263    6477 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:37.502940    6477 out.go:177] * Starting "old-k8s-version-202000" primary control-plane node in "old-k8s-version-202000" cluster
	I0307 14:13:37.524072    6477 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0307 14:13:37.524144    6477 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0307 14:13:37.524175    6477 cache.go:56] Caching tarball of preloaded images
	I0307 14:13:37.524361    6477 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:13:37.524380    6477 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0307 14:13:37.524517    6477 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/old-k8s-version-202000/config.json ...
	I0307 14:13:37.525342    6477 start.go:360] acquireMachinesLock for old-k8s-version-202000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:37.525438    6477 start.go:364] duration metric: took 71.983µs to acquireMachinesLock for "old-k8s-version-202000"
	I0307 14:13:37.525474    6477 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:13:37.525491    6477 fix.go:54] fixHost starting: 
	I0307 14:13:37.525902    6477 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:37.525943    6477 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:37.535042    6477 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51809
	I0307 14:13:37.535435    6477 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:37.535806    6477 main.go:141] libmachine: Using API Version  1
	I0307 14:13:37.535816    6477 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:37.536066    6477 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:37.536206    6477 main.go:141] libmachine: (old-k8s-version-202000) Calling .DriverName
	I0307 14:13:37.536309    6477 main.go:141] libmachine: (old-k8s-version-202000) Calling .GetState
	I0307 14:13:37.536425    6477 main.go:141] libmachine: (old-k8s-version-202000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:37.536440    6477 main.go:141] libmachine: (old-k8s-version-202000) DBG | hyperkit pid from json: 0
	I0307 14:13:37.536454    6477 main.go:141] libmachine: (old-k8s-version-202000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000/hyperkit.json: no such file or directory
	I0307 14:13:37.536482    6477 fix.go:112] recreateIfNeeded on old-k8s-version-202000: state=Stopped err=<nil>
	I0307 14:13:37.536500    6477 main.go:141] libmachine: (old-k8s-version-202000) Calling .DriverName
	W0307 14:13:37.536597    6477 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:13:37.578778    6477 out.go:177] * Restarting existing hyperkit VM for "old-k8s-version-202000" ...
	I0307 14:13:37.642024    6477 main.go:141] libmachine: (old-k8s-version-202000) Calling .Start
	I0307 14:13:37.642341    6477 main.go:141] libmachine: (old-k8s-version-202000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:37.642385    6477 main.go:141] libmachine: (old-k8s-version-202000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000/hyperkit.pid
	I0307 14:13:37.642472    6477 main.go:141] libmachine: (old-k8s-version-202000) DBG | Using UUID 15c70b91-caf6-4610-8030-a691b88ef107
	I0307 14:13:37.644346    6477 main.go:141] libmachine: (old-k8s-version-202000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:37.644399    6477 fix.go:56] duration metric: took 118.912396ms for fixHost
	I0307 14:13:37.644408    6477 start.go:83] releasing machines lock for "old-k8s-version-202000", held for 118.957264ms
	W0307 14:13:37.644421    6477 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 14:13:37.644474    6477 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:37.644480    6477 start.go:728] Will try again in 5 seconds ...
	I0307 14:13:42.646657    6477 start.go:360] acquireMachinesLock for old-k8s-version-202000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:42.646841    6477 start.go:364] duration metric: took 115.881µs to acquireMachinesLock for "old-k8s-version-202000"
	I0307 14:13:42.646874    6477 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:13:42.646881    6477 fix.go:54] fixHost starting: 
	I0307 14:13:42.647309    6477 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:42.647346    6477 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:42.656693    6477 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51839
	I0307 14:13:42.657059    6477 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:42.657396    6477 main.go:141] libmachine: Using API Version  1
	I0307 14:13:42.657406    6477 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:42.657606    6477 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:42.657751    6477 main.go:141] libmachine: (old-k8s-version-202000) Calling .DriverName
	I0307 14:13:42.657854    6477 main.go:141] libmachine: (old-k8s-version-202000) Calling .GetState
	I0307 14:13:42.657941    6477 main.go:141] libmachine: (old-k8s-version-202000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:42.657963    6477 main.go:141] libmachine: (old-k8s-version-202000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000/hyperkit.json: no such file or directory
	I0307 14:13:42.657971    6477 main.go:141] libmachine: (old-k8s-version-202000) DBG | hyperkit pid from json: 0
	I0307 14:13:42.657987    6477 fix.go:112] recreateIfNeeded on old-k8s-version-202000: state=Stopped err=<nil>
	I0307 14:13:42.657998    6477 main.go:141] libmachine: (old-k8s-version-202000) Calling .DriverName
	W0307 14:13:42.658081    6477 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:13:42.701502    6477 out.go:177] * Restarting existing hyperkit VM for "old-k8s-version-202000" ...
	I0307 14:13:42.722307    6477 main.go:141] libmachine: (old-k8s-version-202000) Calling .Start
	I0307 14:13:42.722606    6477 main.go:141] libmachine: (old-k8s-version-202000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:42.722635    6477 main.go:141] libmachine: (old-k8s-version-202000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000/hyperkit.pid
	I0307 14:13:42.722749    6477 main.go:141] libmachine: (old-k8s-version-202000) DBG | Using UUID 15c70b91-caf6-4610-8030-a691b88ef107
	I0307 14:13:42.761436    6477 main.go:141] libmachine: (old-k8s-version-202000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:42.761532    6477 fix.go:56] duration metric: took 114.649103ms for fixHost
	I0307 14:13:42.761541    6477 start.go:83] releasing machines lock for "old-k8s-version-202000", held for 114.686897ms
	W0307 14:13:42.761624    6477 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-202000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p old-k8s-version-202000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:42.804561    6477 out.go:177] 
	W0307 14:13:42.825441    6477 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:13:42.825514    6477 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:13:42.825538    6477 out.go:239] * Related issues:
	* Related issues:
	W0307 14:13:42.825581    6477 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:13:42.825611    6477 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:13:42.868652    6477 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p old-k8s-version-202000 --memory=2200 --alsologtostderr --wait=true --kvm-network=default --kvm-qemu-uri=qemu:///system --disable-driver-mounts --keep-context=false --driver=hyperkit  --kubernetes-version=v1.20.0": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000: exit status 7 (73.543625ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-202000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/SecondStart (6.17s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.53s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p no-preload-098000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context no-preload-098000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context no-preload-098000 describe deploy/metrics-server -n kube-system: exit status 1 (37.487328ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-098000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context no-preload-098000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000: exit status 7 (97.942934ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-098000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/EnableAddonWhileActive (0.53s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/SecondStart (6.99s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p no-preload-098000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p no-preload-098000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (6.909544492s)

                                                
                                                
-- stdout --
	* [no-preload-098000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "no-preload-098000" primary control-plane node in "no-preload-098000" cluster
	* Restarting existing hyperkit VM for "no-preload-098000" ...
	* Restarting existing hyperkit VM for "no-preload-098000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:13:41.060156    6528 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:13:41.060322    6528 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:41.060327    6528 out.go:304] Setting ErrFile to fd 2...
	I0307 14:13:41.060331    6528 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:41.061014    6528 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:13:41.062738    6528 out.go:298] Setting JSON to false
	I0307 14:13:41.085046    6528 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2592,"bootTime":1709847029,"procs":505,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:13:41.085154    6528 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:13:41.107278    6528 out.go:177] * [no-preload-098000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:13:41.149880    6528 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:13:41.149959    6528 notify.go:220] Checking for updates...
	I0307 14:13:41.192934    6528 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:13:41.234911    6528 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:13:41.277824    6528 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:13:41.299063    6528 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:41.321034    6528 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:13:41.343638    6528 config.go:182] Loaded profile config "no-preload-098000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0307 14:13:41.344293    6528 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:41.344383    6528 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:41.353296    6528 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51831
	I0307 14:13:41.353709    6528 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:41.354149    6528 main.go:141] libmachine: Using API Version  1
	I0307 14:13:41.354159    6528 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:41.354404    6528 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:41.354507    6528 main.go:141] libmachine: (no-preload-098000) Calling .DriverName
	I0307 14:13:41.354693    6528 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:13:41.354926    6528 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:41.354952    6528 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:41.362612    6528 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51833
	I0307 14:13:41.362942    6528 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:41.363313    6528 main.go:141] libmachine: Using API Version  1
	I0307 14:13:41.363330    6528 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:41.363523    6528 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:41.363635    6528 main.go:141] libmachine: (no-preload-098000) Calling .DriverName
	I0307 14:13:41.392111    6528 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 14:13:41.433709    6528 start.go:297] selected driver: hyperkit
	I0307 14:13:41.433736    6528 start.go:901] validating driver "hyperkit" against &{Name:no-preload-098000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-098000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0
CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:13:41.433949    6528 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:13:41.438115    6528 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:41.438242    6528 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:13:41.445968    6528 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:13:41.449739    6528 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:41.449772    6528 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:13:41.449909    6528 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:13:41.449968    6528 cni.go:84] Creating CNI manager for ""
	I0307 14:13:41.449987    6528 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:13:41.450058    6528 start.go:340] cluster config:
	{Name:no-preload-098000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:no-preload-098000 Namespace:default
APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVer
sion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:13:41.450140    6528 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:41.492833    6528 out.go:177] * Starting "no-preload-098000" primary control-plane node in "no-preload-098000" cluster
	I0307 14:13:41.513669    6528 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 14:13:41.513904    6528 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/no-preload-098000/config.json ...
	I0307 14:13:41.514002    6528 cache.go:107] acquiring lock: {Name:mk069966db05c69227f21aa62f22a2cadb8a5c03 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:41.514052    6528 cache.go:107] acquiring lock: {Name:mka0a794a9259c18f761087768b28db95a215385 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:41.514103    6528 cache.go:107] acquiring lock: {Name:mk4bda4825093c1c7800eccd5ae25053df8ea854 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:41.514226    6528 cache.go:115] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 exists
	I0307 14:13:41.514260    6528 cache.go:96] cache image "gcr.io/k8s-minikube/storage-provisioner:v5" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5" took 266.277µs
	I0307 14:13:41.514284    6528 cache.go:80] save to tar file gcr.io/k8s-minikube/storage-provisioner:v5 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/gcr.io/k8s-minikube/storage-provisioner_v5 succeeded
	I0307 14:13:41.514301    6528 image.go:134] retrieving image: registry.k8s.io/etcd:3.5.10-0
	I0307 14:13:41.514322    6528 cache.go:115] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 exists
	I0307 14:13:41.514284    6528 cache.go:107] acquiring lock: {Name:mkd92ad654b3164668ca22a54605d955dabea039 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:41.514346    6528 cache.go:96] cache image "registry.k8s.io/kube-proxy:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2" took 275.796µs
	I0307 14:13:41.514366    6528 cache.go:80] save to tar file registry.k8s.io/kube-proxy:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-proxy_v1.29.0-rc.2 succeeded
	I0307 14:13:41.514220    6528 cache.go:107] acquiring lock: {Name:mk0879d77b9c49573dee2dfd49f39b41a8014289 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:41.514339    6528 cache.go:107] acquiring lock: {Name:mkfce85cf4b77e4174090a227c8e8cf183ac4744 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:41.514346    6528 cache.go:107] acquiring lock: {Name:mk55b7d10f765ca492bfa0e9ff622370b103faa2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:41.514419    6528 cache.go:107] acquiring lock: {Name:mk43bcba4d3cc5d962b1021381f8cb1da3d28c9b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:41.514629    6528 cache.go:115] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 exists
	I0307 14:13:41.514672    6528 cache.go:96] cache image "registry.k8s.io/pause:3.9" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9" took 549.112µs
	I0307 14:13:41.514686    6528 cache.go:115] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 exists
	I0307 14:13:41.514706    6528 cache.go:115] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 exists
	I0307 14:13:41.514719    6528 cache.go:80] save to tar file registry.k8s.io/pause:3.9 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/pause_3.9 succeeded
	I0307 14:13:41.514723    6528 cache.go:115] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 exists
	I0307 14:13:41.514747    6528 cache.go:96] cache image "registry.k8s.io/kube-controller-manager:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2" took 546.974µs
	I0307 14:13:41.514742    6528 cache.go:96] cache image "registry.k8s.io/coredns/coredns:v1.11.1" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1" took 523.615µs
	I0307 14:13:41.514764    6528 cache.go:80] save to tar file registry.k8s.io/kube-controller-manager:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-controller-manager_v1.29.0-rc.2 succeeded
	I0307 14:13:41.514771    6528 cache.go:80] save to tar file registry.k8s.io/coredns/coredns:v1.11.1 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/coredns/coredns_v1.11.1 succeeded
	I0307 14:13:41.514764    6528 cache.go:96] cache image "registry.k8s.io/kube-apiserver:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2" took 438.963µs
	I0307 14:13:41.514797    6528 cache.go:115] /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 exists
	I0307 14:13:41.514826    6528 cache.go:96] cache image "registry.k8s.io/kube-scheduler:v1.29.0-rc.2" -> "/Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2" took 582.344µs
	I0307 14:13:41.514802    6528 cache.go:80] save to tar file registry.k8s.io/kube-apiserver:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-apiserver_v1.29.0-rc.2 succeeded
	I0307 14:13:41.514846    6528 cache.go:80] save to tar file registry.k8s.io/kube-scheduler:v1.29.0-rc.2 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/kube-scheduler_v1.29.0-rc.2 succeeded
	I0307 14:13:41.514982    6528 start.go:360] acquireMachinesLock for no-preload-098000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:41.515040    6528 start.go:364] duration metric: took 44.27µs to acquireMachinesLock for "no-preload-098000"
	I0307 14:13:41.515073    6528 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:13:41.515086    6528 fix.go:54] fixHost starting: 
	I0307 14:13:41.515362    6528 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:41.515387    6528 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:41.519542    6528 image.go:177] daemon lookup for registry.k8s.io/etcd:3.5.10-0: Error response from daemon: No such image: registry.k8s.io/etcd:3.5.10-0
	I0307 14:13:41.524216    6528 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51835
	I0307 14:13:41.524567    6528 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:41.524943    6528 main.go:141] libmachine: Using API Version  1
	I0307 14:13:41.524954    6528 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:41.525148    6528 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:41.525257    6528 main.go:141] libmachine: (no-preload-098000) Calling .DriverName
	I0307 14:13:41.525341    6528 main.go:141] libmachine: (no-preload-098000) Calling .GetState
	I0307 14:13:41.525425    6528 main.go:141] libmachine: (no-preload-098000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:41.525478    6528 fix.go:112] recreateIfNeeded on no-preload-098000: state=Stopped err=<nil>
	I0307 14:13:41.525495    6528 main.go:141] libmachine: (no-preload-098000) Calling .DriverName
	I0307 14:13:41.525497    6528 main.go:141] libmachine: (no-preload-098000) DBG | hyperkit pid from json: 0
	I0307 14:13:41.525523    6528 main.go:141] libmachine: (no-preload-098000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000/hyperkit.json: no such file or directory
	W0307 14:13:41.525576    6528 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:13:41.567869    6528 out.go:177] * Restarting existing hyperkit VM for "no-preload-098000" ...
	I0307 14:13:41.588686    6528 main.go:141] libmachine: (no-preload-098000) Calling .Start
	I0307 14:13:41.589064    6528 main.go:141] libmachine: (no-preload-098000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:41.589140    6528 main.go:141] libmachine: (no-preload-098000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000/hyperkit.pid
	I0307 14:13:41.589246    6528 main.go:141] libmachine: (no-preload-098000) DBG | Using UUID a4001bf1-ead9-4d65-932b-ae2494c3ee2d
	I0307 14:13:41.591047    6528 main.go:141] libmachine: (no-preload-098000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:41.591134    6528 fix.go:56] duration metric: took 76.048549ms for fixHost
	I0307 14:13:41.591148    6528 start.go:83] releasing machines lock for "no-preload-098000", held for 76.098362ms
	W0307 14:13:41.591168    6528 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 14:13:41.591225    6528 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:41.591234    6528 start.go:728] Will try again in 5 seconds ...
	I0307 14:13:44.198808    6528 cache.go:162] opening:  /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/images/amd64/registry.k8s.io/etcd_3.5.10-0
	I0307 14:13:46.591849    6528 start.go:360] acquireMachinesLock for no-preload-098000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:47.556565    6528 start.go:364] duration metric: took 964.686443ms to acquireMachinesLock for "no-preload-098000"
	I0307 14:13:47.556595    6528 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:13:47.556603    6528 fix.go:54] fixHost starting: 
	I0307 14:13:47.556947    6528 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:47.556975    6528 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:47.565528    6528 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51871
	I0307 14:13:47.565858    6528 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:47.566178    6528 main.go:141] libmachine: Using API Version  1
	I0307 14:13:47.566197    6528 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:47.566377    6528 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:47.566475    6528 main.go:141] libmachine: (no-preload-098000) Calling .DriverName
	I0307 14:13:47.566568    6528 main.go:141] libmachine: (no-preload-098000) Calling .GetState
	I0307 14:13:47.566644    6528 main.go:141] libmachine: (no-preload-098000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:47.566664    6528 main.go:141] libmachine: (no-preload-098000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000/hyperkit.json: no such file or directory
	I0307 14:13:47.566671    6528 main.go:141] libmachine: (no-preload-098000) DBG | hyperkit pid from json: 0
	I0307 14:13:47.566731    6528 fix.go:112] recreateIfNeeded on no-preload-098000: state=Stopped err=<nil>
	I0307 14:13:47.566752    6528 main.go:141] libmachine: (no-preload-098000) Calling .DriverName
	W0307 14:13:47.566831    6528 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:13:47.589499    6528 out.go:177] * Restarting existing hyperkit VM for "no-preload-098000" ...
	I0307 14:13:47.651079    6528 main.go:141] libmachine: (no-preload-098000) Calling .Start
	I0307 14:13:47.651231    6528 main.go:141] libmachine: (no-preload-098000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:47.651247    6528 main.go:141] libmachine: (no-preload-098000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000/hyperkit.pid
	I0307 14:13:47.651267    6528 main.go:141] libmachine: (no-preload-098000) DBG | Using UUID a4001bf1-ead9-4d65-932b-ae2494c3ee2d
	I0307 14:13:47.718882    6528 main.go:141] libmachine: (no-preload-098000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:47.718971    6528 fix.go:56] duration metric: took 162.36669ms for fixHost
	I0307 14:13:47.718979    6528 start.go:83] releasing machines lock for "no-preload-098000", held for 162.399046ms
	W0307 14:13:47.719039    6528 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p no-preload-098000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p no-preload-098000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:47.760072    6528 out.go:177] 
	W0307 14:13:47.783337    6528 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:13:47.783373    6528 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:13:47.783392    6528 out.go:239] * Related issues:
	* Related issues:
	W0307 14:13:47.783423    6528 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:13:47.783445    6528 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:13:47.826101    6528 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p no-preload-098000 --memory=2200 --alsologtostderr --wait=true --preload=false --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000: exit status 7 (74.016973ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-098000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/SecondStart (6.99s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-202000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000: exit status 7 (72.721564ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-202000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "old-k8s-version-202000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context old-k8s-version-202000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context old-k8s-version-202000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (37.235627ms)

                                                
                                                
** stderr ** 
	error: context "old-k8s-version-202000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context old-k8s-version-202000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000: exit status 7 (72.740822ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-202000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (0.11s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p old-k8s-version-202000 image list --format=json
start_stop_delete_test.go:304: v1.20.0 images missing (-want +got):
[]string{
- 	"k8s.gcr.io/coredns:1.7.0",
- 	"k8s.gcr.io/etcd:3.4.13-0",
- 	"k8s.gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"k8s.gcr.io/kube-apiserver:v1.20.0",
- 	"k8s.gcr.io/kube-controller-manager:v1.20.0",
- 	"k8s.gcr.io/kube-proxy:v1.20.0",
- 	"k8s.gcr.io/kube-scheduler:v1.20.0",
- 	"k8s.gcr.io/pause:3.2",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000: exit status 7 (72.569394ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-202000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Pause (0.28s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p old-k8s-version-202000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p old-k8s-version-202000 --alsologtostderr -v=1: exit status 83 (137.603998ms)

                                                
                                                
-- stdout --
	* The control-plane node old-k8s-version-202000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p old-k8s-version-202000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:13:43.429780    6561 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:13:43.429989    6561 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:43.429994    6561 out.go:304] Setting ErrFile to fd 2...
	I0307 14:13:43.429998    6561 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:43.430186    6561 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:13:43.430486    6561 out.go:298] Setting JSON to false
	I0307 14:13:43.430504    6561 mustload.go:65] Loading cluster: old-k8s-version-202000
	I0307 14:13:43.430781    6561 config.go:182] Loaded profile config "old-k8s-version-202000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.20.0
	I0307 14:13:43.431137    6561 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:43.431188    6561 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:43.438704    6561 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51855
	I0307 14:13:43.439167    6561 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:43.439688    6561 main.go:141] libmachine: Using API Version  1
	I0307 14:13:43.439704    6561 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:43.439918    6561 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:43.440031    6561 main.go:141] libmachine: (old-k8s-version-202000) Calling .GetState
	I0307 14:13:43.440118    6561 main.go:141] libmachine: (old-k8s-version-202000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:43.440148    6561 main.go:141] libmachine: (old-k8s-version-202000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/old-k8s-version-202000/hyperkit.json: no such file or directory
	I0307 14:13:43.440159    6561 main.go:141] libmachine: (old-k8s-version-202000) DBG | hyperkit pid from json: 0
	I0307 14:13:43.461204    6561 out.go:177] * The control-plane node old-k8s-version-202000 host is not running: state=Stopped
	I0307 14:13:43.482641    6561 out.go:177]   To start a cluster, run: "minikube start -p old-k8s-version-202000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p old-k8s-version-202000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000: exit status 7 (72.821044ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-202000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000: exit status 7 (72.48072ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "old-k8s-version-202000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/old-k8s-version/serial/Pause (0.28s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/FirstStart (11.65s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p embed-certs-564000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p embed-certs-564000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (11.575341889s)

                                                
                                                
-- stdout --
	* [embed-certs-564000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "embed-certs-564000" primary control-plane node in "embed-certs-564000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "embed-certs-564000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:13:44.404174    6591 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:13:44.404432    6591 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:44.404437    6591 out.go:304] Setting ErrFile to fd 2...
	I0307 14:13:44.404441    6591 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:44.404609    6591 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:13:44.405995    6591 out.go:298] Setting JSON to false
	I0307 14:13:44.428139    6591 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2595,"bootTime":1709847029,"procs":510,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:13:44.428257    6591 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:13:44.450357    6591 out.go:177] * [embed-certs-564000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:13:44.513186    6591 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:13:44.492235    6591 notify.go:220] Checking for updates...
	I0307 14:13:44.555109    6591 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:13:44.596869    6591 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:13:44.618118    6591 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:13:44.639246    6591 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:44.681069    6591 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:13:44.702810    6591 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:13:44.703106    6591 config.go:182] Loaded profile config "no-preload-098000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0307 14:13:44.703240    6591 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:13:44.731868    6591 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:13:44.774206    6591 start.go:297] selected driver: hyperkit
	I0307 14:13:44.774259    6591 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:13:44.774284    6591 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:13:44.777180    6591 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:44.777283    6591 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:13:44.784906    6591 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:13:44.788716    6591 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:44.788738    6591 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:13:44.788767    6591 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:13:44.788978    6591 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:13:44.789035    6591 cni.go:84] Creating CNI manager for ""
	I0307 14:13:44.789052    6591 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:13:44.789059    6591 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 14:13:44.789120    6591 start.go:340] cluster config:
	{Name:embed-certs-564000 KeepContext:false EmbedCerts:true MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-564000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local Conta
inerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthS
ock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:13:44.789205    6591 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:44.831049    6591 out.go:177] * Starting "embed-certs-564000" primary control-plane node in "embed-certs-564000" cluster
	I0307 14:13:44.852088    6591 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:13:44.852137    6591 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:13:44.852154    6591 cache.go:56] Caching tarball of preloaded images
	I0307 14:13:44.852247    6591 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:13:44.852255    6591 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:13:44.852331    6591 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/embed-certs-564000/config.json ...
	I0307 14:13:44.852348    6591 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/embed-certs-564000/config.json: {Name:mkaefc0bd359910845452aebb4a706ceb67d3b73 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:13:44.852658    6591 start.go:360] acquireMachinesLock for embed-certs-564000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:44.852720    6591 start.go:364] duration metric: took 51.441µs to acquireMachinesLock for "embed-certs-564000"
	I0307 14:13:44.852746    6591 start.go:93] Provisioning new machine with config: &{Name:embed-certs-564000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-564000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou
ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:13:44.852787    6591 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:13:44.895224    6591 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:13:44.895451    6591 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:44.895495    6591 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:44.903578    6591 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51869
	I0307 14:13:44.903940    6591 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:44.904376    6591 main.go:141] libmachine: Using API Version  1
	I0307 14:13:44.904407    6591 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:44.904618    6591 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:44.904719    6591 main.go:141] libmachine: (embed-certs-564000) Calling .GetMachineName
	I0307 14:13:44.904884    6591 main.go:141] libmachine: (embed-certs-564000) Calling .DriverName
	I0307 14:13:44.904996    6591 start.go:159] libmachine.API.Create for "embed-certs-564000" (driver="hyperkit")
	I0307 14:13:44.905018    6591 client.go:168] LocalClient.Create starting
	I0307 14:13:44.905049    6591 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:13:44.905103    6591 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:44.905118    6591 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:44.905173    6591 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:13:44.905209    6591 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:44.905220    6591 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:44.905234    6591 main.go:141] libmachine: Running pre-create checks...
	I0307 14:13:44.905245    6591 main.go:141] libmachine: (embed-certs-564000) Calling .PreCreateCheck
	I0307 14:13:44.905318    6591 main.go:141] libmachine: (embed-certs-564000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:44.905471    6591 main.go:141] libmachine: (embed-certs-564000) Calling .GetConfigRaw
	I0307 14:13:44.905904    6591 main.go:141] libmachine: Creating machine...
	I0307 14:13:44.905912    6591 main.go:141] libmachine: (embed-certs-564000) Calling .Create
	I0307 14:13:44.905980    6591 main.go:141] libmachine: (embed-certs-564000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:44.906086    6591 main.go:141] libmachine: (embed-certs-564000) DBG | I0307 14:13:44.905965    6599 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:44.906133    6591 main.go:141] libmachine: (embed-certs-564000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:13:45.078578    6591 main.go:141] libmachine: (embed-certs-564000) DBG | I0307 14:13:45.078474    6599 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000/id_rsa...
	I0307 14:13:45.158627    6591 main.go:141] libmachine: (embed-certs-564000) DBG | I0307 14:13:45.158582    6599 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000/embed-certs-564000.rawdisk...
	I0307 14:13:45.158639    6591 main.go:141] libmachine: (embed-certs-564000) DBG | Writing magic tar header
	I0307 14:13:45.158652    6591 main.go:141] libmachine: (embed-certs-564000) DBG | Writing SSH key tar header
	I0307 14:13:45.159334    6591 main.go:141] libmachine: (embed-certs-564000) DBG | I0307 14:13:45.159300    6599 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000 ...
	I0307 14:13:45.518048    6591 main.go:141] libmachine: (embed-certs-564000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:45.518070    6591 main.go:141] libmachine: (embed-certs-564000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000/hyperkit.pid
	I0307 14:13:45.518123    6591 main.go:141] libmachine: (embed-certs-564000) DBG | Using UUID 34643999-425d-46fe-a1fd-9a337b2a715b
	I0307 14:13:45.555703    6591 main.go:141] libmachine: (embed-certs-564000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:45.555789    6591 client.go:171] duration metric: took 650.757756ms to LocalClient.Create
	I0307 14:13:47.556508    6591 start.go:128] duration metric: took 2.703686916s to createHost
	I0307 14:13:47.556524    6591 start.go:83] releasing machines lock for "embed-certs-564000", held for 2.703778146s
	W0307 14:13:47.556544    6591 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:13:47.556974    6591 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:47.557000    6591 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:47.565398    6591 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51872
	I0307 14:13:47.565751    6591 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:47.566106    6591 main.go:141] libmachine: Using API Version  1
	I0307 14:13:47.566119    6591 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:47.566391    6591 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:47.566745    6591 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:47.566771    6591 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:47.574653    6591 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51875
	I0307 14:13:47.574984    6591 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:47.575318    6591 main.go:141] libmachine: Using API Version  1
	I0307 14:13:47.575330    6591 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:47.575532    6591 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:47.575628    6591 main.go:141] libmachine: (embed-certs-564000) Calling .GetState
	I0307 14:13:47.575702    6591 main.go:141] libmachine: (embed-certs-564000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:47.575729    6591 main.go:141] libmachine: (embed-certs-564000) DBG | hyperkit pid from json: 0
	I0307 14:13:47.575744    6591 main.go:141] libmachine: (embed-certs-564000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000/hyperkit.json: no such file or directory
	I0307 14:13:47.575771    6591 main.go:141] libmachine: (embed-certs-564000) Calling .DriverName
	I0307 14:13:47.630094    6591 out.go:177] * Deleting "embed-certs-564000" in hyperkit ...
	I0307 14:13:47.672053    6591 main.go:141] libmachine: (embed-certs-564000) Calling .Remove
	I0307 14:13:47.672232    6591 main.go:141] libmachine: (embed-certs-564000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:47.672248    6591 main.go:141] libmachine: (embed-certs-564000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000/hyperkit.json: no such file or directory
	I0307 14:13:47.672254    6591 main.go:141] libmachine: (embed-certs-564000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:47.672266    6591 main.go:141] libmachine: (embed-certs-564000) DBG | hyperkit pid from json: 0
	W0307 14:13:47.690058    6591 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:47.690075    6591 start.go:728] Will try again in 5 seconds ...
	I0307 14:13:52.691341    6591 start.go:360] acquireMachinesLock for embed-certs-564000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:52.893832    6591 start.go:364] duration metric: took 202.451136ms to acquireMachinesLock for "embed-certs-564000"
	I0307 14:13:52.893874    6591 start.go:93] Provisioning new machine with config: &{Name:embed-certs-564000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-564000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] Mou
ntPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:13:52.893966    6591 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:13:52.915739    6591 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:13:52.915812    6591 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:52.915851    6591 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:52.923626    6591 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51910
	I0307 14:13:52.923957    6591 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:52.924276    6591 main.go:141] libmachine: Using API Version  1
	I0307 14:13:52.924297    6591 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:52.924502    6591 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:52.924596    6591 main.go:141] libmachine: (embed-certs-564000) Calling .GetMachineName
	I0307 14:13:52.924671    6591 main.go:141] libmachine: (embed-certs-564000) Calling .DriverName
	I0307 14:13:52.924792    6591 start.go:159] libmachine.API.Create for "embed-certs-564000" (driver="hyperkit")
	I0307 14:13:52.924817    6591 client.go:168] LocalClient.Create starting
	I0307 14:13:52.924868    6591 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:13:52.924913    6591 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:52.924927    6591 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:52.924975    6591 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:13:52.925000    6591 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:52.925014    6591 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:52.925028    6591 main.go:141] libmachine: Running pre-create checks...
	I0307 14:13:52.925034    6591 main.go:141] libmachine: (embed-certs-564000) Calling .PreCreateCheck
	I0307 14:13:52.925125    6591 main.go:141] libmachine: (embed-certs-564000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:52.925150    6591 main.go:141] libmachine: (embed-certs-564000) Calling .GetConfigRaw
	I0307 14:13:52.961361    6591 main.go:141] libmachine: Creating machine...
	I0307 14:13:52.961430    6591 main.go:141] libmachine: (embed-certs-564000) Calling .Create
	I0307 14:13:52.961681    6591 main.go:141] libmachine: (embed-certs-564000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:52.961932    6591 main.go:141] libmachine: (embed-certs-564000) DBG | I0307 14:13:52.961643    6673 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:52.962079    6591 main.go:141] libmachine: (embed-certs-564000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:13:53.189512    6591 main.go:141] libmachine: (embed-certs-564000) DBG | I0307 14:13:53.189412    6673 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000/id_rsa...
	I0307 14:13:53.366557    6591 main.go:141] libmachine: (embed-certs-564000) DBG | I0307 14:13:53.366470    6673 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000/embed-certs-564000.rawdisk...
	I0307 14:13:53.366580    6591 main.go:141] libmachine: (embed-certs-564000) DBG | Writing magic tar header
	I0307 14:13:53.366590    6591 main.go:141] libmachine: (embed-certs-564000) DBG | Writing SSH key tar header
	I0307 14:13:53.367172    6591 main.go:141] libmachine: (embed-certs-564000) DBG | I0307 14:13:53.367132    6673 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000 ...
	I0307 14:13:53.725778    6591 main.go:141] libmachine: (embed-certs-564000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:53.725801    6591 main.go:141] libmachine: (embed-certs-564000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000/hyperkit.pid
	I0307 14:13:53.725814    6591 main.go:141] libmachine: (embed-certs-564000) DBG | Using UUID 50d02004-0ecc-4fa4-afc6-c4e0a7905489
	I0307 14:13:53.761449    6591 main.go:141] libmachine: (embed-certs-564000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:53.761539    6591 client.go:171] duration metric: took 836.708858ms to LocalClient.Create
	I0307 14:13:55.762731    6591 start.go:128] duration metric: took 2.868723348s to createHost
	I0307 14:13:55.762770    6591 start.go:83] releasing machines lock for "embed-certs-564000", held for 2.868903828s
	W0307 14:13:55.762901    6591 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p embed-certs-564000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p embed-certs-564000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:55.788961    6591 out.go:177] 
	W0307 14:13:55.813501    6591 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:13:55.813544    6591 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:13:55.813558    6591 out.go:239] * Related issues:
	* Related issues:
	W0307 14:13:55.813579    6591 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:13:55.813616    6591 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:13:55.856299    6591 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p embed-certs-564000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000: exit status 7 (73.028521ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-564000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/FirstStart (11.65s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-098000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000: exit status 7 (72.351192ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-098000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "no-preload-098000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context no-preload-098000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context no-preload-098000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (36.854116ms)

                                                
                                                
** stderr ** 
	error: context "no-preload-098000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context no-preload-098000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000: exit status 7 (73.470648ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-098000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/AddonExistsAfterStop (0.11s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p no-preload-098000 image list --format=json
start_stop_delete_test.go:304: v1.29.0-rc.2 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.1",
- 	"registry.k8s.io/etcd:3.5.10-0",
- 	"registry.k8s.io/kube-apiserver:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-controller-manager:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-proxy:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-scheduler:v1.29.0-rc.2",
- 	"registry.k8s.io/pause:3.9",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000: exit status 7 (72.853124ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-098000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Pause (0.28s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p no-preload-098000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p no-preload-098000 --alsologtostderr -v=1: exit status 83 (137.326431ms)

                                                
                                                
-- stdout --
	* The control-plane node no-preload-098000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p no-preload-098000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:13:48.411364    6621 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:13:48.411635    6621 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:48.411641    6621 out.go:304] Setting ErrFile to fd 2...
	I0307 14:13:48.411645    6621 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:48.411836    6621 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:13:48.412152    6621 out.go:298] Setting JSON to false
	I0307 14:13:48.412167    6621 mustload.go:65] Loading cluster: no-preload-098000
	I0307 14:13:48.412462    6621 config.go:182] Loaded profile config "no-preload-098000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0307 14:13:48.412793    6621 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:48.412853    6621 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:48.420354    6621 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51891
	I0307 14:13:48.420777    6621 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:48.421239    6621 main.go:141] libmachine: Using API Version  1
	I0307 14:13:48.421248    6621 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:48.421472    6621 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:48.421585    6621 main.go:141] libmachine: (no-preload-098000) Calling .GetState
	I0307 14:13:48.421668    6621 main.go:141] libmachine: (no-preload-098000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:48.421717    6621 main.go:141] libmachine: (no-preload-098000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/no-preload-098000/hyperkit.json: no such file or directory
	I0307 14:13:48.421749    6621 main.go:141] libmachine: (no-preload-098000) DBG | hyperkit pid from json: 0
	I0307 14:13:48.443918    6621 out.go:177] * The control-plane node no-preload-098000 host is not running: state=Stopped
	I0307 14:13:48.465371    6621 out.go:177]   To start a cluster, run: "minikube start -p no-preload-098000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p no-preload-098000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000: exit status 7 (72.562101ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-098000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000: exit status 7 (72.829321ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "no-preload-098000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/no-preload/serial/Pause (0.28s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/FirstStart (11.41s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p default-k8s-diff-port-190000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p default-k8s-diff-port-190000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (11.330102841s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-190000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "default-k8s-diff-port-190000" primary control-plane node in "default-k8s-diff-port-190000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "default-k8s-diff-port-190000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:13:49.765609    6661 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:13:49.765851    6661 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:49.765856    6661 out.go:304] Setting ErrFile to fd 2...
	I0307 14:13:49.765860    6661 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:13:49.766036    6661 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:13:49.767408    6661 out.go:298] Setting JSON to false
	I0307 14:13:49.789646    6661 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2600,"bootTime":1709847029,"procs":510,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:13:49.789795    6661 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:13:49.812154    6661 out.go:177] * [default-k8s-diff-port-190000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:13:49.854816    6661 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:13:49.854845    6661 notify.go:220] Checking for updates...
	I0307 14:13:49.898635    6661 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:13:49.920776    6661 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:13:49.941967    6661 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:13:49.968632    6661 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:49.990823    6661 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:13:50.013152    6661 config.go:182] Loaded profile config "embed-certs-564000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:13:50.013267    6661 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:13:50.013386    6661 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:13:50.042435    6661 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:13:50.084439    6661 start.go:297] selected driver: hyperkit
	I0307 14:13:50.084463    6661 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:13:50.084501    6661 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:13:50.088271    6661 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:50.088377    6661 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:13:50.095945    6661 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:13:50.099606    6661 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:50.099640    6661 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:13:50.099677    6661 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 14:13:50.099898    6661 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:13:50.099954    6661 cni.go:84] Creating CNI manager for ""
	I0307 14:13:50.099970    6661 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:13:50.099977    6661 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 14:13:50.100041    6661 start.go:340] cluster config:
	{Name:default-k8s-diff-port-190000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-190000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomai
n:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPat
h: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:13:50.100122    6661 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:13:50.142485    6661 out.go:177] * Starting "default-k8s-diff-port-190000" primary control-plane node in "default-k8s-diff-port-190000" cluster
	I0307 14:13:50.163363    6661 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:13:50.163425    6661 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:13:50.163443    6661 cache.go:56] Caching tarball of preloaded images
	I0307 14:13:50.163580    6661 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:13:50.163594    6661 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:13:50.163703    6661 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/default-k8s-diff-port-190000/config.json ...
	I0307 14:13:50.163727    6661 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/default-k8s-diff-port-190000/config.json: {Name:mkeeef7e768a8463a42340dfff16fd7a7f030732 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:13:50.164311    6661 start.go:360] acquireMachinesLock for default-k8s-diff-port-190000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:50.164406    6661 start.go:364] duration metric: took 69.159µs to acquireMachinesLock for "default-k8s-diff-port-190000"
	I0307 14:13:50.164442    6661 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-190000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-190000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:13:50.164664    6661 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:13:50.186406    6661 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:13:50.186690    6661 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:50.186757    6661 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:50.195940    6661 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51904
	I0307 14:13:50.196367    6661 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:50.196798    6661 main.go:141] libmachine: Using API Version  1
	I0307 14:13:50.196823    6661 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:50.197032    6661 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:50.197124    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .GetMachineName
	I0307 14:13:50.197214    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .DriverName
	I0307 14:13:50.197319    6661 start.go:159] libmachine.API.Create for "default-k8s-diff-port-190000" (driver="hyperkit")
	I0307 14:13:50.197343    6661 client.go:168] LocalClient.Create starting
	I0307 14:13:50.197375    6661 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:13:50.197428    6661 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:50.197444    6661 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:50.197494    6661 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:13:50.197530    6661 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:50.197538    6661 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:50.197552    6661 main.go:141] libmachine: Running pre-create checks...
	I0307 14:13:50.197566    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .PreCreateCheck
	I0307 14:13:50.197648    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:50.197803    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .GetConfigRaw
	I0307 14:13:50.208041    6661 main.go:141] libmachine: Creating machine...
	I0307 14:13:50.208065    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .Create
	I0307 14:13:50.208325    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:50.208557    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | I0307 14:13:50.208288    6669 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:50.208693    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:13:50.381968    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | I0307 14:13:50.381903    6669 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000/id_rsa...
	I0307 14:13:50.501237    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | I0307 14:13:50.501165    6669 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000/default-k8s-diff-port-190000.rawdisk...
	I0307 14:13:50.501251    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | Writing magic tar header
	I0307 14:13:50.501259    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | Writing SSH key tar header
	I0307 14:13:50.502073    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | I0307 14:13:50.501970    6669 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000 ...
	I0307 14:13:50.858372    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:50.858442    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000/hyperkit.pid
	I0307 14:13:50.858467    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | Using UUID afeca0a3-ccd8-46b7-a4b7-16bd76a0a03f
	I0307 14:13:50.893427    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:50.893509    6661 client.go:171] duration metric: took 696.149864ms to LocalClient.Create
	I0307 14:13:52.893766    6661 start.go:128] duration metric: took 2.729070194s to createHost
	I0307 14:13:52.893782    6661 start.go:83] releasing machines lock for "default-k8s-diff-port-190000", held for 2.729347914s
	W0307 14:13:52.893800    6661 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:13:52.894112    6661 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:52.894140    6661 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:52.902226    6661 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51906
	I0307 14:13:52.902585    6661 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:52.902948    6661 main.go:141] libmachine: Using API Version  1
	I0307 14:13:52.902958    6661 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:52.903147    6661 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:52.903473    6661 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:52.903496    6661 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:52.911302    6661 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51908
	I0307 14:13:52.911645    6661 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:52.911968    6661 main.go:141] libmachine: Using API Version  1
	I0307 14:13:52.911977    6661 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:52.912191    6661 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:52.912296    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .GetState
	I0307 14:13:52.912384    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:52.912407    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | hyperkit pid from json: 0
	I0307 14:13:52.912421    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000/hyperkit.json: no such file or directory
	I0307 14:13:52.912453    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .DriverName
	I0307 14:13:52.960332    6661 out.go:177] * Deleting "default-k8s-diff-port-190000" in hyperkit ...
	I0307 14:13:52.982427    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .Remove
	I0307 14:13:52.982731    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:52.982750    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:52.982770    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | hyperkit pid from json: 0
	I0307 14:13:52.982793    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000/hyperkit.json: no such file or directory
	W0307 14:13:53.000014    6661 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:13:53.000029    6661 start.go:728] Will try again in 5 seconds ...
	I0307 14:13:58.002119    6661 start.go:360] acquireMachinesLock for default-k8s-diff-port-190000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:13:58.002330    6661 start.go:364] duration metric: took 171.468µs to acquireMachinesLock for "default-k8s-diff-port-190000"
	I0307 14:13:58.002371    6661 start.go:93] Provisioning new machine with config: &{Name:default-k8s-diff-port-190000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-190000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:26214
4 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:13:58.002531    6661 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:13:58.025496    6661 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:13:58.025583    6661 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:13:58.025611    6661 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:13:58.033792    6661 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51937
	I0307 14:13:58.034157    6661 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:13:58.034478    6661 main.go:141] libmachine: Using API Version  1
	I0307 14:13:58.034501    6661 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:13:58.034702    6661 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:13:58.034801    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .GetMachineName
	I0307 14:13:58.034884    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .DriverName
	I0307 14:13:58.034982    6661 start.go:159] libmachine.API.Create for "default-k8s-diff-port-190000" (driver="hyperkit")
	I0307 14:13:58.034997    6661 client.go:168] LocalClient.Create starting
	I0307 14:13:58.035022    6661 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:13:58.035068    6661 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:58.035078    6661 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:58.035115    6661 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:13:58.035149    6661 main.go:141] libmachine: Decoding PEM data...
	I0307 14:13:58.035158    6661 main.go:141] libmachine: Parsing certificate...
	I0307 14:13:58.035171    6661 main.go:141] libmachine: Running pre-create checks...
	I0307 14:13:58.035177    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .PreCreateCheck
	I0307 14:13:58.035258    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:58.035286    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .GetConfigRaw
	I0307 14:13:58.035729    6661 main.go:141] libmachine: Creating machine...
	I0307 14:13:58.035738    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .Create
	I0307 14:13:58.035801    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:58.035922    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | I0307 14:13:58.035796    6707 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:13:58.035965    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:13:58.208793    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | I0307 14:13:58.208692    6707 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000/id_rsa...
	I0307 14:13:58.431053    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | I0307 14:13:58.430968    6707 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000/default-k8s-diff-port-190000.rawdisk...
	I0307 14:13:58.431071    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | Writing magic tar header
	I0307 14:13:58.431081    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | Writing SSH key tar header
	I0307 14:13:58.431889    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | I0307 14:13:58.431791    6707 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000 ...
	I0307 14:13:58.790297    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:13:58.790316    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000/hyperkit.pid
	I0307 14:13:58.790327    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | Using UUID 76a7f985-6bb0-4cc7-b9ab-41d35dcfa7ab
	I0307 14:13:58.825283    6661 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:13:58.825363    6661 client.go:171] duration metric: took 790.354101ms to LocalClient.Create
	I0307 14:14:00.825537    6661 start.go:128] duration metric: took 2.822952304s to createHost
	I0307 14:14:00.825566    6661 start.go:83] releasing machines lock for "default-k8s-diff-port-190000", held for 2.823199456s
	W0307 14:14:00.825698    6661 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-190000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-190000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:14:00.846324    6661 out.go:177] 
	W0307 14:14:00.910167    6661 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:14:00.910208    6661 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:14:00.910221    6661 out.go:239] * Related issues:
	* Related issues:
	W0307 14:14:00.910243    6661 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:14:00.910258    6661 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:14:00.952235    6661 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p default-k8s-diff-port-190000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000: exit status 7 (74.289139ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-190000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/FirstStart (11.41s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/DeployApp (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context embed-certs-564000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context embed-certs-564000 create -f testdata/busybox.yaml: exit status 1 (37.114729ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-564000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context embed-certs-564000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000: exit status 7 (72.15214ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-564000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000: exit status 7 (72.134324ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-564000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/DeployApp (0.18s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p embed-certs-564000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context embed-certs-564000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context embed-certs-564000 describe deploy/metrics-server -n kube-system: exit status 1 (36.736352ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-564000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context embed-certs-564000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000: exit status 7 (72.472784ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-564000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/EnableAddonWhileActive (0.32s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/SecondStart (6.54s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p embed-certs-564000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p embed-certs-564000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (6.426856248s)

                                                
                                                
-- stdout --
	* [embed-certs-564000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "embed-certs-564000" primary control-plane node in "embed-certs-564000" cluster
	* Restarting existing hyperkit VM for "embed-certs-564000" ...
	* Restarting existing hyperkit VM for "embed-certs-564000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:14:00.000438    6723 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:14:00.000709    6723 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:14:00.000715    6723 out.go:304] Setting ErrFile to fd 2...
	I0307 14:14:00.000719    6723 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:14:00.000899    6723 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:14:00.002568    6723 out.go:298] Setting JSON to false
	I0307 14:14:00.026778    6723 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2611,"bootTime":1709847029,"procs":497,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:14:00.026880    6723 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:14:00.049189    6723 out.go:177] * [embed-certs-564000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:14:00.091720    6723 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:14:00.091784    6723 notify.go:220] Checking for updates...
	I0307 14:14:00.134856    6723 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:14:00.155729    6723 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:14:00.176786    6723 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:14:00.197875    6723 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:14:00.219761    6723 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:14:00.241691    6723 config.go:182] Loaded profile config "embed-certs-564000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:14:00.242357    6723 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:00.242442    6723 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:00.251504    6723 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51952
	I0307 14:14:00.251858    6723 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:00.252307    6723 main.go:141] libmachine: Using API Version  1
	I0307 14:14:00.252332    6723 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:00.252536    6723 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:00.252634    6723 main.go:141] libmachine: (embed-certs-564000) Calling .DriverName
	I0307 14:14:00.252821    6723 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:14:00.253056    6723 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:00.253075    6723 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:00.260760    6723 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51954
	I0307 14:14:00.261108    6723 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:00.261493    6723 main.go:141] libmachine: Using API Version  1
	I0307 14:14:00.261511    6723 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:00.261711    6723 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:00.261796    6723 main.go:141] libmachine: (embed-certs-564000) Calling .DriverName
	I0307 14:14:00.289564    6723 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 14:14:00.331861    6723 start.go:297] selected driver: hyperkit
	I0307 14:14:00.331889    6723 start.go:901] validating driver "hyperkit" against &{Name:embed-certs-564000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-564000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpir
ation:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:14:00.332087    6723 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:14:00.336732    6723 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:14:00.336838    6723 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:14:00.344497    6723 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:14:00.348253    6723 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:00.348279    6723 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:14:00.348397    6723 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:14:00.348459    6723 cni.go:84] Creating CNI manager for ""
	I0307 14:14:00.348481    6723 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:14:00.348523    6723 start.go:340] cluster config:
	{Name:embed-certs-564000 KeepContext:false EmbedCerts:true MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:embed-certs-564000 Namespace:default APIS
erverHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p20
00.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:14:00.348627    6723 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:14:00.390782    6723 out.go:177] * Starting "embed-certs-564000" primary control-plane node in "embed-certs-564000" cluster
	I0307 14:14:00.412427    6723 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:14:00.412518    6723 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:14:00.412548    6723 cache.go:56] Caching tarball of preloaded images
	I0307 14:14:00.412771    6723 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:14:00.412789    6723 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:14:00.412936    6723 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/embed-certs-564000/config.json ...
	I0307 14:14:00.413613    6723 start.go:360] acquireMachinesLock for embed-certs-564000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:14:00.825658    6723 start.go:364] duration metric: took 411.987377ms to acquireMachinesLock for "embed-certs-564000"
	I0307 14:14:00.825723    6723 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:14:00.825744    6723 fix.go:54] fixHost starting: 
	I0307 14:14:00.826219    6723 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:00.826274    6723 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:00.835472    6723 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51956
	I0307 14:14:00.835866    6723 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:00.836244    6723 main.go:141] libmachine: Using API Version  1
	I0307 14:14:00.836260    6723 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:00.836506    6723 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:00.836624    6723 main.go:141] libmachine: (embed-certs-564000) Calling .DriverName
	I0307 14:14:00.836721    6723 main.go:141] libmachine: (embed-certs-564000) Calling .GetState
	I0307 14:14:00.836816    6723 main.go:141] libmachine: (embed-certs-564000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:00.836826    6723 main.go:141] libmachine: (embed-certs-564000) DBG | hyperkit pid from json: 0
	I0307 14:14:00.836839    6723 main.go:141] libmachine: (embed-certs-564000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000/hyperkit.json: no such file or directory
	I0307 14:14:00.836870    6723 fix.go:112] recreateIfNeeded on embed-certs-564000: state=Stopped err=<nil>
	I0307 14:14:00.836898    6723 main.go:141] libmachine: (embed-certs-564000) Calling .DriverName
	W0307 14:14:00.836984    6723 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:14:00.889043    6723 out.go:177] * Restarting existing hyperkit VM for "embed-certs-564000" ...
	I0307 14:14:00.931182    6723 main.go:141] libmachine: (embed-certs-564000) Calling .Start
	I0307 14:14:00.931469    6723 main.go:141] libmachine: (embed-certs-564000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:00.931506    6723 main.go:141] libmachine: (embed-certs-564000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000/hyperkit.pid
	I0307 14:14:00.931606    6723 main.go:141] libmachine: (embed-certs-564000) DBG | Using UUID 50d02004-0ecc-4fa4-afc6-c4e0a7905489
	I0307 14:14:00.933889    6723 main.go:141] libmachine: (embed-certs-564000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:14:00.934014    6723 fix.go:56] duration metric: took 108.273486ms for fixHost
	I0307 14:14:00.934028    6723 start.go:83] releasing machines lock for "embed-certs-564000", held for 108.348168ms
	W0307 14:14:00.934048    6723 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 14:14:00.934114    6723 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:14:00.934123    6723 start.go:728] Will try again in 5 seconds ...
	I0307 14:14:05.935198    6723 start.go:360] acquireMachinesLock for embed-certs-564000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:14:05.935417    6723 start.go:364] duration metric: took 135.453µs to acquireMachinesLock for "embed-certs-564000"
	I0307 14:14:05.935489    6723 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:14:05.935508    6723 fix.go:54] fixHost starting: 
	I0307 14:14:05.936014    6723 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:05.936095    6723 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:05.944580    6723 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51997
	I0307 14:14:05.944964    6723 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:05.945338    6723 main.go:141] libmachine: Using API Version  1
	I0307 14:14:05.945352    6723 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:05.945570    6723 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:05.945672    6723 main.go:141] libmachine: (embed-certs-564000) Calling .DriverName
	I0307 14:14:05.945761    6723 main.go:141] libmachine: (embed-certs-564000) Calling .GetState
	I0307 14:14:05.945843    6723 main.go:141] libmachine: (embed-certs-564000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:05.945855    6723 main.go:141] libmachine: (embed-certs-564000) DBG | hyperkit pid from json: 0
	I0307 14:14:05.945865    6723 main.go:141] libmachine: (embed-certs-564000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000/hyperkit.json: no such file or directory
	I0307 14:14:05.945899    6723 fix.go:112] recreateIfNeeded on embed-certs-564000: state=Stopped err=<nil>
	I0307 14:14:05.945909    6723 main.go:141] libmachine: (embed-certs-564000) Calling .DriverName
	W0307 14:14:05.945995    6723 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:14:05.978094    6723 out.go:177] * Restarting existing hyperkit VM for "embed-certs-564000" ...
	I0307 14:14:06.019909    6723 main.go:141] libmachine: (embed-certs-564000) Calling .Start
	I0307 14:14:06.020155    6723 main.go:141] libmachine: (embed-certs-564000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:06.020190    6723 main.go:141] libmachine: (embed-certs-564000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000/hyperkit.pid
	I0307 14:14:06.020251    6723 main.go:141] libmachine: (embed-certs-564000) DBG | Using UUID 50d02004-0ecc-4fa4-afc6-c4e0a7905489
	I0307 14:14:06.155980    6723 main.go:141] libmachine: (embed-certs-564000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:14:06.156085    6723 fix.go:56] duration metric: took 220.576393ms for fixHost
	I0307 14:14:06.156094    6723 start.go:83] releasing machines lock for "embed-certs-564000", held for 220.660874ms
	W0307 14:14:06.156163    6723 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p embed-certs-564000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p embed-certs-564000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:14:06.198210    6723 out.go:177] 
	W0307 14:14:06.240284    6723 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:14:06.240368    6723 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:14:06.240383    6723 out.go:239] * Related issues:
	* Related issues:
	W0307 14:14:06.240414    6723 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:14:06.240444    6723 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:14:06.281797    6723 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p embed-certs-564000 --memory=2200 --alsologtostderr --wait=true --embed-certs --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000: exit status 7 (109.994737ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-564000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/SecondStart (6.54s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/DeployApp
start_stop_delete_test.go:196: (dbg) Run:  kubectl --context default-k8s-diff-port-190000 create -f testdata/busybox.yaml
start_stop_delete_test.go:196: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-190000 create -f testdata/busybox.yaml: exit status 1 (36.722069ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-190000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:196: kubectl --context default-k8s-diff-port-190000 create -f testdata/busybox.yaml failed: exit status 1
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000: exit status 7 (72.072318ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-190000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000: exit status 7 (72.582154ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-190000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/DeployApp (0.18s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.32s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p default-k8s-diff-port-190000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:215: (dbg) Run:  kubectl --context default-k8s-diff-port-190000 describe deploy/metrics-server -n kube-system
start_stop_delete_test.go:215: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-190000 describe deploy/metrics-server -n kube-system: exit status 1 (37.493908ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-190000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:217: failed to get info on auto-pause deployments. args "kubectl --context default-k8s-diff-port-190000 describe deploy/metrics-server -n kube-system": exit status 1
start_stop_delete_test.go:221: addon did not load correct image. Expected to contain " fake.domain/registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000: exit status 7 (72.872347ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-190000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonWhileActive (0.32s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/SecondStart (6.09s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p default-k8s-diff-port-190000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p default-k8s-diff-port-190000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4: exit status 60 (6.010652858s)

                                                
                                                
-- stdout --
	* [default-k8s-diff-port-190000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "default-k8s-diff-port-190000" primary control-plane node in "default-k8s-diff-port-190000" cluster
	* Restarting existing hyperkit VM for "default-k8s-diff-port-190000" ...
	* Restarting existing hyperkit VM for "default-k8s-diff-port-190000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:14:05.824083    6787 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:14:05.824345    6787 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:14:05.824350    6787 out.go:304] Setting ErrFile to fd 2...
	I0307 14:14:05.824354    6787 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:14:05.824518    6787 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:14:05.825906    6787 out.go:298] Setting JSON to false
	I0307 14:14:05.848222    6787 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2616,"bootTime":1709847029,"procs":506,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:14:05.848324    6787 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:14:05.870373    6787 out.go:177] * [default-k8s-diff-port-190000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:14:05.913452    6787 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:14:05.913524    6787 notify.go:220] Checking for updates...
	I0307 14:14:05.957052    6787 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:14:06.019843    6787 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:14:06.062184    6787 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:14:06.106394    6787 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:14:06.129099    6787 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:14:06.150622    6787 config.go:182] Loaded profile config "default-k8s-diff-port-190000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:14:06.151096    6787 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:06.151186    6787 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:06.159954    6787 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:51999
	I0307 14:14:06.160443    6787 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:06.160925    6787 main.go:141] libmachine: Using API Version  1
	I0307 14:14:06.160936    6787 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:06.161163    6787 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:06.161274    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .DriverName
	I0307 14:14:06.161482    6787 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:14:06.161751    6787 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:06.161779    6787 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:06.169754    6787 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52001
	I0307 14:14:06.170099    6787 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:06.170458    6787 main.go:141] libmachine: Using API Version  1
	I0307 14:14:06.170475    6787 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:06.170716    6787 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:06.170829    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .DriverName
	I0307 14:14:06.218850    6787 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 14:14:06.261024    6787 start.go:297] selected driver: hyperkit
	I0307 14:14:06.261041    6787 start.go:901] validating driver "hyperkit" against &{Name:default-k8s-diff-port-190000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 Kube
rnetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-190000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false E
xtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:14:06.261161    6787 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:14:06.264452    6787 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:14:06.264542    6787 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:14:06.272213    6787 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:14:06.275891    6787 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:06.275912    6787 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:14:06.276077    6787 start_flags.go:947] Waiting for all components: map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true]
	I0307 14:14:06.276133    6787 cni.go:84] Creating CNI manager for ""
	I0307 14:14:06.276147    6787 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:14:06.276205    6787 start.go:340] cluster config:
	{Name:default-k8s-diff-port-190000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8444 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:default-k8s-diff-port-190000 N
amespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8444 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-hos
t Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:14:06.276289    6787 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:14:06.346013    6787 out.go:177] * Starting "default-k8s-diff-port-190000" primary control-plane node in "default-k8s-diff-port-190000" cluster
	I0307 14:14:06.389812    6787 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 14:14:06.389880    6787 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 14:14:06.389899    6787 cache.go:56] Caching tarball of preloaded images
	I0307 14:14:06.390015    6787 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:14:06.390027    6787 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 14:14:06.390115    6787 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/default-k8s-diff-port-190000/config.json ...
	I0307 14:14:06.390545    6787 start.go:360] acquireMachinesLock for default-k8s-diff-port-190000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:14:06.390591    6787 start.go:364] duration metric: took 33.533µs to acquireMachinesLock for "default-k8s-diff-port-190000"
	I0307 14:14:06.390608    6787 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:14:06.390616    6787 fix.go:54] fixHost starting: 
	I0307 14:14:06.390830    6787 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:06.390853    6787 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:06.399357    6787 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52003
	I0307 14:14:06.399737    6787 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:06.400101    6787 main.go:141] libmachine: Using API Version  1
	I0307 14:14:06.400116    6787 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:06.400317    6787 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:06.400440    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .DriverName
	I0307 14:14:06.400539    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .GetState
	I0307 14:14:06.400629    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:06.400657    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000/hyperkit.json: no such file or directory
	I0307 14:14:06.400663    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | hyperkit pid from json: 0
	I0307 14:14:06.400709    6787 fix.go:112] recreateIfNeeded on default-k8s-diff-port-190000: state=Stopped err=<nil>
	I0307 14:14:06.400753    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .DriverName
	W0307 14:14:06.400836    6787 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:14:06.443081    6787 out.go:177] * Restarting existing hyperkit VM for "default-k8s-diff-port-190000" ...
	I0307 14:14:06.479988    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .Start
	I0307 14:14:06.480425    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:06.480479    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000/hyperkit.pid
	I0307 14:14:06.480565    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | Using UUID 76a7f985-6bb0-4cc7-b9ab-41d35dcfa7ab
	I0307 14:14:06.482810    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:14:06.482926    6787 fix.go:56] duration metric: took 92.307566ms for fixHost
	I0307 14:14:06.482939    6787 start.go:83] releasing machines lock for "default-k8s-diff-port-190000", held for 92.341113ms
	W0307 14:14:06.482957    6787 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 14:14:06.483013    6787 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:14:06.483021    6787 start.go:728] Will try again in 5 seconds ...
	I0307 14:14:11.484757    6787 start.go:360] acquireMachinesLock for default-k8s-diff-port-190000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:14:11.484948    6787 start.go:364] duration metric: took 134.703µs to acquireMachinesLock for "default-k8s-diff-port-190000"
	I0307 14:14:11.484993    6787 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:14:11.485002    6787 fix.go:54] fixHost starting: 
	I0307 14:14:11.485533    6787 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:11.485610    6787 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:11.494899    6787 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52038
	I0307 14:14:11.495308    6787 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:11.495703    6787 main.go:141] libmachine: Using API Version  1
	I0307 14:14:11.495756    6787 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:11.496009    6787 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:11.496146    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .DriverName
	I0307 14:14:11.496234    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .GetState
	I0307 14:14:11.496324    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:11.496335    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | hyperkit pid from json: 0
	I0307 14:14:11.496348    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000/hyperkit.json: no such file or directory
	I0307 14:14:11.496355    6787 fix.go:112] recreateIfNeeded on default-k8s-diff-port-190000: state=Stopped err=<nil>
	I0307 14:14:11.496366    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .DriverName
	W0307 14:14:11.496445    6787 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:14:11.517996    6787 out.go:177] * Restarting existing hyperkit VM for "default-k8s-diff-port-190000" ...
	I0307 14:14:11.564544    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .Start
	I0307 14:14:11.564844    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:11.564893    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000/hyperkit.pid
	I0307 14:14:11.564944    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | Using UUID 76a7f985-6bb0-4cc7-b9ab-41d35dcfa7ab
	I0307 14:14:11.602922    6787 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:14:11.603017    6787 fix.go:56] duration metric: took 118.013847ms for fixHost
	I0307 14:14:11.603025    6787 start.go:83] releasing machines lock for "default-k8s-diff-port-190000", held for 118.063409ms
	W0307 14:14:11.603081    6787 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-190000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p default-k8s-diff-port-190000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:14:11.624879    6787 out.go:177] 
	W0307 14:14:11.668096    6787 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:14:11.668162    6787 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:14:11.668229    6787 out.go:239] * Related issues:
	* Related issues:
	W0307 14:14:11.668286    6787 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:14:11.668337    6787 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:14:11.710882    6787 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p default-k8s-diff-port-190000 --memory=2200 --alsologtostderr --wait=true --apiserver-port=8444 --driver=hyperkit  --kubernetes-version=v1.28.4": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000: exit status 7 (73.014725ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-190000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/SecondStart (6.09s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-564000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000: exit status 7 (73.746673ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-564000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "embed-certs-564000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context embed-certs-564000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context embed-certs-564000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (36.507924ms)

                                                
                                                
** stderr ** 
	error: context "embed-certs-564000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context embed-certs-564000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000: exit status 7 (71.3821ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-564000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/AddonExistsAfterStop (0.11s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p embed-certs-564000 image list --format=json
start_stop_delete_test.go:304: v1.28.4 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.4",
- 	"registry.k8s.io/kube-controller-manager:v1.28.4",
- 	"registry.k8s.io/kube-proxy:v1.28.4",
- 	"registry.k8s.io/kube-scheduler:v1.28.4",
- 	"registry.k8s.io/pause:3.9",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000: exit status 7 (73.518802ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-564000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Pause (0.28s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p embed-certs-564000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p embed-certs-564000 --alsologtostderr -v=1: exit status 83 (136.745204ms)

                                                
                                                
-- stdout --
	* The control-plane node embed-certs-564000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p embed-certs-564000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:14:06.900540    6816 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:14:06.901215    6816 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:14:06.901223    6816 out.go:304] Setting ErrFile to fd 2...
	I0307 14:14:06.901230    6816 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:14:06.901784    6816 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:14:06.902114    6816 out.go:298] Setting JSON to false
	I0307 14:14:06.902131    6816 mustload.go:65] Loading cluster: embed-certs-564000
	I0307 14:14:06.902379    6816 config.go:182] Loaded profile config "embed-certs-564000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:14:06.902697    6816 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:06.902743    6816 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:06.910323    6816 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52019
	I0307 14:14:06.910726    6816 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:06.911178    6816 main.go:141] libmachine: Using API Version  1
	I0307 14:14:06.911189    6816 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:06.911386    6816 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:06.911490    6816 main.go:141] libmachine: (embed-certs-564000) Calling .GetState
	I0307 14:14:06.911623    6816 main.go:141] libmachine: (embed-certs-564000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:06.911663    6816 main.go:141] libmachine: (embed-certs-564000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/embed-certs-564000/hyperkit.json: no such file or directory
	I0307 14:14:06.911671    6816 main.go:141] libmachine: (embed-certs-564000) DBG | hyperkit pid from json: 0
	I0307 14:14:06.933614    6816 out.go:177] * The control-plane node embed-certs-564000 host is not running: state=Stopped
	I0307 14:14:06.954505    6816 out.go:177]   To start a cluster, run: "minikube start -p embed-certs-564000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p embed-certs-564000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000: exit status 7 (72.822222ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-564000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000: exit status 7 (72.763638ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "embed-certs-564000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/embed-certs/serial/Pause (0.28s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/FirstStart (11.46s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/FirstStart
start_stop_delete_test.go:186: (dbg) Run:  out/minikube-darwin-amd64 start -p newest-cni-438000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:186: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p newest-cni-438000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (11.384460335s)

                                                
                                                
-- stdout --
	* [newest-cni-438000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on user configuration
	* Starting "newest-cni-438000" primary control-plane node in "newest-cni-438000" cluster
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	* Deleting "newest-cni-438000" in hyperkit ...
	* Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:14:07.870888    6844 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:14:07.871060    6844 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:14:07.871065    6844 out.go:304] Setting ErrFile to fd 2...
	I0307 14:14:07.871069    6844 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:14:07.871233    6844 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:14:07.872705    6844 out.go:298] Setting JSON to false
	I0307 14:14:07.894940    6844 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2618,"bootTime":1709847029,"procs":511,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:14:07.895034    6844 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:14:07.917288    6844 out.go:177] * [newest-cni-438000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:14:07.959854    6844 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:14:07.959922    6844 notify.go:220] Checking for updates...
	I0307 14:14:07.981835    6844 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:14:08.002900    6844 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:14:08.044676    6844 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:14:08.086711    6844 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:14:08.130683    6844 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:14:08.152283    6844 config.go:182] Loaded profile config "default-k8s-diff-port-190000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:14:08.152395    6844 config.go:182] Loaded profile config "multinode-419000-m01": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:14:08.152524    6844 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:14:08.181849    6844 out.go:177] * Using the hyperkit driver based on user configuration
	I0307 14:14:08.224622    6844 start.go:297] selected driver: hyperkit
	I0307 14:14:08.224648    6844 start.go:901] validating driver "hyperkit" against <nil>
	I0307 14:14:08.224673    6844 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:14:08.228857    6844 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:14:08.228962    6844 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:14:08.236739    6844 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:14:08.240522    6844 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:08.240545    6844 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:14:08.240587    6844 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	W0307 14:14:08.240634    6844 out.go:239] ! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	! With --network-plugin=cni, you will need to provide your own CNI. See --cni flag as a user-friendly alternative
	I0307 14:14:08.240843    6844 start_flags.go:966] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I0307 14:14:08.240906    6844 cni.go:84] Creating CNI manager for ""
	I0307 14:14:08.240924    6844 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:14:08.240930    6844 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 14:14:08.240997    6844 start.go:340] cluster config:
	{Name:newest-cni-438000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-438000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local C
ontainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetr
ics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:14:08.241082    6844 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:14:08.303453    6844 out.go:177] * Starting "newest-cni-438000" primary control-plane node in "newest-cni-438000" cluster
	I0307 14:14:08.324635    6844 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 14:14:08.324697    6844 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0307 14:14:08.324736    6844 cache.go:56] Caching tarball of preloaded images
	I0307 14:14:08.324898    6844 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:14:08.324911    6844 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0307 14:14:08.325018    6844 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/newest-cni-438000/config.json ...
	I0307 14:14:08.325043    6844 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/newest-cni-438000/config.json: {Name:mk3b1ea4bff13bd194f121f83071916c0235fac8 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 14:14:08.325559    6844 start.go:360] acquireMachinesLock for newest-cni-438000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:14:08.325641    6844 start.go:364] duration metric: took 65.645µs to acquireMachinesLock for "newest-cni-438000"
	I0307 14:14:08.325677    6844 start.go:93] Provisioning new machine with config: &{Name:newest-cni-438000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-438000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube
-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:14:08.325763    6844 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:14:08.367557    6844 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:14:08.367853    6844 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:08.367920    6844 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:08.377215    6844 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52032
	I0307 14:14:08.377584    6844 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:08.378019    6844 main.go:141] libmachine: Using API Version  1
	I0307 14:14:08.378029    6844 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:08.378265    6844 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:08.378398    6844 main.go:141] libmachine: (newest-cni-438000) Calling .GetMachineName
	I0307 14:14:08.378507    6844 main.go:141] libmachine: (newest-cni-438000) Calling .DriverName
	I0307 14:14:08.378610    6844 start.go:159] libmachine.API.Create for "newest-cni-438000" (driver="hyperkit")
	I0307 14:14:08.378636    6844 client.go:168] LocalClient.Create starting
	I0307 14:14:08.378676    6844 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:14:08.378734    6844 main.go:141] libmachine: Decoding PEM data...
	I0307 14:14:08.378749    6844 main.go:141] libmachine: Parsing certificate...
	I0307 14:14:08.378806    6844 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:14:08.378841    6844 main.go:141] libmachine: Decoding PEM data...
	I0307 14:14:08.378852    6844 main.go:141] libmachine: Parsing certificate...
	I0307 14:14:08.378879    6844 main.go:141] libmachine: Running pre-create checks...
	I0307 14:14:08.378893    6844 main.go:141] libmachine: (newest-cni-438000) Calling .PreCreateCheck
	I0307 14:14:08.378974    6844 main.go:141] libmachine: (newest-cni-438000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:08.379179    6844 main.go:141] libmachine: (newest-cni-438000) Calling .GetConfigRaw
	I0307 14:14:08.379676    6844 main.go:141] libmachine: Creating machine...
	I0307 14:14:08.379685    6844 main.go:141] libmachine: (newest-cni-438000) Calling .Create
	I0307 14:14:08.379763    6844 main.go:141] libmachine: (newest-cni-438000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:08.379873    6844 main.go:141] libmachine: (newest-cni-438000) DBG | I0307 14:14:08.379751    6852 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:14:08.379922    6844 main.go:141] libmachine: (newest-cni-438000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:14:08.552649    6844 main.go:141] libmachine: (newest-cni-438000) DBG | I0307 14:14:08.552586    6852 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000/id_rsa...
	I0307 14:14:08.780251    6844 main.go:141] libmachine: (newest-cni-438000) DBG | I0307 14:14:08.780169    6852 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000/newest-cni-438000.rawdisk...
	I0307 14:14:08.780275    6844 main.go:141] libmachine: (newest-cni-438000) DBG | Writing magic tar header
	I0307 14:14:08.780286    6844 main.go:141] libmachine: (newest-cni-438000) DBG | Writing SSH key tar header
	I0307 14:14:08.780933    6844 main.go:141] libmachine: (newest-cni-438000) DBG | I0307 14:14:08.780893    6852 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000 ...
	I0307 14:14:09.140367    6844 main.go:141] libmachine: (newest-cni-438000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:09.140391    6844 main.go:141] libmachine: (newest-cni-438000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000/hyperkit.pid
	I0307 14:14:09.140402    6844 main.go:141] libmachine: (newest-cni-438000) DBG | Using UUID dd84e324-b9cf-4511-a038-a3ea4dfc8de8
	I0307 14:14:09.178951    6844 main.go:141] libmachine: (newest-cni-438000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:14:09.179040    6844 client.go:171] duration metric: took 800.386359ms to LocalClient.Create
	I0307 14:14:11.179451    6844 start.go:128] duration metric: took 2.853651428s to createHost
	I0307 14:14:11.179472    6844 start.go:83] releasing machines lock for "newest-cni-438000", held for 2.853801239s
	W0307 14:14:11.179495    6844 start.go:713] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	I0307 14:14:11.179810    6844 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:11.179847    6844 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:11.188051    6844 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52034
	I0307 14:14:11.188417    6844 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:11.188745    6844 main.go:141] libmachine: Using API Version  1
	I0307 14:14:11.188757    6844 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:11.189012    6844 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:11.189360    6844 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:11.189384    6844 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:11.197166    6844 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52036
	I0307 14:14:11.197495    6844 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:11.197855    6844 main.go:141] libmachine: Using API Version  1
	I0307 14:14:11.197878    6844 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:11.198074    6844 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:11.198179    6844 main.go:141] libmachine: (newest-cni-438000) Calling .GetState
	I0307 14:14:11.198257    6844 main.go:141] libmachine: (newest-cni-438000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:11.198281    6844 main.go:141] libmachine: (newest-cni-438000) DBG | hyperkit pid from json: 0
	I0307 14:14:11.198308    6844 main.go:141] libmachine: (newest-cni-438000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000/hyperkit.json: no such file or directory
	I0307 14:14:11.198360    6844 main.go:141] libmachine: (newest-cni-438000) Calling .DriverName
	I0307 14:14:11.240113    6844 out.go:177] * Deleting "newest-cni-438000" in hyperkit ...
	I0307 14:14:11.263798    6844 main.go:141] libmachine: (newest-cni-438000) Calling .Remove
	I0307 14:14:11.264004    6844 main.go:141] libmachine: (newest-cni-438000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:11.264016    6844 main.go:141] libmachine: (newest-cni-438000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:11.264032    6844 main.go:141] libmachine: (newest-cni-438000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000/hyperkit.json: no such file or directory
	I0307 14:14:11.264045    6844 main.go:141] libmachine: (newest-cni-438000) DBG | hyperkit pid from json: 0
	W0307 14:14:11.279257    6844 out.go:239] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:14:11.279271    6844 start.go:728] Will try again in 5 seconds ...
	I0307 14:14:16.279753    6844 start.go:360] acquireMachinesLock for newest-cni-438000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:14:16.279980    6844 start.go:364] duration metric: took 189.37µs to acquireMachinesLock for "newest-cni-438000"
	I0307 14:14:16.280026    6844 start.go:93] Provisioning new machine with config: &{Name:newest-cni-438000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-438000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube
-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s} &{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}
	I0307 14:14:16.280128    6844 start.go:125] createHost starting for "" (driver="hyperkit")
	I0307 14:14:16.302770    6844 out.go:204] * Creating hyperkit VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
	I0307 14:14:16.302876    6844 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:16.302913    6844 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:16.311132    6844 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52066
	I0307 14:14:16.311531    6844 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:16.311900    6844 main.go:141] libmachine: Using API Version  1
	I0307 14:14:16.311913    6844 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:16.312120    6844 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:16.312223    6844 main.go:141] libmachine: (newest-cni-438000) Calling .GetMachineName
	I0307 14:14:16.312319    6844 main.go:141] libmachine: (newest-cni-438000) Calling .DriverName
	I0307 14:14:16.312420    6844 start.go:159] libmachine.API.Create for "newest-cni-438000" (driver="hyperkit")
	I0307 14:14:16.312436    6844 client.go:168] LocalClient.Create starting
	I0307 14:14:16.312464    6844 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/ca.pem
	I0307 14:14:16.312514    6844 main.go:141] libmachine: Decoding PEM data...
	I0307 14:14:16.312524    6844 main.go:141] libmachine: Parsing certificate...
	I0307 14:14:16.312571    6844 main.go:141] libmachine: Reading certificate data from /Users/jenkins/minikube-integration/18320-1375/.minikube/certs/cert.pem
	I0307 14:14:16.312607    6844 main.go:141] libmachine: Decoding PEM data...
	I0307 14:14:16.312622    6844 main.go:141] libmachine: Parsing certificate...
	I0307 14:14:16.312635    6844 main.go:141] libmachine: Running pre-create checks...
	I0307 14:14:16.312641    6844 main.go:141] libmachine: (newest-cni-438000) Calling .PreCreateCheck
	I0307 14:14:16.312721    6844 main.go:141] libmachine: (newest-cni-438000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:16.312743    6844 main.go:141] libmachine: (newest-cni-438000) Calling .GetConfigRaw
	I0307 14:14:16.313247    6844 main.go:141] libmachine: Creating machine...
	I0307 14:14:16.313255    6844 main.go:141] libmachine: (newest-cni-438000) Calling .Create
	I0307 14:14:16.313327    6844 main.go:141] libmachine: (newest-cni-438000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:16.313439    6844 main.go:141] libmachine: (newest-cni-438000) DBG | I0307 14:14:16.313313    6904 common.go:145] Making disk image using store path: /Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:14:16.313477    6844 main.go:141] libmachine: (newest-cni-438000) Downloading /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/boot2docker.iso from file:///Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso...
	I0307 14:14:16.486417    6844 main.go:141] libmachine: (newest-cni-438000) DBG | I0307 14:14:16.486323    6904 common.go:152] Creating ssh key: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000/id_rsa...
	I0307 14:14:16.600486    6844 main.go:141] libmachine: (newest-cni-438000) DBG | I0307 14:14:16.600418    6904 common.go:158] Creating raw disk image: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000/newest-cni-438000.rawdisk...
	I0307 14:14:16.600501    6844 main.go:141] libmachine: (newest-cni-438000) DBG | Writing magic tar header
	I0307 14:14:16.600512    6844 main.go:141] libmachine: (newest-cni-438000) DBG | Writing SSH key tar header
	I0307 14:14:16.601380    6844 main.go:141] libmachine: (newest-cni-438000) DBG | I0307 14:14:16.601273    6904 common.go:172] Fixing permissions on /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000 ...
	I0307 14:14:16.960117    6844 main.go:141] libmachine: (newest-cni-438000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:16.960138    6844 main.go:141] libmachine: (newest-cni-438000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000/hyperkit.pid
	I0307 14:14:16.960152    6844 main.go:141] libmachine: (newest-cni-438000) DBG | Using UUID c5756559-6e48-4bab-be3f-5098be27026b
	I0307 14:14:16.996158    6844 main.go:141] libmachine: (newest-cni-438000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:14:16.996225    6844 client.go:171] duration metric: took 683.776279ms to LocalClient.Create
	I0307 14:14:18.998461    6844 start.go:128] duration metric: took 2.718298806s to createHost
	I0307 14:14:18.998485    6844 start.go:83] releasing machines lock for "newest-cni-438000", held for 2.718470396s
	W0307 14:14:18.998601    6844 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p newest-cni-438000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p newest-cni-438000" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:14:19.044207    6844 out.go:177] 
	W0307 14:14:19.068147    6844 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:14:19.068259    6844 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:14:19.068273    6844 out.go:239] * Related issues:
	* Related issues:
	W0307 14:14:19.068292    6844 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:14:19.068367    6844 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:14:19.132951    6844 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:188: failed starting minikube -first start-. args "out/minikube-darwin-amd64 start -p newest-cni-438000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-438000 -n newest-cni-438000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-438000 -n newest-cni-438000: exit status 7 (73.185219ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-438000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/FirstStart (11.46s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.07s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop
start_stop_delete_test.go:275: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-190000" does not exist
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000: exit status 7 (72.516824ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-190000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/UserAppExistsAfterStop (0.07s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.11s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop
start_stop_delete_test.go:288: failed waiting for 'addon dashboard' pod post-stop-start: client config: context "default-k8s-diff-port-190000" does not exist
start_stop_delete_test.go:291: (dbg) Run:  kubectl --context default-k8s-diff-port-190000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard
start_stop_delete_test.go:291: (dbg) Non-zero exit: kubectl --context default-k8s-diff-port-190000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard: exit status 1 (37.139853ms)

                                                
                                                
** stderr ** 
	error: context "default-k8s-diff-port-190000" does not exist

                                                
                                                
** /stderr **
start_stop_delete_test.go:293: failed to get info on kubernetes-dashboard deployments. args "kubectl --context default-k8s-diff-port-190000 describe deploy/dashboard-metrics-scraper -n kubernetes-dashboard": exit status 1
start_stop_delete_test.go:297: addon did not load correct image. Expected to contain " registry.k8s.io/echoserver:1.4". Addon deployment info: 
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000: exit status 7 (72.903007ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-190000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/AddonExistsAfterStop (0.11s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p default-k8s-diff-port-190000 image list --format=json
start_stop_delete_test.go:304: v1.28.4 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.10.1",
- 	"registry.k8s.io/etcd:3.5.9-0",
- 	"registry.k8s.io/kube-apiserver:v1.28.4",
- 	"registry.k8s.io/kube-controller-manager:v1.28.4",
- 	"registry.k8s.io/kube-proxy:v1.28.4",
- 	"registry.k8s.io/kube-scheduler:v1.28.4",
- 	"registry.k8s.io/pause:3.9",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000: exit status 7 (72.210284ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-190000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Pause (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p default-k8s-diff-port-190000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p default-k8s-diff-port-190000 --alsologtostderr -v=1: exit status 83 (143.672693ms)

                                                
                                                
-- stdout --
	* The control-plane node default-k8s-diff-port-190000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p default-k8s-diff-port-190000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:14:12.269574    6876 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:14:12.270272    6876 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:14:12.270280    6876 out.go:304] Setting ErrFile to fd 2...
	I0307 14:14:12.270286    6876 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:14:12.270916    6876 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:14:12.271235    6876 out.go:298] Setting JSON to false
	I0307 14:14:12.271251    6876 mustload.go:65] Loading cluster: default-k8s-diff-port-190000
	I0307 14:14:12.271512    6876 config.go:182] Loaded profile config "default-k8s-diff-port-190000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 14:14:12.271823    6876 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:12.271867    6876 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:12.279446    6876 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52054
	I0307 14:14:12.279907    6876 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:12.280343    6876 main.go:141] libmachine: Using API Version  1
	I0307 14:14:12.280352    6876 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:12.280566    6876 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:12.280672    6876 main.go:141] libmachine: (default-k8s-diff-port-190000) Calling .GetState
	I0307 14:14:12.280752    6876 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:12.280780    6876 main.go:141] libmachine: (default-k8s-diff-port-190000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/default-k8s-diff-port-190000/hyperkit.json: no such file or directory
	I0307 14:14:12.280786    6876 main.go:141] libmachine: (default-k8s-diff-port-190000) DBG | hyperkit pid from json: 0
	I0307 14:14:12.303184    6876 out.go:177] * The control-plane node default-k8s-diff-port-190000 host is not running: state=Stopped
	I0307 14:14:12.331098    6876 out.go:177]   To start a cluster, run: "minikube start -p default-k8s-diff-port-190000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p default-k8s-diff-port-190000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000: exit status 7 (72.809426ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-190000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000: exit status 7 (72.773439ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "default-k8s-diff-port-190000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/default-k8s-diff-port/serial/Pause (0.29s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/SecondStart (5.91s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/SecondStart
start_stop_delete_test.go:256: (dbg) Run:  out/minikube-darwin-amd64 start -p newest-cni-438000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2
start_stop_delete_test.go:256: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p newest-cni-438000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2: exit status 60 (5.83776615s)

                                                
                                                
-- stdout --
	* [newest-cni-438000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	* Starting "newest-cni-438000" primary control-plane node in "newest-cni-438000" cluster
	* Restarting existing hyperkit VM for "newest-cni-438000" ...
	* Restarting existing hyperkit VM for "newest-cni-438000" ...
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:14:23.248813    6941 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:14:23.249084    6941 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:14:23.249090    6941 out.go:304] Setting ErrFile to fd 2...
	I0307 14:14:23.249094    6941 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:14:23.249288    6941 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:14:23.251461    6941 out.go:298] Setting JSON to false
	I0307 14:14:23.273992    6941 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":2634,"bootTime":1709847029,"procs":491,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 14:14:23.274094    6941 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 14:14:23.296002    6941 out.go:177] * [newest-cni-438000] minikube v1.32.0 on Darwin 14.3.1
	I0307 14:14:23.338656    6941 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 14:14:23.338700    6941 notify.go:220] Checking for updates...
	I0307 14:14:23.382739    6941 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 14:14:23.404619    6941 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 14:14:23.425684    6941 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 14:14:23.446668    6941 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 14:14:23.489696    6941 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 14:14:23.511506    6941 config.go:182] Loaded profile config "newest-cni-438000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0307 14:14:23.512226    6941 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:23.512336    6941 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:23.521111    6941 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52097
	I0307 14:14:23.521465    6941 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:23.521886    6941 main.go:141] libmachine: Using API Version  1
	I0307 14:14:23.521895    6941 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:23.522131    6941 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:23.522231    6941 main.go:141] libmachine: (newest-cni-438000) Calling .DriverName
	I0307 14:14:23.522430    6941 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 14:14:23.522663    6941 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:23.522687    6941 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:23.530234    6941 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52099
	I0307 14:14:23.530573    6941 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:23.530917    6941 main.go:141] libmachine: Using API Version  1
	I0307 14:14:23.530932    6941 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:23.531167    6941 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:23.531269    6941 main.go:141] libmachine: (newest-cni-438000) Calling .DriverName
	I0307 14:14:23.559598    6941 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 14:14:23.601684    6941 start.go:297] selected driver: hyperkit
	I0307 14:14:23.601713    6941 start.go:901] validating driver "hyperkit" against &{Name:newest-cni-438000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-438000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> Exp
osedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:14:23.601915    6941 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 14:14:23.606286    6941 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:14:23.606379    6941 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 14:14:23.614062    6941 install.go:137] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit version is 1.32.0
	I0307 14:14:23.617949    6941 install.go:79] stdout: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:23.617975    6941 install.go:81] /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit looks good
	I0307 14:14:23.618119    6941 start_flags.go:966] Waiting for components: map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true]
	I0307 14:14:23.618184    6941 cni.go:84] Creating CNI manager for ""
	I0307 14:14:23.618205    6941 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 14:14:23.618248    6941 start.go:340] cluster config:
	{Name:newest-cni-438000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:2200 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:newest-cni-438000 Namespace:default
APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates:ServerSideApply=true ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:kubeadm Key:pod-network-cidr Value:10.42.0.0/16}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[dashboard:true metrics-server:true] CustomAddonImages:map[MetricsScraper:registry.k8s.io/echoserver:1.4 MetricsServer:registry.k8s.io/echoserver:1.4] CustomAddonRegistries:map[MetricsServer:fake.domain] VerifyComponents:map[apiserver:true apps_running:false default_sa:true extra:false kubelet:false node_ready:false system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0
CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 14:14:23.618337    6941 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 14:14:23.639644    6941 out.go:177] * Starting "newest-cni-438000" primary control-plane node in "newest-cni-438000" cluster
	I0307 14:14:23.660570    6941 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 14:14:23.660654    6941 preload.go:147] Found local preload: /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0307 14:14:23.660776    6941 cache.go:56] Caching tarball of preloaded images
	I0307 14:14:23.661000    6941 preload.go:173] Found /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 in cache, skipping download
	I0307 14:14:23.661021    6941 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0307 14:14:23.661181    6941 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/newest-cni-438000/config.json ...
	I0307 14:14:23.662295    6941 start.go:360] acquireMachinesLock for newest-cni-438000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:14:23.662429    6941 start.go:364] duration metric: took 101.016µs to acquireMachinesLock for "newest-cni-438000"
	I0307 14:14:23.662471    6941 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:14:23.662488    6941 fix.go:54] fixHost starting: 
	I0307 14:14:23.662851    6941 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:23.662879    6941 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:23.671212    6941 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52101
	I0307 14:14:23.671569    6941 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:23.671961    6941 main.go:141] libmachine: Using API Version  1
	I0307 14:14:23.671973    6941 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:23.672220    6941 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:23.672336    6941 main.go:141] libmachine: (newest-cni-438000) Calling .DriverName
	I0307 14:14:23.672425    6941 main.go:141] libmachine: (newest-cni-438000) Calling .GetState
	I0307 14:14:23.672506    6941 main.go:141] libmachine: (newest-cni-438000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:23.672521    6941 main.go:141] libmachine: (newest-cni-438000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000/hyperkit.json: no such file or directory
	I0307 14:14:23.672527    6941 main.go:141] libmachine: (newest-cni-438000) DBG | hyperkit pid from json: 0
	I0307 14:14:23.672575    6941 fix.go:112] recreateIfNeeded on newest-cni-438000: state=Stopped err=<nil>
	I0307 14:14:23.672600    6941 main.go:141] libmachine: (newest-cni-438000) Calling .DriverName
	W0307 14:14:23.672681    6941 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:14:23.714559    6941 out.go:177] * Restarting existing hyperkit VM for "newest-cni-438000" ...
	I0307 14:14:23.736478    6941 main.go:141] libmachine: (newest-cni-438000) Calling .Start
	I0307 14:14:23.736794    6941 main.go:141] libmachine: (newest-cni-438000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:23.736824    6941 main.go:141] libmachine: (newest-cni-438000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000/hyperkit.pid
	I0307 14:14:23.736845    6941 main.go:141] libmachine: (newest-cni-438000) DBG | Using UUID c5756559-6e48-4bab-be3f-5098be27026b
	I0307 14:14:23.739013    6941 main.go:141] libmachine: (newest-cni-438000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:14:23.739108    6941 fix.go:56] duration metric: took 76.622511ms for fixHost
	I0307 14:14:23.739120    6941 start.go:83] releasing machines lock for "newest-cni-438000", held for 76.675411ms
	W0307 14:14:23.739138    6941 start.go:713] error starting host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	W0307 14:14:23.739209    6941 out.go:239] ! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	! StartHost failed, but will try again: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:14:23.739217    6941 start.go:728] Will try again in 5 seconds ...
	I0307 14:14:28.740771    6941 start.go:360] acquireMachinesLock for newest-cni-438000: {Name:mkda15b323a9e69b8357af510a5ae8950ab1ff97 Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
	I0307 14:14:28.740978    6941 start.go:364] duration metric: took 136.661µs to acquireMachinesLock for "newest-cni-438000"
	I0307 14:14:28.741012    6941 start.go:96] Skipping create...Using existing machine configuration
	I0307 14:14:28.741021    6941 fix.go:54] fixHost starting: 
	I0307 14:14:28.741458    6941 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:28.741498    6941 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:28.750663    6941 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52103
	I0307 14:14:28.751034    6941 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:28.751423    6941 main.go:141] libmachine: Using API Version  1
	I0307 14:14:28.751437    6941 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:28.751629    6941 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:28.751735    6941 main.go:141] libmachine: (newest-cni-438000) Calling .DriverName
	I0307 14:14:28.751831    6941 main.go:141] libmachine: (newest-cni-438000) Calling .GetState
	I0307 14:14:28.751954    6941 main.go:141] libmachine: (newest-cni-438000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000/hyperkit.json: no such file or directory
	I0307 14:14:28.751965    6941 main.go:141] libmachine: (newest-cni-438000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:28.751970    6941 fix.go:112] recreateIfNeeded on newest-cni-438000: state=Stopped err=<nil>
	I0307 14:14:28.751981    6941 main.go:141] libmachine: (newest-cni-438000) Calling .DriverName
	I0307 14:14:28.752020    6941 main.go:141] libmachine: (newest-cni-438000) DBG | hyperkit pid from json: 0
	W0307 14:14:28.752072    6941 fix.go:138] unexpected machine state, will restart: <nil>
	I0307 14:14:28.795448    6941 out.go:177] * Restarting existing hyperkit VM for "newest-cni-438000" ...
	I0307 14:14:28.816612    6941 main.go:141] libmachine: (newest-cni-438000) Calling .Start
	I0307 14:14:28.816839    6941 main.go:141] libmachine: (newest-cni-438000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:28.816871    6941 main.go:141] libmachine: (newest-cni-438000) DBG | clean start, hyperkit pid file doesn't exist: /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000/hyperkit.pid
	I0307 14:14:28.816944    6941 main.go:141] libmachine: (newest-cni-438000) DBG | Using UUID c5756559-6e48-4bab-be3f-5098be27026b
	I0307 14:14:28.853801    6941 main.go:141] libmachine: (newest-cni-438000) DBG | virtio_net: Could not create vmnet interface, permission denied or no entitlement?
	I0307 14:14:28.853897    6941 fix.go:56] duration metric: took 112.875364ms for fixHost
	I0307 14:14:28.853907    6941 start.go:83] releasing machines lock for "newest-cni-438000", held for 112.916097ms
	W0307 14:14:28.853960    6941 out.go:239] * Failed to start hyperkit VM. Running "minikube delete -p newest-cni-438000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	* Failed to start hyperkit VM. Running "minikube delete -p newest-cni-438000" may fix it: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	I0307 14:14:28.897321    6941 out.go:177] 
	W0307 14:14:28.918679    6941 out.go:239] X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	X Exiting due to PR_HYPERKIT_VMNET_FRAMEWORK: Failed to start host: driver start: getting MAC address from UUID: vmnet: error from vmnet.framework: -1
	
	W0307 14:14:28.918756    6941 out.go:239] * Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	* Suggestion: 
	
	    Hyperkit networking is broken. Try disabling Internet Sharing: System Preference > Sharing > Internet Sharing.
	    Alternatively, you can try upgrading to the latest hyperkit version, or using an alternate driver.
	W0307 14:14:28.918770    6941 out.go:239] * Related issues:
	* Related issues:
	W0307 14:14:28.918829    6941 out.go:239]   - https://github.com/kubernetes/minikube/issues/6028
	  - https://github.com/kubernetes/minikube/issues/6028
	W0307 14:14:28.918853    6941 out.go:239]   - https://github.com/kubernetes/minikube/issues/5594
	  - https://github.com/kubernetes/minikube/issues/5594
	I0307 14:14:28.940613    6941 out.go:177] 

                                                
                                                
** /stderr **
start_stop_delete_test.go:259: failed to start minikube post-stop. args "out/minikube-darwin-amd64 start -p newest-cni-438000 --memory=2200 --alsologtostderr --wait=apiserver,system_pods,default_sa --feature-gates ServerSideApply=true --network-plugin=cni --extra-config=kubeadm.pod-network-cidr=10.42.0.0/16 --driver=hyperkit  --kubernetes-version=v1.29.0-rc.2": exit status 60
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-438000 -n newest-cni-438000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-438000 -n newest-cni-438000: exit status 7 (73.342745ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-438000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/SecondStart (5.91s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.18s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/VerifyKubernetesImages
start_stop_delete_test.go:304: (dbg) Run:  out/minikube-darwin-amd64 -p newest-cni-438000 image list --format=json
start_stop_delete_test.go:304: v1.29.0-rc.2 images missing (-want +got):
[]string{
- 	"gcr.io/k8s-minikube/storage-provisioner:v5",
- 	"registry.k8s.io/coredns/coredns:v1.11.1",
- 	"registry.k8s.io/etcd:3.5.10-0",
- 	"registry.k8s.io/kube-apiserver:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-controller-manager:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-proxy:v1.29.0-rc.2",
- 	"registry.k8s.io/kube-scheduler:v1.29.0-rc.2",
- 	"registry.k8s.io/pause:3.9",
}
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-438000 -n newest-cni-438000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-438000 -n newest-cni-438000: exit status 7 (74.036173ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-438000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/VerifyKubernetesImages (0.18s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Pause (0.29s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Pause
start_stop_delete_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 pause -p newest-cni-438000 --alsologtostderr -v=1
start_stop_delete_test.go:311: (dbg) Non-zero exit: out/minikube-darwin-amd64 pause -p newest-cni-438000 --alsologtostderr -v=1: exit status 83 (137.52414ms)

                                                
                                                
-- stdout --
	* The control-plane node newest-cni-438000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p newest-cni-438000"

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 14:14:29.343431    6963 out.go:291] Setting OutFile to fd 1 ...
	I0307 14:14:29.343699    6963 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:14:29.343704    6963 out.go:304] Setting ErrFile to fd 2...
	I0307 14:14:29.343708    6963 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 14:14:29.343874    6963 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 14:14:29.344178    6963 out.go:298] Setting JSON to false
	I0307 14:14:29.344192    6963 mustload.go:65] Loading cluster: newest-cni-438000
	I0307 14:14:29.344458    6963 config.go:182] Loaded profile config "newest-cni-438000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.29.0-rc.2
	I0307 14:14:29.344793    6963 main.go:141] libmachine: Found binary path at /Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit
	I0307 14:14:29.344841    6963 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 14:14:29.352306    6963 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:52113
	I0307 14:14:29.352733    6963 main.go:141] libmachine: () Calling .GetVersion
	I0307 14:14:29.353172    6963 main.go:141] libmachine: Using API Version  1
	I0307 14:14:29.353189    6963 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 14:14:29.353419    6963 main.go:141] libmachine: () Calling .GetMachineName
	I0307 14:14:29.353538    6963 main.go:141] libmachine: (newest-cni-438000) Calling .GetState
	I0307 14:14:29.353620    6963 main.go:141] libmachine: (newest-cni-438000) DBG | exe=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin/docker-machine-driver-hyperkit uid=0
	I0307 14:14:29.353643    6963 main.go:141] libmachine: (newest-cni-438000) Error reading pid file: open /Users/jenkins/minikube-integration/18320-1375/.minikube/machines/newest-cni-438000/hyperkit.json: no such file or directory
	I0307 14:14:29.353649    6963 main.go:141] libmachine: (newest-cni-438000) DBG | hyperkit pid from json: 0
	I0307 14:14:29.374608    6963 out.go:177] * The control-plane node newest-cni-438000 host is not running: state=Stopped
	I0307 14:14:29.396319    6963 out.go:177]   To start a cluster, run: "minikube start -p newest-cni-438000"

                                                
                                                
** /stderr **
start_stop_delete_test.go:311: out/minikube-darwin-amd64 pause -p newest-cni-438000 --alsologtostderr -v=1 failed: exit status 83
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-438000 -n newest-cni-438000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-438000 -n newest-cni-438000: exit status 7 (73.277413ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-438000" host is not running, skipping log retrieval (state="Stopped")
helpers_test.go:222: -----------------------post-mortem--------------------------------
helpers_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-438000 -n newest-cni-438000
helpers_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-438000 -n newest-cni-438000: exit status 7 (74.031916ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
helpers_test.go:239: status error: exit status 7 (may be ok)
helpers_test.go:241: "newest-cni-438000" host is not running, skipping log retrieval (state="Stopped")
--- FAIL: TestStartStop/group/newest-cni/serial/Pause (0.29s)

                                                
                                    

Test pass (101/280)

Order passed test Duration
3 TestDownloadOnly/v1.20.0/json-events 49.66
4 TestDownloadOnly/v1.20.0/preload-exists 0
7 TestDownloadOnly/v1.20.0/kubectl 0
8 TestDownloadOnly/v1.20.0/LogsDuration 0.3
9 TestDownloadOnly/v1.20.0/DeleteAll 0.94
10 TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds 0.37
12 TestDownloadOnly/v1.28.4/json-events 52.3
13 TestDownloadOnly/v1.28.4/preload-exists 0
16 TestDownloadOnly/v1.28.4/kubectl 0
17 TestDownloadOnly/v1.28.4/LogsDuration 0.32
18 TestDownloadOnly/v1.28.4/DeleteAll 0.41
19 TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds 0.39
21 TestDownloadOnly/v1.29.0-rc.2/json-events 48
22 TestDownloadOnly/v1.29.0-rc.2/preload-exists 0
25 TestDownloadOnly/v1.29.0-rc.2/kubectl 0
26 TestDownloadOnly/v1.29.0-rc.2/LogsDuration 0.3
27 TestDownloadOnly/v1.29.0-rc.2/DeleteAll 0.4
28 TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds 0.37
30 TestBinaryMirror 1.02
34 TestAddons/PreSetup/EnablingAddonOnNonExistingCluster 0.15
35 TestAddons/PreSetup/DisablingAddonOnNonExistingCluster 0.15
36 TestAddons/Setup 332.34
38 TestAddons/parallel/Registry 18.68
39 TestAddons/parallel/Ingress 19.81
40 TestAddons/parallel/InspektorGadget 10.48
41 TestAddons/parallel/MetricsServer 5.47
42 TestAddons/parallel/HelmTiller 10.09
44 TestAddons/parallel/CSI 34.43
45 TestAddons/parallel/Headlamp 13.31
46 TestAddons/parallel/CloudSpanner 5.43
47 TestAddons/parallel/LocalPath 52.42
48 TestAddons/parallel/NvidiaDevicePlugin 5.35
49 TestAddons/parallel/Yakd 5.01
52 TestAddons/serial/GCPAuth/Namespaces 0.09
53 TestAddons/StoppedEnableDisable 5.96
61 TestHyperKitDriverInstallOrUpdate 12.26
65 TestErrorSpam/start 1.32
66 TestErrorSpam/status 0.22
67 TestErrorSpam/pause 0.43
68 TestErrorSpam/unpause 0.41
69 TestErrorSpam/stop 10.74
72 TestFunctional/serial/CopySyncFile 0
74 TestFunctional/serial/AuditLog 0
80 TestFunctional/serial/CacheCmd/cache/add_remote 6.69
81 TestFunctional/serial/CacheCmd/cache/add_local 1.64
82 TestFunctional/serial/CacheCmd/cache/CacheDelete 0.09
83 TestFunctional/serial/CacheCmd/cache/list 0.09
86 TestFunctional/serial/CacheCmd/cache/delete 0.18
95 TestFunctional/parallel/ConfigCmd 0.69
97 TestFunctional/parallel/DryRun 0.98
98 TestFunctional/parallel/InternationalLanguage 0.55
104 TestFunctional/parallel/AddonsCmd 0.27
119 TestFunctional/parallel/License 1.58
120 TestFunctional/parallel/Version/short 0.11
127 TestFunctional/parallel/ImageCommands/Setup 5.87
140 TestFunctional/parallel/TunnelCmd/serial/StartTunnel 0.02
148 TestFunctional/parallel/ImageCommands/ImageRemove 0.2
150 TestFunctional/parallel/ImageCommands/ImageSaveDaemon 0.21
151 TestFunctional/parallel/ProfileCmd/profile_not_create 0.25
152 TestFunctional/parallel/ProfileCmd/profile_list 0.23
153 TestFunctional/parallel/ProfileCmd/profile_json_output 0.23
158 TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil 10.02
160 TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel 0.14
161 TestFunctional/delete_addon-resizer_images 0.12
162 TestFunctional/delete_my-image_image 0.05
163 TestFunctional/delete_minikube_cached_images 0.05
192 TestJSONOutput/start/Audit 0
198 TestJSONOutput/pause/Audit 0
200 TestJSONOutput/pause/parallel/DistinctCurrentSteps 0
201 TestJSONOutput/pause/parallel/IncreasingCurrentSteps 0
204 TestJSONOutput/unpause/Audit 0
206 TestJSONOutput/unpause/parallel/DistinctCurrentSteps 0
207 TestJSONOutput/unpause/parallel/IncreasingCurrentSteps 0
209 TestJSONOutput/stop/Command 3.12
210 TestJSONOutput/stop/Audit 0
212 TestJSONOutput/stop/parallel/DistinctCurrentSteps 0
213 TestJSONOutput/stop/parallel/IncreasingCurrentSteps 0
214 TestErrorJSONOutput 0.76
219 TestMainNoArgs 0.09
264 TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current 2.54
265 TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current 6.03
266 TestStoppedBinaryUpgrade/Setup 5.33
279 TestNoKubernetes/serial/StartNoK8sWithVersion 0.41
283 TestNoKubernetes/serial/VerifyK8sNotRunning 0.14
284 TestNoKubernetes/serial/ProfileList 0.33
285 TestNoKubernetes/serial/Stop 3.49
287 TestNoKubernetes/serial/VerifyK8sNotRunningSecond 0.14
303 TestStartStop/group/old-k8s-version/serial/Stop 3.43
304 TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop 0.46
308 TestStartStop/group/no-preload/serial/Stop 3.23
309 TestStartStop/group/no-preload/serial/EnableAddonAfterStop 0.33
325 TestStartStop/group/embed-certs/serial/Stop 3.09
326 TestStartStop/group/embed-certs/serial/EnableAddonAfterStop 0.35
330 TestStartStop/group/default-k8s-diff-port/serial/Stop 3.82
331 TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop 0.33
343 TestStartStop/group/newest-cni/serial/DeployApp 0
344 TestStartStop/group/newest-cni/serial/EnableAddonWhileActive 0.21
345 TestStartStop/group/newest-cni/serial/Stop 3.38
346 TestStartStop/group/newest-cni/serial/EnableAddonAfterStop 0.33
348 TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop 0
349 TestStartStop/group/newest-cni/serial/AddonExistsAfterStop 0
x
+
TestDownloadOnly/v1.20.0/json-events (49.66s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-410000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=hyperkit 
aaa_download_only_test.go:81: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-410000 --force --alsologtostderr --kubernetes-version=v1.20.0 --container-runtime=docker --driver=hyperkit : (49.660146761s)
--- PASS: TestDownloadOnly/v1.20.0/json-events (49.66s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/preload-exists
--- PASS: TestDownloadOnly/v1.20.0/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/kubectl
--- PASS: TestDownloadOnly/v1.20.0/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/LogsDuration (0.3s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-410000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-410000: exit status 85 (297.716866ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      | End Time |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	| start   | -o=json --download-only        | download-only-410000 | jenkins | v1.32.0 | 07 Mar 24 13:46 PST |          |
	|         | -p download-only-410000        |                      |         |         |                     |          |
	|         | --force --alsologtostderr      |                      |         |         |                     |          |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |          |
	|         | --container-runtime=docker     |                      |         |         |                     |          |
	|         | --driver=hyperkit              |                      |         |         |                     |          |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|----------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/07 13:46:37
	Running on machine: MacOS-Agent-4
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0307 13:46:37.018590    1848 out.go:291] Setting OutFile to fd 1 ...
	I0307 13:46:37.019307    1848 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:46:37.019335    1848 out.go:304] Setting ErrFile to fd 2...
	I0307 13:46:37.019344    1848 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:46:37.019864    1848 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	W0307 13:46:37.019971    1848 root.go:314] Error reading config file at /Users/jenkins/minikube-integration/18320-1375/.minikube/config/config.json: open /Users/jenkins/minikube-integration/18320-1375/.minikube/config/config.json: no such file or directory
	I0307 13:46:37.021722    1848 out.go:298] Setting JSON to true
	I0307 13:46:37.046830    1848 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":968,"bootTime":1709847029,"procs":492,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 13:46:37.046921    1848 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 13:46:37.069222    1848 out.go:97] [download-only-410000] minikube v1.32.0 on Darwin 14.3.1
	I0307 13:46:37.090566    1848 out.go:169] MINIKUBE_LOCATION=18320
	I0307 13:46:37.069373    1848 notify.go:220] Checking for updates...
	W0307 13:46:37.069387    1848 preload.go:294] Failed to list preload files: open /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball: no such file or directory
	I0307 13:46:37.134881    1848 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 13:46:37.155680    1848 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 13:46:37.176973    1848 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 13:46:37.198946    1848 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	W0307 13:46:37.241628    1848 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0307 13:46:37.241901    1848 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 13:46:37.313987    1848 out.go:97] Using the hyperkit driver based on user configuration
	I0307 13:46:37.314048    1848 start.go:297] selected driver: hyperkit
	I0307 13:46:37.314062    1848 start.go:901] validating driver "hyperkit" against <nil>
	I0307 13:46:37.314278    1848 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 13:46:37.314655    1848 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 13:46:37.458174    1848 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 13:46:37.462819    1848 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:46:37.462841    1848 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 13:46:37.462868    1848 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 13:46:37.467696    1848 start_flags.go:393] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB
	I0307 13:46:37.467872    1848 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0307 13:46:37.467926    1848 cni.go:84] Creating CNI manager for ""
	I0307 13:46:37.467944    1848 cni.go:162] CNI unnecessary in this configuration, recommending no CNI
	I0307 13:46:37.468017    1848 start.go:340] cluster config:
	{Name:download-only-410000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:6000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.20.0 ClusterName:download-only-410000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.20.0 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 13:46:37.468228    1848 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 13:46:37.489432    1848 out.go:97] Downloading VM boot image ...
	I0307 13:46:37.489508    1848 download.go:107] Downloading: https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso?checksum=file:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso.sha256 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/iso/amd64/minikube-v1.32.1-1708638130-18020-amd64.iso
	I0307 13:46:53.957019    1848 out.go:97] Starting "download-only-410000" primary control-plane node in "download-only-410000" cluster
	I0307 13:46:53.957042    1848 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0307 13:46:54.226552    1848 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0307 13:46:54.226579    1848 cache.go:56] Caching tarball of preloaded images
	I0307 13:46:54.226795    1848 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0307 13:46:54.247637    1848 out.go:97] Downloading Kubernetes v1.20.0 preload ...
	I0307 13:46:54.247697    1848 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...
	I0307 13:46:54.836671    1848 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.20.0/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4?checksum=md5:9a82241e9b8b4ad2b5cca73108f2c7a3 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4
	I0307 13:47:12.785887    1848 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...
	I0307 13:47:12.786086    1848 preload.go:255] verifying checksum of /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.20.0-docker-overlay2-amd64.tar.lz4 ...
	I0307 13:47:13.336008    1848 cache.go:59] Finished verifying existence of preloaded tar for v1.20.0 on docker
	I0307 13:47:13.336241    1848 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/download-only-410000/config.json ...
	I0307 13:47:13.336264    1848 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/download-only-410000/config.json: {Name:mk0c9db60834642c1297dfdc9ea5ff966b14990e Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 13:47:13.336569    1848 preload.go:132] Checking if preload exists for k8s version v1.20.0 and runtime docker
	I0307 13:47:13.336873    1848 download.go:107] Downloading: https://dl.k8s.io/release/v1.20.0/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.20.0/bin/darwin/amd64/kubectl.sha256 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/darwin/amd64/v1.20.0/kubectl
	
	
	* The control-plane node download-only-410000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-410000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.20.0/LogsDuration (0.30s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAll (0.94s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-amd64 delete --all
--- PASS: TestDownloadOnly/v1.20.0/DeleteAll (0.94s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.37s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-410000
--- PASS: TestDownloadOnly/v1.20.0/DeleteAlwaysSucceeds (0.37s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/json-events (52.3s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-572000 --force --alsologtostderr --kubernetes-version=v1.28.4 --container-runtime=docker --driver=hyperkit 
aaa_download_only_test.go:81: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-572000 --force --alsologtostderr --kubernetes-version=v1.28.4 --container-runtime=docker --driver=hyperkit : (52.300146585s)
--- PASS: TestDownloadOnly/v1.28.4/json-events (52.30s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/preload-exists
--- PASS: TestDownloadOnly/v1.28.4/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/kubectl
--- PASS: TestDownloadOnly/v1.28.4/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/LogsDuration (0.32s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-572000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-572000: exit status 85 (324.259428ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |              Args              |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only        | download-only-410000 | jenkins | v1.32.0 | 07 Mar 24 13:46 PST |                     |
	|         | -p download-only-410000        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0   |                      |         |         |                     |                     |
	|         | --container-runtime=docker     |                      |         |         |                     |                     |
	|         | --driver=hyperkit              |                      |         |         |                     |                     |
	| delete  | --all                          | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:47 PST | 07 Mar 24 13:47 PST |
	| delete  | -p download-only-410000        | download-only-410000 | jenkins | v1.32.0 | 07 Mar 24 13:47 PST | 07 Mar 24 13:47 PST |
	| start   | -o=json --download-only        | download-only-572000 | jenkins | v1.32.0 | 07 Mar 24 13:47 PST |                     |
	|         | -p download-only-572000        |                      |         |         |                     |                     |
	|         | --force --alsologtostderr      |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.28.4   |                      |         |         |                     |                     |
	|         | --container-runtime=docker     |                      |         |         |                     |                     |
	|         | --driver=hyperkit              |                      |         |         |                     |                     |
	|---------|--------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/07 13:47:28
	Running on machine: MacOS-Agent-4
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0307 13:47:28.298479    1918 out.go:291] Setting OutFile to fd 1 ...
	I0307 13:47:28.298815    1918 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:47:28.298821    1918 out.go:304] Setting ErrFile to fd 2...
	I0307 13:47:28.298824    1918 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:47:28.298985    1918 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 13:47:28.300571    1918 out.go:298] Setting JSON to true
	I0307 13:47:28.322839    1918 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1019,"bootTime":1709847029,"procs":481,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 13:47:28.322933    1918 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 13:47:28.344757    1918 out.go:97] [download-only-572000] minikube v1.32.0 on Darwin 14.3.1
	I0307 13:47:28.366547    1918 out.go:169] MINIKUBE_LOCATION=18320
	I0307 13:47:28.344965    1918 notify.go:220] Checking for updates...
	I0307 13:47:28.408642    1918 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 13:47:28.429722    1918 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 13:47:28.451788    1918 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 13:47:28.473445    1918 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	W0307 13:47:28.515752    1918 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0307 13:47:28.516247    1918 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 13:47:28.546461    1918 out.go:97] Using the hyperkit driver based on user configuration
	I0307 13:47:28.546512    1918 start.go:297] selected driver: hyperkit
	I0307 13:47:28.546527    1918 start.go:901] validating driver "hyperkit" against <nil>
	I0307 13:47:28.546729    1918 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 13:47:28.546960    1918 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 13:47:28.555848    1918 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 13:47:28.559569    1918 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:47:28.559600    1918 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 13:47:28.559632    1918 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 13:47:28.562222    1918 start_flags.go:393] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB
	I0307 13:47:28.562366    1918 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0307 13:47:28.562425    1918 cni.go:84] Creating CNI manager for ""
	I0307 13:47:28.562446    1918 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 13:47:28.562458    1918 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 13:47:28.562525    1918 start.go:340] cluster config:
	{Name:download-only-572000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:6000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.28.4 ClusterName:download-only-572000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local
ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 13:47:28.562618    1918 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 13:47:28.583547    1918 out.go:97] Starting "download-only-572000" primary control-plane node in "download-only-572000" cluster
	I0307 13:47:28.583602    1918 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 13:47:29.083460    1918 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.4/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 13:47:29.083493    1918 cache.go:56] Caching tarball of preloaded images
	I0307 13:47:29.083844    1918 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 13:47:29.105356    1918 out.go:97] Downloading Kubernetes v1.28.4 preload ...
	I0307 13:47:29.105385    1918 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 ...
	I0307 13:47:29.685304    1918 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.28.4/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4?checksum=md5:7ebdea7754e21f51b865dbfc36b53b7d -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4
	I0307 13:47:48.580451    1918 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 ...
	I0307 13:47:48.580621    1918 preload.go:255] verifying checksum of /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.28.4-docker-overlay2-amd64.tar.lz4 ...
	I0307 13:47:49.158809    1918 cache.go:59] Finished verifying existence of preloaded tar for v1.28.4 on docker
	I0307 13:47:49.159058    1918 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/download-only-572000/config.json ...
	I0307 13:47:49.159082    1918 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/download-only-572000/config.json: {Name:mke74ea08a8bedc5ce6de35131936b47adb29628 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 13:47:49.159383    1918 preload.go:132] Checking if preload exists for k8s version v1.28.4 and runtime docker
	I0307 13:47:49.159578    1918 download.go:107] Downloading: https://dl.k8s.io/release/v1.28.4/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.28.4/bin/darwin/amd64/kubectl.sha256 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/darwin/amd64/v1.28.4/kubectl
	
	
	* The control-plane node download-only-572000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-572000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.28.4/LogsDuration (0.32s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/DeleteAll (0.41s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-amd64 delete --all
--- PASS: TestDownloadOnly/v1.28.4/DeleteAll (0.41s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds (0.39s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-572000
--- PASS: TestDownloadOnly/v1.28.4/DeleteAlwaysSucceeds (0.39s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/json-events (48s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/json-events
aaa_download_only_test.go:81: (dbg) Run:  out/minikube-darwin-amd64 start -o=json --download-only -p download-only-609000 --force --alsologtostderr --kubernetes-version=v1.29.0-rc.2 --container-runtime=docker --driver=hyperkit 
aaa_download_only_test.go:81: (dbg) Done: out/minikube-darwin-amd64 start -o=json --download-only -p download-only-609000 --force --alsologtostderr --kubernetes-version=v1.29.0-rc.2 --container-runtime=docker --driver=hyperkit : (47.996425837s)
--- PASS: TestDownloadOnly/v1.29.0-rc.2/json-events (48.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/preload-exists (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/preload-exists
--- PASS: TestDownloadOnly/v1.29.0-rc.2/preload-exists (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/kubectl (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/kubectl
--- PASS: TestDownloadOnly/v1.29.0-rc.2/kubectl (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/LogsDuration (0.3s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/LogsDuration
aaa_download_only_test.go:184: (dbg) Run:  out/minikube-darwin-amd64 logs -p download-only-609000
aaa_download_only_test.go:184: (dbg) Non-zero exit: out/minikube-darwin-amd64 logs -p download-only-609000: exit status 85 (299.086995ms)

                                                
                                                
-- stdout --
	
	==> Audit <==
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| Command |               Args                |       Profile        |  User   | Version |     Start Time      |      End Time       |
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	| start   | -o=json --download-only           | download-only-410000 | jenkins | v1.32.0 | 07 Mar 24 13:46 PST |                     |
	|         | -p download-only-410000           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.20.0      |                      |         |         |                     |                     |
	|         | --container-runtime=docker        |                      |         |         |                     |                     |
	|         | --driver=hyperkit                 |                      |         |         |                     |                     |
	| delete  | --all                             | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:47 PST | 07 Mar 24 13:47 PST |
	| delete  | -p download-only-410000           | download-only-410000 | jenkins | v1.32.0 | 07 Mar 24 13:47 PST | 07 Mar 24 13:47 PST |
	| start   | -o=json --download-only           | download-only-572000 | jenkins | v1.32.0 | 07 Mar 24 13:47 PST |                     |
	|         | -p download-only-572000           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.28.4      |                      |         |         |                     |                     |
	|         | --container-runtime=docker        |                      |         |         |                     |                     |
	|         | --driver=hyperkit                 |                      |         |         |                     |                     |
	| delete  | --all                             | minikube             | jenkins | v1.32.0 | 07 Mar 24 13:48 PST | 07 Mar 24 13:48 PST |
	| delete  | -p download-only-572000           | download-only-572000 | jenkins | v1.32.0 | 07 Mar 24 13:48 PST | 07 Mar 24 13:48 PST |
	| start   | -o=json --download-only           | download-only-609000 | jenkins | v1.32.0 | 07 Mar 24 13:48 PST |                     |
	|         | -p download-only-609000           |                      |         |         |                     |                     |
	|         | --force --alsologtostderr         |                      |         |         |                     |                     |
	|         | --kubernetes-version=v1.29.0-rc.2 |                      |         |         |                     |                     |
	|         | --container-runtime=docker        |                      |         |         |                     |                     |
	|         | --driver=hyperkit                 |                      |         |         |                     |                     |
	|---------|-----------------------------------|----------------------|---------|---------|---------------------|---------------------|
	
	
	==> Last Start <==
	Log file created at: 2024/03/07 13:48:21
	Running on machine: MacOS-Agent-4
	Binary: Built with gc go1.22.0 for darwin/amd64
	Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
	I0307 13:48:21.734177    1968 out.go:291] Setting OutFile to fd 1 ...
	I0307 13:48:21.734662    1968 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:48:21.734669    1968 out.go:304] Setting ErrFile to fd 2...
	I0307 13:48:21.734675    1968 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:48:21.735466    1968 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 13:48:21.736876    1968 out.go:298] Setting JSON to true
	I0307 13:48:21.758869    1968 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1072,"bootTime":1709847029,"procs":483,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 13:48:21.758967    1968 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 13:48:21.780136    1968 out.go:97] [download-only-609000] minikube v1.32.0 on Darwin 14.3.1
	I0307 13:48:21.801873    1968 out.go:169] MINIKUBE_LOCATION=18320
	I0307 13:48:21.780272    1968 notify.go:220] Checking for updates...
	I0307 13:48:21.843930    1968 out.go:169] KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 13:48:21.887978    1968 out.go:169] MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 13:48:21.910057    1968 out.go:169] MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 13:48:21.932010    1968 out.go:169] MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	W0307 13:48:21.975009    1968 out.go:267] minikube skips various validations when --force is supplied; this may lead to unexpected behavior
	I0307 13:48:21.975413    1968 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 13:48:22.003682    1968 out.go:97] Using the hyperkit driver based on user configuration
	I0307 13:48:22.003722    1968 start.go:297] selected driver: hyperkit
	I0307 13:48:22.003735    1968 start.go:901] validating driver "hyperkit" against <nil>
	I0307 13:48:22.003933    1968 install.go:52] acquiring lock: {Name:mk4023283b30b374c3f04c8805d539e68824c0b8 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 13:48:22.004131    1968 install.go:117] Validating docker-machine-driver-hyperkit, PATH=/Users/jenkins/minikube-integration/18320-1375/.minikube/bin:/Users/jenkins/workspace/out/:/usr/bin:/bin:/usr/sbin:/sbin:/Users/jenkins/google-cloud-sdk/bin:/usr/local/bin/:/usr/local/go/bin/:/Users/jenkins/go/bin
	I0307 13:48:22.013069    1968 install.go:137] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit version is 1.32.0
	I0307 13:48:22.016856    1968 install.go:79] stdout: /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:48:22.016878    1968 install.go:81] /Users/jenkins/workspace/out/docker-machine-driver-hyperkit looks good
	I0307 13:48:22.016907    1968 start_flags.go:310] no existing cluster config was found, will generate one from the flags 
	I0307 13:48:22.019464    1968 start_flags.go:393] Using suggested 6000MB memory alloc based on sys=32768MB, container=0MB
	I0307 13:48:22.019618    1968 start_flags.go:929] Wait components to verify : map[apiserver:true system_pods:true]
	I0307 13:48:22.019677    1968 cni.go:84] Creating CNI manager for ""
	I0307 13:48:22.019693    1968 cni.go:158] "hyperkit" driver + "docker" container runtime found on kubernetes v1.24+, recommending bridge
	I0307 13:48:22.019703    1968 start_flags.go:319] Found "bridge CNI" CNI - setting NetworkPlugin=cni
	I0307 13:48:22.019774    1968 start.go:340] cluster config:
	{Name:download-only-609000 KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:6000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8443 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.29.0-rc.2 ClusterName:download-only-609000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.l
ocal ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.29.0-rc.2 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 13:48:22.019859    1968 iso.go:125] acquiring lock: {Name:mkee38a5e71a1dcca2bf9b53365c0d8678e25650 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
	I0307 13:48:22.041098    1968 out.go:97] Starting "download-only-609000" primary control-plane node in "download-only-609000" cluster
	I0307 13:48:22.041133    1968 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 13:48:22.517855    1968 preload.go:119] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.29.0-rc.2/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0307 13:48:22.517905    1968 cache.go:56] Caching tarball of preloaded images
	I0307 13:48:22.518208    1968 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 13:48:22.539904    1968 out.go:97] Downloading Kubernetes v1.29.0-rc.2 preload ...
	I0307 13:48:22.539931    1968 preload.go:237] getting checksum for preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 ...
	I0307 13:48:23.170195    1968 download.go:107] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/v18/v1.29.0-rc.2/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4?checksum=md5:47acda482c3add5b56147c92b8d7f468 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4
	I0307 13:48:41.304303    1968 preload.go:248] saving checksum for preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 ...
	I0307 13:48:41.304494    1968 preload.go:255] verifying checksum of /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v18-v1.29.0-rc.2-docker-overlay2-amd64.tar.lz4 ...
	I0307 13:48:41.806206    1968 cache.go:59] Finished verifying existence of preloaded tar for v1.29.0-rc.2 on docker
	I0307 13:48:41.806466    1968 profile.go:142] Saving config to /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/download-only-609000/config.json ...
	I0307 13:48:41.806492    1968 lock.go:35] WriteFile acquiring /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/download-only-609000/config.json: {Name:mke89426df53f19ccba4564788dcc392fc3f9a17 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
	I0307 13:48:41.806789    1968 preload.go:132] Checking if preload exists for k8s version v1.29.0-rc.2 and runtime docker
	I0307 13:48:41.806980    1968 download.go:107] Downloading: https://dl.k8s.io/release/v1.29.0-rc.2/bin/darwin/amd64/kubectl?checksum=file:https://dl.k8s.io/release/v1.29.0-rc.2/bin/darwin/amd64/kubectl.sha256 -> /Users/jenkins/minikube-integration/18320-1375/.minikube/cache/darwin/amd64/v1.29.0-rc.2/kubectl
	
	
	* The control-plane node download-only-609000 host does not exist
	  To start a cluster, run: "minikube start -p download-only-609000"

                                                
                                                
-- /stdout --
aaa_download_only_test.go:185: minikube logs failed with error: exit status 85
--- PASS: TestDownloadOnly/v1.29.0-rc.2/LogsDuration (0.30s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/DeleteAll (0.4s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/DeleteAll
aaa_download_only_test.go:197: (dbg) Run:  out/minikube-darwin-amd64 delete --all
--- PASS: TestDownloadOnly/v1.29.0-rc.2/DeleteAll (0.40s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds (0.37s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds
aaa_download_only_test.go:208: (dbg) Run:  out/minikube-darwin-amd64 delete -p download-only-609000
--- PASS: TestDownloadOnly/v1.29.0-rc.2/DeleteAlwaysSucceeds (0.37s)

                                                
                                    
x
+
TestBinaryMirror (1.02s)

                                                
                                                
=== RUN   TestBinaryMirror
aaa_download_only_test.go:314: (dbg) Run:  out/minikube-darwin-amd64 start --download-only -p binary-mirror-671000 --alsologtostderr --binary-mirror http://127.0.0.1:49358 --driver=hyperkit 
helpers_test.go:175: Cleaning up "binary-mirror-671000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p binary-mirror-671000
--- PASS: TestBinaryMirror (1.02s)

                                                
                                    
x
+
TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.15s)

                                                
                                                
=== RUN   TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/EnablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/EnablingAddonOnNonExistingCluster
addons_test.go:928: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p addons-925000
addons_test.go:928: (dbg) Non-zero exit: out/minikube-darwin-amd64 addons enable dashboard -p addons-925000: exit status 85 (152.704841ms)

                                                
                                                
-- stdout --
	* Profile "addons-925000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-925000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/EnablingAddonOnNonExistingCluster (0.15s)

                                                
                                    
x
+
TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.15s)

                                                
                                                
=== RUN   TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
=== PAUSE TestAddons/PreSetup/DisablingAddonOnNonExistingCluster

                                                
                                                

                                                
                                                
=== CONT  TestAddons/PreSetup/DisablingAddonOnNonExistingCluster
addons_test.go:939: (dbg) Run:  out/minikube-darwin-amd64 addons disable dashboard -p addons-925000
addons_test.go:939: (dbg) Non-zero exit: out/minikube-darwin-amd64 addons disable dashboard -p addons-925000: exit status 85 (152.608957ms)

                                                
                                                
-- stdout --
	* Profile "addons-925000" not found. Run "minikube profile list" to view all profiles.
	  To start a cluster, run: "minikube start -p addons-925000"

                                                
                                                
-- /stdout --
--- PASS: TestAddons/PreSetup/DisablingAddonOnNonExistingCluster (0.15s)

                                                
                                    
x
+
TestAddons/Setup (332.34s)

                                                
                                                
=== RUN   TestAddons/Setup
addons_test.go:109: (dbg) Run:  out/minikube-darwin-amd64 start -p addons-925000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller
addons_test.go:109: (dbg) Done: out/minikube-darwin-amd64 start -p addons-925000 --wait=true --memory=4000 --alsologtostderr --addons=registry --addons=metrics-server --addons=volumesnapshots --addons=csi-hostpath-driver --addons=gcp-auth --addons=cloud-spanner --addons=inspektor-gadget --addons=storage-provisioner-rancher --addons=nvidia-device-plugin --addons=yakd --driver=hyperkit  --addons=ingress --addons=ingress-dns --addons=helm-tiller: (5m32.344671865s)
--- PASS: TestAddons/Setup (332.34s)

                                                
                                    
x
+
TestAddons/parallel/Registry (18.68s)

                                                
                                                
=== RUN   TestAddons/parallel/Registry
=== PAUSE TestAddons/parallel/Registry

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Registry
addons_test.go:330: registry stabilized in 12.404533ms
addons_test.go:332: (dbg) TestAddons/parallel/Registry: waiting 6m0s for pods matching "actual-registry=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-vw9m8" [cc8fd9ac-2b26-4182-b7b0-321c5a14d143] Running
addons_test.go:332: (dbg) TestAddons/parallel/Registry: actual-registry=true healthy within 5.004808487s
addons_test.go:335: (dbg) TestAddons/parallel/Registry: waiting 10m0s for pods matching "registry-proxy=true" in namespace "kube-system" ...
helpers_test.go:344: "registry-proxy-bjr9f" [c08d8f8d-f141-402f-b047-6bfa310c97e1] Running
addons_test.go:335: (dbg) TestAddons/parallel/Registry: registry-proxy=true healthy within 5.004238559s
addons_test.go:340: (dbg) Run:  kubectl --context addons-925000 delete po -l run=registry-test --now
addons_test.go:345: (dbg) Run:  kubectl --context addons-925000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local"
addons_test.go:345: (dbg) Done: kubectl --context addons-925000 run --rm registry-test --restart=Never --image=gcr.io/k8s-minikube/busybox -it -- sh -c "wget --spider -S http://registry.kube-system.svc.cluster.local": (8.009945846s)
addons_test.go:359: (dbg) Run:  out/minikube-darwin-amd64 -p addons-925000 ip
addons_test.go:388: (dbg) Run:  out/minikube-darwin-amd64 -p addons-925000 addons disable registry --alsologtostderr -v=1
--- PASS: TestAddons/parallel/Registry (18.68s)

                                                
                                    
x
+
TestAddons/parallel/Ingress (19.81s)

                                                
                                                
=== RUN   TestAddons/parallel/Ingress
=== PAUSE TestAddons/parallel/Ingress

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Ingress
addons_test.go:207: (dbg) Run:  kubectl --context addons-925000 wait --for=condition=ready --namespace=ingress-nginx pod --selector=app.kubernetes.io/component=controller --timeout=90s
addons_test.go:232: (dbg) Run:  kubectl --context addons-925000 replace --force -f testdata/nginx-ingress-v1.yaml
addons_test.go:245: (dbg) Run:  kubectl --context addons-925000 replace --force -f testdata/nginx-pod-svc.yaml
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: waiting 8m0s for pods matching "run=nginx" in namespace "default" ...
helpers_test.go:344: "nginx" [ee3dd16b-7fe2-4294-b9bd-a1d6e055608d] Pending / Ready:ContainersNotReady (containers with unready status: [nginx]) / ContainersReady:ContainersNotReady (containers with unready status: [nginx])
helpers_test.go:344: "nginx" [ee3dd16b-7fe2-4294-b9bd-a1d6e055608d] Running
addons_test.go:250: (dbg) TestAddons/parallel/Ingress: run=nginx healthy within 10.004831799s
addons_test.go:262: (dbg) Run:  out/minikube-darwin-amd64 -p addons-925000 ssh "curl -s http://127.0.0.1/ -H 'Host: nginx.example.com'"
addons_test.go:286: (dbg) Run:  kubectl --context addons-925000 replace --force -f testdata/ingress-dns-example-v1.yaml
addons_test.go:291: (dbg) Run:  out/minikube-darwin-amd64 -p addons-925000 ip
addons_test.go:297: (dbg) Run:  nslookup hello-john.test 192.169.0.3
addons_test.go:306: (dbg) Run:  out/minikube-darwin-amd64 -p addons-925000 addons disable ingress-dns --alsologtostderr -v=1
addons_test.go:306: (dbg) Done: out/minikube-darwin-amd64 -p addons-925000 addons disable ingress-dns --alsologtostderr -v=1: (1.414595618s)
addons_test.go:311: (dbg) Run:  out/minikube-darwin-amd64 -p addons-925000 addons disable ingress --alsologtostderr -v=1
addons_test.go:311: (dbg) Done: out/minikube-darwin-amd64 -p addons-925000 addons disable ingress --alsologtostderr -v=1: (7.472802034s)
--- PASS: TestAddons/parallel/Ingress (19.81s)

                                                
                                    
x
+
TestAddons/parallel/InspektorGadget (10.48s)

                                                
                                                
=== RUN   TestAddons/parallel/InspektorGadget
=== PAUSE TestAddons/parallel/InspektorGadget

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/InspektorGadget
addons_test.go:838: (dbg) TestAddons/parallel/InspektorGadget: waiting 8m0s for pods matching "k8s-app=gadget" in namespace "gadget" ...
helpers_test.go:344: "gadget-czr27" [ab55966e-4232-4175-813d-a93b2ac8a75e] Running / Ready:ContainersNotReady (containers with unready status: [gadget]) / ContainersReady:ContainersNotReady (containers with unready status: [gadget])
addons_test.go:838: (dbg) TestAddons/parallel/InspektorGadget: k8s-app=gadget healthy within 5.003515131s
addons_test.go:841: (dbg) Run:  out/minikube-darwin-amd64 addons disable inspektor-gadget -p addons-925000
addons_test.go:841: (dbg) Done: out/minikube-darwin-amd64 addons disable inspektor-gadget -p addons-925000: (5.471847252s)
--- PASS: TestAddons/parallel/InspektorGadget (10.48s)

                                                
                                    
x
+
TestAddons/parallel/MetricsServer (5.47s)

                                                
                                                
=== RUN   TestAddons/parallel/MetricsServer
=== PAUSE TestAddons/parallel/MetricsServer

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/MetricsServer
addons_test.go:407: metrics-server stabilized in 2.324284ms
addons_test.go:409: (dbg) TestAddons/parallel/MetricsServer: waiting 6m0s for pods matching "k8s-app=metrics-server" in namespace "kube-system" ...
helpers_test.go:344: "metrics-server-69cf46c98-8dbl2" [45cfcb50-8c09-47c4-81d1-83b685311138] Running
addons_test.go:409: (dbg) TestAddons/parallel/MetricsServer: k8s-app=metrics-server healthy within 5.003744592s
addons_test.go:415: (dbg) Run:  kubectl --context addons-925000 top pods -n kube-system
addons_test.go:432: (dbg) Run:  out/minikube-darwin-amd64 -p addons-925000 addons disable metrics-server --alsologtostderr -v=1
--- PASS: TestAddons/parallel/MetricsServer (5.47s)

                                                
                                    
x
+
TestAddons/parallel/HelmTiller (10.09s)

                                                
                                                
=== RUN   TestAddons/parallel/HelmTiller
=== PAUSE TestAddons/parallel/HelmTiller

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/HelmTiller
addons_test.go:456: tiller-deploy stabilized in 2.565623ms
addons_test.go:458: (dbg) TestAddons/parallel/HelmTiller: waiting 6m0s for pods matching "app=helm" in namespace "kube-system" ...
helpers_test.go:344: "tiller-deploy-7b677967b9-whsmm" [4c8f75fc-ce81-46de-bb5d-b1bfa2cb1999] Running
addons_test.go:458: (dbg) TestAddons/parallel/HelmTiller: app=helm healthy within 5.003571789s
addons_test.go:473: (dbg) Run:  kubectl --context addons-925000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version
addons_test.go:473: (dbg) Done: kubectl --context addons-925000 run --rm helm-test --restart=Never --image=docker.io/alpine/helm:2.16.3 -it --namespace=kube-system -- version: (4.651293614s)
addons_test.go:490: (dbg) Run:  out/minikube-darwin-amd64 -p addons-925000 addons disable helm-tiller --alsologtostderr -v=1
--- PASS: TestAddons/parallel/HelmTiller (10.09s)

                                                
                                    
x
+
TestAddons/parallel/CSI (34.43s)

                                                
                                                
=== RUN   TestAddons/parallel/CSI
=== PAUSE TestAddons/parallel/CSI

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CSI
addons_test.go:561: csi-hostpath-driver pods stabilized in 12.976314ms
addons_test.go:564: (dbg) Run:  kubectl --context addons-925000 create -f testdata/csi-hostpath-driver/pvc.yaml
addons_test.go:569: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-925000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-925000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-925000 get pvc hpvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-925000 get pvc hpvc -o jsonpath={.status.phase} -n default
addons_test.go:574: (dbg) Run:  kubectl --context addons-925000 create -f testdata/csi-hostpath-driver/pv-pod.yaml
addons_test.go:579: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod" in namespace "default" ...
helpers_test.go:344: "task-pv-pod" [3aab93e5-de92-4083-a3db-67a416b0895a] Pending
helpers_test.go:344: "task-pv-pod" [3aab93e5-de92-4083-a3db-67a416b0895a] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod" [3aab93e5-de92-4083-a3db-67a416b0895a] Running
addons_test.go:579: (dbg) TestAddons/parallel/CSI: app=task-pv-pod healthy within 12.003620296s
addons_test.go:584: (dbg) Run:  kubectl --context addons-925000 create -f testdata/csi-hostpath-driver/snapshot.yaml
addons_test.go:589: (dbg) TestAddons/parallel/CSI: waiting 6m0s for volume snapshot "new-snapshot-demo" in namespace "default" ...
helpers_test.go:419: (dbg) Run:  kubectl --context addons-925000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
helpers_test.go:419: (dbg) Run:  kubectl --context addons-925000 get volumesnapshot new-snapshot-demo -o jsonpath={.status.readyToUse} -n default
addons_test.go:594: (dbg) Run:  kubectl --context addons-925000 delete pod task-pv-pod
addons_test.go:600: (dbg) Run:  kubectl --context addons-925000 delete pvc hpvc
addons_test.go:606: (dbg) Run:  kubectl --context addons-925000 create -f testdata/csi-hostpath-driver/pvc-restore.yaml
addons_test.go:611: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pvc "hpvc-restore" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-925000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-925000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
2024/03/07 13:55:03 [DEBUG] GET http://192.169.0.3:5000
helpers_test.go:394: (dbg) Run:  kubectl --context addons-925000 get pvc hpvc-restore -o jsonpath={.status.phase} -n default
addons_test.go:616: (dbg) Run:  kubectl --context addons-925000 create -f testdata/csi-hostpath-driver/pv-pod-restore.yaml
addons_test.go:621: (dbg) TestAddons/parallel/CSI: waiting 6m0s for pods matching "app=task-pv-pod-restore" in namespace "default" ...
helpers_test.go:344: "task-pv-pod-restore" [dcf3a397-c27a-435d-8c6d-5b0b56fee66f] Pending
helpers_test.go:344: "task-pv-pod-restore" [dcf3a397-c27a-435d-8c6d-5b0b56fee66f] Pending / Ready:ContainersNotReady (containers with unready status: [task-pv-container]) / ContainersReady:ContainersNotReady (containers with unready status: [task-pv-container])
helpers_test.go:344: "task-pv-pod-restore" [dcf3a397-c27a-435d-8c6d-5b0b56fee66f] Running
addons_test.go:621: (dbg) TestAddons/parallel/CSI: app=task-pv-pod-restore healthy within 7.004942189s
addons_test.go:626: (dbg) Run:  kubectl --context addons-925000 delete pod task-pv-pod-restore
addons_test.go:630: (dbg) Run:  kubectl --context addons-925000 delete pvc hpvc-restore
addons_test.go:634: (dbg) Run:  kubectl --context addons-925000 delete volumesnapshot new-snapshot-demo
addons_test.go:638: (dbg) Run:  out/minikube-darwin-amd64 -p addons-925000 addons disable csi-hostpath-driver --alsologtostderr -v=1
addons_test.go:638: (dbg) Done: out/minikube-darwin-amd64 -p addons-925000 addons disable csi-hostpath-driver --alsologtostderr -v=1: (6.407551985s)
addons_test.go:642: (dbg) Run:  out/minikube-darwin-amd64 -p addons-925000 addons disable volumesnapshots --alsologtostderr -v=1
--- PASS: TestAddons/parallel/CSI (34.43s)

                                                
                                    
x
+
TestAddons/parallel/Headlamp (13.31s)

                                                
                                                
=== RUN   TestAddons/parallel/Headlamp
=== PAUSE TestAddons/parallel/Headlamp

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Headlamp
addons_test.go:824: (dbg) Run:  out/minikube-darwin-amd64 addons enable headlamp -p addons-925000 --alsologtostderr -v=1
addons_test.go:824: (dbg) Done: out/minikube-darwin-amd64 addons enable headlamp -p addons-925000 --alsologtostderr -v=1: (1.30004214s)
addons_test.go:829: (dbg) TestAddons/parallel/Headlamp: waiting 8m0s for pods matching "app.kubernetes.io/name=headlamp" in namespace "headlamp" ...
helpers_test.go:344: "headlamp-5485c556b-nqzbq" [0662e199-2f5b-49a4-896f-920cd6b933a6] Pending / Ready:ContainersNotReady (containers with unready status: [headlamp]) / ContainersReady:ContainersNotReady (containers with unready status: [headlamp])
helpers_test.go:344: "headlamp-5485c556b-nqzbq" [0662e199-2f5b-49a4-896f-920cd6b933a6] Running
addons_test.go:829: (dbg) TestAddons/parallel/Headlamp: app.kubernetes.io/name=headlamp healthy within 12.004875067s
--- PASS: TestAddons/parallel/Headlamp (13.31s)

                                                
                                    
x
+
TestAddons/parallel/CloudSpanner (5.43s)

                                                
                                                
=== RUN   TestAddons/parallel/CloudSpanner
=== PAUSE TestAddons/parallel/CloudSpanner

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/CloudSpanner
addons_test.go:857: (dbg) TestAddons/parallel/CloudSpanner: waiting 6m0s for pods matching "app=cloud-spanner-emulator" in namespace "default" ...
helpers_test.go:344: "cloud-spanner-emulator-6548d5df46-87z87" [2b2afe31-7a4a-430d-9245-611a12cea2a1] Running
addons_test.go:857: (dbg) TestAddons/parallel/CloudSpanner: app=cloud-spanner-emulator healthy within 5.004034466s
addons_test.go:860: (dbg) Run:  out/minikube-darwin-amd64 addons disable cloud-spanner -p addons-925000
--- PASS: TestAddons/parallel/CloudSpanner (5.43s)

                                                
                                    
x
+
TestAddons/parallel/LocalPath (52.42s)

                                                
                                                
=== RUN   TestAddons/parallel/LocalPath
=== PAUSE TestAddons/parallel/LocalPath

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/LocalPath
addons_test.go:873: (dbg) Run:  kubectl --context addons-925000 apply -f testdata/storage-provisioner-rancher/pvc.yaml
addons_test.go:879: (dbg) Run:  kubectl --context addons-925000 apply -f testdata/storage-provisioner-rancher/pod.yaml
addons_test.go:883: (dbg) TestAddons/parallel/LocalPath: waiting 5m0s for pvc "test-pvc" in namespace "default" ...
helpers_test.go:394: (dbg) Run:  kubectl --context addons-925000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-925000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-925000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-925000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-925000 get pvc test-pvc -o jsonpath={.status.phase} -n default
helpers_test.go:394: (dbg) Run:  kubectl --context addons-925000 get pvc test-pvc -o jsonpath={.status.phase} -n default
addons_test.go:886: (dbg) TestAddons/parallel/LocalPath: waiting 3m0s for pods matching "run=test-local-path" in namespace "default" ...
helpers_test.go:344: "test-local-path" [12435eb9-2f27-4c2b-9ef6-d845c82e811f] Pending / Ready:ContainersNotReady (containers with unready status: [busybox]) / ContainersReady:ContainersNotReady (containers with unready status: [busybox])
helpers_test.go:344: "test-local-path" [12435eb9-2f27-4c2b-9ef6-d845c82e811f] Pending: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
helpers_test.go:344: "test-local-path" [12435eb9-2f27-4c2b-9ef6-d845c82e811f] Succeeded: Initialized:PodCompleted / Ready:PodCompleted / ContainersReady:PodCompleted
addons_test.go:886: (dbg) TestAddons/parallel/LocalPath: run=test-local-path healthy within 4.003097227s
addons_test.go:891: (dbg) Run:  kubectl --context addons-925000 get pvc test-pvc -o=json
addons_test.go:900: (dbg) Run:  out/minikube-darwin-amd64 -p addons-925000 ssh "cat /opt/local-path-provisioner/pvc-5e04d413-792c-4b45-b71c-dbe48849ede3_default_test-pvc/file1"
addons_test.go:912: (dbg) Run:  kubectl --context addons-925000 delete pod test-local-path
addons_test.go:916: (dbg) Run:  kubectl --context addons-925000 delete pvc test-pvc
addons_test.go:920: (dbg) Run:  out/minikube-darwin-amd64 -p addons-925000 addons disable storage-provisioner-rancher --alsologtostderr -v=1
addons_test.go:920: (dbg) Done: out/minikube-darwin-amd64 -p addons-925000 addons disable storage-provisioner-rancher --alsologtostderr -v=1: (42.777574262s)
--- PASS: TestAddons/parallel/LocalPath (52.42s)

                                                
                                    
x
+
TestAddons/parallel/NvidiaDevicePlugin (5.35s)

                                                
                                                
=== RUN   TestAddons/parallel/NvidiaDevicePlugin
=== PAUSE TestAddons/parallel/NvidiaDevicePlugin

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/NvidiaDevicePlugin
addons_test.go:952: (dbg) TestAddons/parallel/NvidiaDevicePlugin: waiting 6m0s for pods matching "name=nvidia-device-plugin-ds" in namespace "kube-system" ...
helpers_test.go:344: "nvidia-device-plugin-daemonset-6gc9g" [571ad657-c70e-4f55-9fbe-439b9d44e097] Running
addons_test.go:952: (dbg) TestAddons/parallel/NvidiaDevicePlugin: name=nvidia-device-plugin-ds healthy within 5.003688904s
addons_test.go:955: (dbg) Run:  out/minikube-darwin-amd64 addons disable nvidia-device-plugin -p addons-925000
--- PASS: TestAddons/parallel/NvidiaDevicePlugin (5.35s)

                                                
                                    
x
+
TestAddons/parallel/Yakd (5.01s)

                                                
                                                
=== RUN   TestAddons/parallel/Yakd
=== PAUSE TestAddons/parallel/Yakd

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Yakd
addons_test.go:963: (dbg) TestAddons/parallel/Yakd: waiting 2m0s for pods matching "app.kubernetes.io/name=yakd-dashboard" in namespace "yakd-dashboard" ...
helpers_test.go:344: "yakd-dashboard-9947fc6bf-jnfh8" [a7d885e5-06a1-4be4-a993-d9f8a7d7a092] Running
addons_test.go:963: (dbg) TestAddons/parallel/Yakd: app.kubernetes.io/name=yakd-dashboard healthy within 5.004584525s
--- PASS: TestAddons/parallel/Yakd (5.01s)

                                                
                                    
x
+
TestAddons/serial/GCPAuth/Namespaces (0.09s)

                                                
                                                
=== RUN   TestAddons/serial/GCPAuth/Namespaces
addons_test.go:650: (dbg) Run:  kubectl --context addons-925000 create ns new-namespace
addons_test.go:664: (dbg) Run:  kubectl --context addons-925000 get secret gcp-auth -n new-namespace
--- PASS: TestAddons/serial/GCPAuth/Namespaces (0.09s)

                                                
                                    
x
+
TestAddons/StoppedEnableDisable (5.96s)

                                                
                                                
=== RUN   TestAddons/StoppedEnableDisable
addons_test.go:172: (dbg) Run:  out/minikube-darwin-amd64 stop -p addons-925000
addons_test.go:172: (dbg) Done: out/minikube-darwin-amd64 stop -p addons-925000: (5.403060548s)
addons_test.go:176: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p addons-925000
addons_test.go:180: (dbg) Run:  out/minikube-darwin-amd64 addons disable dashboard -p addons-925000
addons_test.go:185: (dbg) Run:  out/minikube-darwin-amd64 addons disable gvisor -p addons-925000
--- PASS: TestAddons/StoppedEnableDisable (5.96s)

                                                
                                    
x
+
TestHyperKitDriverInstallOrUpdate (12.26s)

                                                
                                                
=== RUN   TestHyperKitDriverInstallOrUpdate
=== PAUSE TestHyperKitDriverInstallOrUpdate

                                                
                                                

                                                
                                                
=== CONT  TestHyperKitDriverInstallOrUpdate
* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:

                                                
                                                
$ sudo chown root:wheel /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current1952269056/001/.minikube/bin/docker-machine-driver-hyperkit 
$ sudo chmod u+s /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current1952269056/001/.minikube/bin/docker-machine-driver-hyperkit 

                                                
                                                

                                                
                                                
! Unable to update hyperkit driver: [sudo chown root:wheel /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current1952269056/001/.minikube/bin/docker-machine-driver-hyperkit] requires a password, and --interactive=false
* Starting "minikube" primary control-plane node in "minikube" cluster
* Download complete!
--- PASS: TestHyperKitDriverInstallOrUpdate (12.26s)

                                                
                                    
x
+
TestErrorSpam/start (1.32s)

                                                
                                                
=== RUN   TestErrorSpam/start
error_spam_test.go:216: Cleaning up 1 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 start --dry-run
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 start --dry-run
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 start --dry-run
--- PASS: TestErrorSpam/start (1.32s)

                                                
                                    
x
+
TestErrorSpam/status (0.22s)

                                                
                                                
=== RUN   TestErrorSpam/status
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 status
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 status: exit status 7 (73.388828ms)

                                                
                                                
-- stdout --
	nospam-536000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 status" failed: exit status 7
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 status
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 status: exit status 7 (72.249412ms)

                                                
                                                
-- stdout --
	nospam-536000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 status" failed: exit status 7
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 status
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 status: exit status 7 (72.506095ms)

                                                
                                                
-- stdout --
	nospam-536000
	type: Control Plane
	host: Stopped
	kubelet: Stopped
	apiserver: Stopped
	kubeconfig: Stopped
	

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 status" failed: exit status 7
--- PASS: TestErrorSpam/status (0.22s)

                                                
                                    
x
+
TestErrorSpam/pause (0.43s)

                                                
                                                
=== RUN   TestErrorSpam/pause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 pause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 pause: exit status 83 (136.869418ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-536000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-536000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 pause" failed: exit status 83
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 pause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 pause: exit status 83 (137.514157ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-536000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-536000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 pause" failed: exit status 83
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 pause
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 pause: exit status 83 (157.120716ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-536000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-536000"

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 pause" failed: exit status 83
--- PASS: TestErrorSpam/pause (0.43s)

                                                
                                    
x
+
TestErrorSpam/unpause (0.41s)

                                                
                                                
=== RUN   TestErrorSpam/unpause
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 unpause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 unpause: exit status 83 (138.487519ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-536000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-536000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 unpause" failed: exit status 83
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 unpause
error_spam_test.go:159: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 unpause: exit status 83 (134.980067ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-536000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-536000"

                                                
                                                
-- /stdout --
error_spam_test.go:161: "out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 unpause" failed: exit status 83
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 unpause
error_spam_test.go:182: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 unpause: exit status 83 (137.955902ms)

                                                
                                                
-- stdout --
	* The control-plane node nospam-536000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p nospam-536000"

                                                
                                                
-- /stdout --
error_spam_test.go:184: "out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 unpause" failed: exit status 83
--- PASS: TestErrorSpam/unpause (0.41s)

                                                
                                    
x
+
TestErrorSpam/stop (10.74s)

                                                
                                                
=== RUN   TestErrorSpam/stop
error_spam_test.go:216: Cleaning up 0 logfile(s) ...
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 stop
error_spam_test.go:159: (dbg) Done: out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 stop: (3.854684745s)
error_spam_test.go:159: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 stop
error_spam_test.go:159: (dbg) Done: out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 stop: (3.392008754s)
error_spam_test.go:182: (dbg) Run:  out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 stop
error_spam_test.go:182: (dbg) Done: out/minikube-darwin-amd64 -p nospam-536000 --log_dir /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/nospam-536000 stop: (3.488447252s)
--- PASS: TestErrorSpam/stop (10.74s)

                                                
                                    
x
+
TestFunctional/serial/CopySyncFile (0s)

                                                
                                                
=== RUN   TestFunctional/serial/CopySyncFile
functional_test.go:1851: local sync path: /Users/jenkins/minikube-integration/18320-1375/.minikube/files/etc/test/nested/copy/1843/hosts
--- PASS: TestFunctional/serial/CopySyncFile (0.00s)

                                                
                                    
x
+
TestFunctional/serial/AuditLog (0s)

                                                
                                                
=== RUN   TestFunctional/serial/AuditLog
--- PASS: TestFunctional/serial/AuditLog (0.00s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_remote (6.69s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_remote
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 cache add registry.k8s.io/pause:3.1
functional_test.go:1045: (dbg) Done: out/minikube-darwin-amd64 -p functional-550000 cache add registry.k8s.io/pause:3.1: (2.731152997s)
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 cache add registry.k8s.io/pause:3.3
functional_test.go:1045: (dbg) Done: out/minikube-darwin-amd64 -p functional-550000 cache add registry.k8s.io/pause:3.3: (2.163921205s)
functional_test.go:1045: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 cache add registry.k8s.io/pause:latest
functional_test.go:1045: (dbg) Done: out/minikube-darwin-amd64 -p functional-550000 cache add registry.k8s.io/pause:latest: (1.793147281s)
--- PASS: TestFunctional/serial/CacheCmd/cache/add_remote (6.69s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/add_local (1.64s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/add_local
functional_test.go:1073: (dbg) Run:  docker build -t minikube-local-cache-test:functional-550000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalserialCacheCmdcacheadd_local520917927/001
functional_test.go:1085: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 cache add minikube-local-cache-test:functional-550000
functional_test.go:1085: (dbg) Done: out/minikube-darwin-amd64 -p functional-550000 cache add minikube-local-cache-test:functional-550000: (1.069401002s)
functional_test.go:1090: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 cache delete minikube-local-cache-test:functional-550000
functional_test.go:1079: (dbg) Run:  docker rmi minikube-local-cache-test:functional-550000
--- PASS: TestFunctional/serial/CacheCmd/cache/add_local (1.64s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/CacheDelete (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/CacheDelete
functional_test.go:1098: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:3.3
--- PASS: TestFunctional/serial/CacheCmd/cache/CacheDelete (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/list (0.09s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/list
functional_test.go:1106: (dbg) Run:  out/minikube-darwin-amd64 cache list
--- PASS: TestFunctional/serial/CacheCmd/cache/list (0.09s)

                                                
                                    
x
+
TestFunctional/serial/CacheCmd/cache/delete (0.18s)

                                                
                                                
=== RUN   TestFunctional/serial/CacheCmd/cache/delete
functional_test.go:1168: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:3.1
functional_test.go:1168: (dbg) Run:  out/minikube-darwin-amd64 cache delete registry.k8s.io/pause:latest
--- PASS: TestFunctional/serial/CacheCmd/cache/delete (0.18s)

                                                
                                    
x
+
TestFunctional/parallel/ConfigCmd (0.69s)

                                                
                                                
=== RUN   TestFunctional/parallel/ConfigCmd
=== PAUSE TestFunctional/parallel/ConfigCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/ConfigCmd
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 config get cpus: exit status 14 (62.328496ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 config set cpus 2
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 config get cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 config unset cpus
functional_test.go:1195: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 config get cpus
functional_test.go:1195: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 config get cpus: exit status 14 (132.583141ms)

                                                
                                                
** stderr ** 
	Error: specified key could not be found in config

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/ConfigCmd (0.69s)

                                                
                                    
x
+
TestFunctional/parallel/DryRun (0.98s)

                                                
                                                
=== RUN   TestFunctional/parallel/DryRun
=== PAUSE TestFunctional/parallel/DryRun

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/DryRun
functional_test.go:970: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-550000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit 
functional_test.go:970: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-550000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit : exit status 23 (497.535116ms)

                                                
                                                
-- stdout --
	* [functional-550000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Using the hyperkit driver based on existing profile
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 13:58:50.516522    3171 out.go:291] Setting OutFile to fd 1 ...
	I0307 13:58:50.517148    3171 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:58:50.517156    3171 out.go:304] Setting ErrFile to fd 2...
	I0307 13:58:50.517163    3171 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:58:50.517773    3171 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 13:58:50.519279    3171 out.go:298] Setting JSON to false
	I0307 13:58:50.542001    3171 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1701,"bootTime":1709847029,"procs":493,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 13:58:50.542099    3171 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 13:58:50.563439    3171 out.go:177] * [functional-550000] minikube v1.32.0 on Darwin 14.3.1
	I0307 13:58:50.605471    3171 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 13:58:50.605546    3171 notify.go:220] Checking for updates...
	I0307 13:58:50.648543    3171 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 13:58:50.669265    3171 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 13:58:50.690353    3171 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 13:58:50.711285    3171 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 13:58:50.732304    3171 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 13:58:50.754158    3171 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 13:58:50.754845    3171 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:58:50.754939    3171 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 13:58:50.763746    3171 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50052
	I0307 13:58:50.764114    3171 main.go:141] libmachine: () Calling .GetVersion
	I0307 13:58:50.764527    3171 main.go:141] libmachine: Using API Version  1
	I0307 13:58:50.764562    3171 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 13:58:50.764820    3171 main.go:141] libmachine: () Calling .GetMachineName
	I0307 13:58:50.764936    3171 main.go:141] libmachine: (functional-550000) Calling .DriverName
	I0307 13:58:50.765119    3171 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 13:58:50.765365    3171 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:58:50.765392    3171 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 13:58:50.773037    3171 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50054
	I0307 13:58:50.773355    3171 main.go:141] libmachine: () Calling .GetVersion
	I0307 13:58:50.773706    3171 main.go:141] libmachine: Using API Version  1
	I0307 13:58:50.773726    3171 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 13:58:50.773931    3171 main.go:141] libmachine: () Calling .GetMachineName
	I0307 13:58:50.774035    3171 main.go:141] libmachine: (functional-550000) Calling .DriverName
	I0307 13:58:50.802460    3171 out.go:177] * Using the hyperkit driver based on existing profile
	I0307 13:58:50.844220    3171 start.go:297] selected driver: hyperkit
	I0307 13:58:50.844248    3171 start.go:901] validating driver "hyperkit" against &{Name:functional-550000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-550000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PV
ersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 13:58:50.844452    3171 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 13:58:50.869470    3171 out.go:177] 
	W0307 13:58:50.890318    3171 out.go:239] X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	X Exiting due to RSRC_INSUFFICIENT_REQ_MEMORY: Requested memory allocation 250MiB is less than the usable minimum of 1800MB
	I0307 13:58:50.911414    3171 out.go:177] 

                                                
                                                
** /stderr **
functional_test.go:987: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-550000 --dry-run --alsologtostderr -v=1 --driver=hyperkit 
--- PASS: TestFunctional/parallel/DryRun (0.98s)

                                                
                                    
x
+
TestFunctional/parallel/InternationalLanguage (0.55s)

                                                
                                                
=== RUN   TestFunctional/parallel/InternationalLanguage
=== PAUSE TestFunctional/parallel/InternationalLanguage

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/InternationalLanguage
functional_test.go:1016: (dbg) Run:  out/minikube-darwin-amd64 start -p functional-550000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit 
functional_test.go:1016: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p functional-550000 --dry-run --memory 250MB --alsologtostderr --driver=hyperkit : exit status 23 (553.902537ms)

                                                
                                                
-- stdout --
	* [functional-550000] minikube v1.32.0 sur Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	* Utilisation du pilote hyperkit basé sur le profil existant
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	I0307 13:58:51.487294    3187 out.go:291] Setting OutFile to fd 1 ...
	I0307 13:58:51.487543    3187 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:58:51.487549    3187 out.go:304] Setting ErrFile to fd 2...
	I0307 13:58:51.487552    3187 out.go:338] TERM=,COLORTERM=, which probably does not support color
	I0307 13:58:51.487756    3187 root.go:338] Updating PATH: /Users/jenkins/minikube-integration/18320-1375/.minikube/bin
	I0307 13:58:51.489345    3187 out.go:298] Setting JSON to false
	I0307 13:58:51.511958    3187 start.go:129] hostinfo: {"hostname":"MacOS-Agent-4.local","uptime":1702,"bootTime":1709847029,"procs":497,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"14.3.1","kernelVersion":"23.3.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"f2f27e25-cfda-5ffd-9706-e98286194e62"}
	W0307 13:58:51.512061    3187 start.go:137] gopshost.Virtualization returned error: not implemented yet
	I0307 13:58:51.533908    3187 out.go:177] * [functional-550000] minikube v1.32.0 sur Darwin 14.3.1
	I0307 13:58:51.597380    3187 out.go:177]   - MINIKUBE_LOCATION=18320
	I0307 13:58:51.576514    3187 notify.go:220] Checking for updates...
	I0307 13:58:51.639337    3187 out.go:177]   - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	I0307 13:58:51.660484    3187 out.go:177]   - MINIKUBE_BIN=out/minikube-darwin-amd64
	I0307 13:58:51.681382    3187 out.go:177]   - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	I0307 13:58:51.723320    3187 out.go:177]   - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	I0307 13:58:51.765379    3187 out.go:177]   - MINIKUBE_FORCE_SYSTEMD=
	I0307 13:58:51.786819    3187 config.go:182] Loaded profile config "functional-550000": Driver=hyperkit, ContainerRuntime=docker, KubernetesVersion=v1.28.4
	I0307 13:58:51.787188    3187 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:58:51.787244    3187 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 13:58:51.795364    3187 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50062
	I0307 13:58:51.795719    3187 main.go:141] libmachine: () Calling .GetVersion
	I0307 13:58:51.796147    3187 main.go:141] libmachine: Using API Version  1
	I0307 13:58:51.796169    3187 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 13:58:51.796451    3187 main.go:141] libmachine: () Calling .GetMachineName
	I0307 13:58:51.796595    3187 main.go:141] libmachine: (functional-550000) Calling .DriverName
	I0307 13:58:51.796783    3187 driver.go:392] Setting default libvirt URI to qemu:///system
	I0307 13:58:51.797018    3187 main.go:141] libmachine: Found binary path at /Users/jenkins/workspace/out/docker-machine-driver-hyperkit
	I0307 13:58:51.797044    3187 main.go:141] libmachine: Launching plugin server for driver hyperkit
	I0307 13:58:51.804633    3187 main.go:141] libmachine: Plugin server listening at address 127.0.0.1:50064
	I0307 13:58:51.804951    3187 main.go:141] libmachine: () Calling .GetVersion
	I0307 13:58:51.805295    3187 main.go:141] libmachine: Using API Version  1
	I0307 13:58:51.805309    3187 main.go:141] libmachine: () Calling .SetConfigRaw
	I0307 13:58:51.805532    3187 main.go:141] libmachine: () Calling .GetMachineName
	I0307 13:58:51.805636    3187 main.go:141] libmachine: (functional-550000) Calling .DriverName
	I0307 13:58:51.834340    3187 out.go:177] * Utilisation du pilote hyperkit basé sur le profil existant
	I0307 13:58:51.876574    3187 start.go:297] selected driver: hyperkit
	I0307 13:58:51.876601    3187 start.go:901] validating driver "hyperkit" against &{Name:functional-550000 KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube-builds/iso/18020/minikube-v1.32.1-1708638130-18020-amd64.iso KicBaseImage:gcr.io/k8s-minikube/kicbase-builds:v0.0.42-1708944392-18244@sha256:8610dac8144c3f59a6cf50871eb10395cea122e148262744231a04c396033b08 Memory:4000 CPUs:2 DiskSize:20000 Driver:hyperkit HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 APIServerPort:8441 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfi
g:{KubernetesVersion:v1.28.4 ClusterName:functional-550000 Namespace:default APIServerHAVIP: APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: RegistryAliases: ExtraOptions:[{Component:apiserver Key:enable-admission-plugins Value:NamespaceAutoProvision}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI:} Nodes:[{Name: IP: Port:8441 KubernetesVersion:v1.28.4 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true apps_running:true default_sa:true extra:true kubelet:true node_ready:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: Subnet: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host Mount9PV
ersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false DisableMetrics:false CustomQemuFirmwarePath: SocketVMnetClientPath: SocketVMnetPath: StaticIP: SSHAuthSock: SSHAgentPID:0 GPUs: AutoPauseInterval:1m0s}
	I0307 13:58:51.876785    3187 start.go:912] status for hyperkit: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
	I0307 13:58:51.902327    3187 out.go:177] 
	W0307 13:58:51.923325    3187 out.go:239] X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	X Fermeture en raison de RSRC_INSUFFICIENT_REQ_MEMORY : L'allocation de mémoire demandée 250 Mio est inférieure au minimum utilisable de 1800 Mo
	I0307 13:58:51.944324    3187 out.go:177] 

                                                
                                                
** /stderr **
--- PASS: TestFunctional/parallel/InternationalLanguage (0.55s)

                                                
                                    
x
+
TestFunctional/parallel/AddonsCmd (0.27s)

                                                
                                                
=== RUN   TestFunctional/parallel/AddonsCmd
=== PAUSE TestFunctional/parallel/AddonsCmd

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/AddonsCmd
functional_test.go:1686: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 addons list
functional_test.go:1698: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 addons list -o json
--- PASS: TestFunctional/parallel/AddonsCmd (0.27s)

                                                
                                    
x
+
TestFunctional/parallel/License (1.58s)

                                                
                                                
=== RUN   TestFunctional/parallel/License
=== PAUSE TestFunctional/parallel/License

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/License
functional_test.go:2284: (dbg) Run:  out/minikube-darwin-amd64 license
functional_test.go:2284: (dbg) Done: out/minikube-darwin-amd64 license: (1.576186307s)
--- PASS: TestFunctional/parallel/License (1.58s)

                                                
                                    
x
+
TestFunctional/parallel/Version/short (0.11s)

                                                
                                                
=== RUN   TestFunctional/parallel/Version/short
=== PAUSE TestFunctional/parallel/Version/short

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/Version/short
functional_test.go:2252: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 version --short
--- PASS: TestFunctional/parallel/Version/short (0.11s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/Setup (5.87s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/Setup
functional_test.go:341: (dbg) Run:  docker pull gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:341: (dbg) Done: docker pull gcr.io/google-containers/addon-resizer:1.8.8: (5.812652197s)
functional_test.go:346: (dbg) Run:  docker tag gcr.io/google-containers/addon-resizer:1.8.8 gcr.io/google-containers/addon-resizer:functional-550000
--- PASS: TestFunctional/parallel/ImageCommands/Setup (5.87s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/StartTunnel
functional_test_tunnel_test.go:129: (dbg) daemon: [out/minikube-darwin-amd64 -p functional-550000 tunnel --alsologtostderr]
--- PASS: TestFunctional/parallel/TunnelCmd/serial/StartTunnel (0.02s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageRemove (0.2s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageRemove
functional_test.go:391: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image rm gcr.io/google-containers/addon-resizer:functional-550000 --alsologtostderr
functional_test.go:447: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image ls
--- PASS: TestFunctional/parallel/ImageCommands/ImageRemove (0.20s)

                                                
                                    
x
+
TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.21s)

                                                
                                                
=== RUN   TestFunctional/parallel/ImageCommands/ImageSaveDaemon
functional_test.go:418: (dbg) Run:  docker rmi gcr.io/google-containers/addon-resizer:functional-550000
functional_test.go:423: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 image save --daemon gcr.io/google-containers/addon-resizer:functional-550000 --alsologtostderr
functional_test.go:428: (dbg) Run:  docker image inspect gcr.io/google-containers/addon-resizer:functional-550000
--- PASS: TestFunctional/parallel/ImageCommands/ImageSaveDaemon (0.21s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_not_create (0.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_not_create
functional_test.go:1266: (dbg) Run:  out/minikube-darwin-amd64 profile lis
functional_test.go:1271: (dbg) Run:  out/minikube-darwin-amd64 profile list --output json
--- PASS: TestFunctional/parallel/ProfileCmd/profile_not_create (0.25s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_list (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_list
functional_test.go:1306: (dbg) Run:  out/minikube-darwin-amd64 profile list
functional_test.go:1311: Took "144.321963ms" to run "out/minikube-darwin-amd64 profile list"
functional_test.go:1320: (dbg) Run:  out/minikube-darwin-amd64 profile list -l
functional_test.go:1325: Took "85.357443ms" to run "out/minikube-darwin-amd64 profile list -l"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_list (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/ProfileCmd/profile_json_output (0.23s)

                                                
                                                
=== RUN   TestFunctional/parallel/ProfileCmd/profile_json_output
functional_test.go:1357: (dbg) Run:  out/minikube-darwin-amd64 profile list -o json
functional_test.go:1362: Took "143.24162ms" to run "out/minikube-darwin-amd64 profile list -o json"
functional_test.go:1370: (dbg) Run:  out/minikube-darwin-amd64 profile list -o json --light
functional_test.go:1375: Took "84.880456ms" to run "out/minikube-darwin-amd64 profile list -o json --light"
--- PASS: TestFunctional/parallel/ProfileCmd/profile_json_output (0.23s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (10.02s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil
functional_test_tunnel_test.go:351: (dbg) Run:  dscacheutil -q host -a name nginx-svc.default.svc.cluster.local.
E0307 14:00:05.914839    1843 cert_rotation.go:168] key failed with : open /Users/jenkins/minikube-integration/18320-1375/.minikube/profiles/addons-925000/client.crt: no such file or directory
functional_test_tunnel_test.go:351: (dbg) Done: dscacheutil -q host -a name nginx-svc.default.svc.cluster.local.: (10.008195205s)
functional_test_tunnel_test.go:359: DNS resolution by dscacheutil for nginx-svc.default.svc.cluster.local. is working!
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DNSResolutionByDscacheutil (10.02s)

                                                
                                    
x
+
TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.14s)

                                                
                                                
=== RUN   TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel
functional_test_tunnel_test.go:434: (dbg) stopping [out/minikube-darwin-amd64 -p functional-550000 tunnel --alsologtostderr] ...
--- PASS: TestFunctional/parallel/TunnelCmd/serial/DeleteTunnel (0.14s)

                                                
                                    
x
+
TestFunctional/delete_addon-resizer_images (0.12s)

                                                
                                                
=== RUN   TestFunctional/delete_addon-resizer_images
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:1.8.8
functional_test.go:189: (dbg) Run:  docker rmi -f gcr.io/google-containers/addon-resizer:functional-550000
--- PASS: TestFunctional/delete_addon-resizer_images (0.12s)

                                                
                                    
x
+
TestFunctional/delete_my-image_image (0.05s)

                                                
                                                
=== RUN   TestFunctional/delete_my-image_image
functional_test.go:197: (dbg) Run:  docker rmi -f localhost/my-image:functional-550000
--- PASS: TestFunctional/delete_my-image_image (0.05s)

                                                
                                    
x
+
TestFunctional/delete_minikube_cached_images (0.05s)

                                                
                                                
=== RUN   TestFunctional/delete_minikube_cached_images
functional_test.go:205: (dbg) Run:  docker rmi -f minikube-local-cache-test:functional-550000
--- PASS: TestFunctional/delete_minikube_cached_images (0.05s)

                                                
                                    
x
+
TestJSONOutput/start/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/start/Audit
--- PASS: TestJSONOutput/start/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/Audit
--- PASS: TestJSONOutput/pause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/pause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/pause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/pause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/pause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/Audit
--- PASS: TestJSONOutput/unpause/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/unpause/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/unpause/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/unpause/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/Command (3.12s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Command
json_output_test.go:63: (dbg) Run:  out/minikube-darwin-amd64 stop -p json-output-020000 --output=json --user=testUser
json_output_test.go:63: (dbg) Done: out/minikube-darwin-amd64 stop -p json-output-020000 --output=json --user=testUser: (3.12003854s)
--- PASS: TestJSONOutput/stop/Command (3.12s)

                                                
                                    
x
+
TestJSONOutput/stop/Audit (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/Audit
--- PASS: TestJSONOutput/stop/Audit (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/DistinctCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/DistinctCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/DistinctCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/DistinctCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/DistinctCurrentSteps (0.00s)

                                                
                                    
x
+
TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0s)

                                                
                                                
=== RUN   TestJSONOutput/stop/parallel/IncreasingCurrentSteps
=== PAUSE TestJSONOutput/stop/parallel/IncreasingCurrentSteps

                                                
                                                

                                                
                                                
=== CONT  TestJSONOutput/stop/parallel/IncreasingCurrentSteps
--- PASS: TestJSONOutput/stop/parallel/IncreasingCurrentSteps (0.00s)

                                                
                                    
x
+
TestErrorJSONOutput (0.76s)

                                                
                                                
=== RUN   TestErrorJSONOutput
json_output_test.go:160: (dbg) Run:  out/minikube-darwin-amd64 start -p json-output-error-970000 --memory=2200 --output=json --wait=true --driver=fail
json_output_test.go:160: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p json-output-error-970000 --memory=2200 --output=json --wait=true --driver=fail: exit status 56 (386.548102ms)

                                                
                                                
-- stdout --
	{"specversion":"1.0","id":"9769d9d6-267a-4d87-985f-7b710ec6d9aa","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.step","datacontenttype":"application/json","data":{"currentstep":"0","message":"[json-output-error-970000] minikube v1.32.0 on Darwin 14.3.1","name":"Initial Minikube Setup","totalsteps":"19"}}
	{"specversion":"1.0","id":"3a9833e6-65cb-4f55-a525-6917d88fd1e6","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_LOCATION=18320"}}
	{"specversion":"1.0","id":"5f168c9f-2fe5-4698-b5e5-3c00de6279da","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig"}}
	{"specversion":"1.0","id":"2a8db87a-926b-4e9f-8802-ee0bd9263529","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_BIN=out/minikube-darwin-amd64"}}
	{"specversion":"1.0","id":"b81c57c3-e824-4153-8307-eb5958b1240c","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true"}}
	{"specversion":"1.0","id":"feea98a4-157a-4dce-aa18-1f68db73e32b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube"}}
	{"specversion":"1.0","id":"6142a90d-11de-4ee2-bcc4-d7130c3e6a43","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.info","datacontenttype":"application/json","data":{"message":"MINIKUBE_FORCE_SYSTEMD="}}
	{"specversion":"1.0","id":"a355623d-ac58-4aaa-b79f-f0118e2ff33b","source":"https://minikube.sigs.k8s.io/","type":"io.k8s.sigs.minikube.error","datacontenttype":"application/json","data":{"advice":"","exitcode":"56","issues":"","message":"The driver 'fail' is not supported on darwin/amd64","name":"DRV_UNSUPPORTED_OS","url":""}}

                                                
                                                
-- /stdout --
helpers_test.go:175: Cleaning up "json-output-error-970000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p json-output-error-970000
--- PASS: TestErrorJSONOutput (0.76s)

                                                
                                    
x
+
TestMainNoArgs (0.09s)

                                                
                                                
=== RUN   TestMainNoArgs
main_test.go:68: (dbg) Run:  out/minikube-darwin-amd64
--- PASS: TestMainNoArgs (0.09s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (2.54s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current
* minikube v1.32.0 on darwin
- MINIKUBE_LOCATION=18320
- KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current3032784277/001
* Using the hyperkit driver based on user configuration
* The 'hyperkit' driver requires elevated permissions. The following commands will be executed:

                                                
                                                
$ sudo chown root:wheel /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current3032784277/001/.minikube/bin/docker-machine-driver-hyperkit 
$ sudo chmod u+s /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current3032784277/001/.minikube/bin/docker-machine-driver-hyperkit 

                                                
                                                

                                                
                                                
! Unable to update hyperkit driver: [sudo chown root:wheel /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.11.0-to-current3032784277/001/.minikube/bin/docker-machine-driver-hyperkit] requires a password, and --interactive=false
* Starting "minikube" primary control-plane node in "minikube" cluster
* Download complete!
--- PASS: TestHyperkitDriverSkipUpgrade/upgrade-v1.11.0-to-current (2.54s)

                                                
                                    
x
+
TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (6.03s)

                                                
                                                
=== RUN   TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current
* minikube v1.32.0 on darwin
- MINIKUBE_LOCATION=18320
- KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
- MINIKUBE_BIN=out/minikube-darwin-amd64
- MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
- MINIKUBE_FORCE_SYSTEMD=
- MINIKUBE_HOME=/var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestHyperkitDriverSkipUpgradeupgrade-v1.2.0-to-current1952269056/001
* Using the hyperkit driver based on user configuration
* Downloading driver docker-machine-driver-hyperkit:
--- PASS: TestHyperkitDriverSkipUpgrade/upgrade-v1.2.0-to-current (6.03s)

                                                
                                    
x
+
TestStoppedBinaryUpgrade/Setup (5.33s)

                                                
                                                
=== RUN   TestStoppedBinaryUpgrade/Setup
--- PASS: TestStoppedBinaryUpgrade/Setup (5.33s)

                                                
                                    
x
+
TestNoKubernetes/serial/StartNoK8sWithVersion (0.41s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/StartNoK8sWithVersion
no_kubernetes_test.go:83: (dbg) Run:  out/minikube-darwin-amd64 start -p NoKubernetes-189000 --no-kubernetes --kubernetes-version=1.20 --driver=hyperkit 
no_kubernetes_test.go:83: (dbg) Non-zero exit: out/minikube-darwin-amd64 start -p NoKubernetes-189000 --no-kubernetes --kubernetes-version=1.20 --driver=hyperkit : exit status 14 (406.727123ms)

                                                
                                                
-- stdout --
	* [NoKubernetes-189000] minikube v1.32.0 on Darwin 14.3.1
	  - MINIKUBE_LOCATION=18320
	  - KUBECONFIG=/Users/jenkins/minikube-integration/18320-1375/kubeconfig
	  - MINIKUBE_BIN=out/minikube-darwin-amd64
	  - MINIKUBE_SUPPRESS_DOCKER_PERFORMANCE=true
	  - MINIKUBE_HOME=/Users/jenkins/minikube-integration/18320-1375/.minikube
	  - MINIKUBE_FORCE_SYSTEMD=
	
	

                                                
                                                
-- /stdout --
** stderr ** 
	X Exiting due to MK_USAGE: cannot specify --kubernetes-version with --no-kubernetes,
	to unset a global config run:
	
	$ minikube config unset kubernetes-version

                                                
                                                
** /stderr **
--- PASS: TestNoKubernetes/serial/StartNoK8sWithVersion (0.41s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunning (0.14s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunning
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-amd64 ssh -p NoKubernetes-189000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p NoKubernetes-189000 "sudo systemctl is-active --quiet service kubelet": exit status 83 (137.232979ms)

                                                
                                                
-- stdout --
	* The control-plane node NoKubernetes-189000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p NoKubernetes-189000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunning (0.14s)

                                                
                                    
x
+
TestNoKubernetes/serial/ProfileList (0.33s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/ProfileList
no_kubernetes_test.go:169: (dbg) Run:  out/minikube-darwin-amd64 profile list
no_kubernetes_test.go:179: (dbg) Run:  out/minikube-darwin-amd64 profile list --output=json
--- PASS: TestNoKubernetes/serial/ProfileList (0.33s)

                                                
                                    
x
+
TestNoKubernetes/serial/Stop (3.49s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/Stop
no_kubernetes_test.go:158: (dbg) Run:  out/minikube-darwin-amd64 stop -p NoKubernetes-189000
no_kubernetes_test.go:158: (dbg) Done: out/minikube-darwin-amd64 stop -p NoKubernetes-189000: (3.485342307s)
--- PASS: TestNoKubernetes/serial/Stop (3.49s)

                                                
                                    
x
+
TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.14s)

                                                
                                                
=== RUN   TestNoKubernetes/serial/VerifyK8sNotRunningSecond
no_kubernetes_test.go:147: (dbg) Run:  out/minikube-darwin-amd64 ssh -p NoKubernetes-189000 "sudo systemctl is-active --quiet service kubelet"
no_kubernetes_test.go:147: (dbg) Non-zero exit: out/minikube-darwin-amd64 ssh -p NoKubernetes-189000 "sudo systemctl is-active --quiet service kubelet": exit status 83 (139.334455ms)

                                                
                                                
-- stdout --
	* The control-plane node NoKubernetes-189000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p NoKubernetes-189000"

                                                
                                                
-- /stdout --
--- PASS: TestNoKubernetes/serial/VerifyK8sNotRunningSecond (0.14s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/Stop (3.43s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p old-k8s-version-202000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p old-k8s-version-202000 --alsologtostderr -v=3: (3.4339772s)
--- PASS: TestStartStop/group/old-k8s-version/serial/Stop (3.43s)

                                                
                                    
x
+
TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.46s)

                                                
                                                
=== RUN   TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p old-k8s-version-202000 -n old-k8s-version-202000: exit status 7 (98.519203ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p old-k8s-version-202000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/old-k8s-version/serial/EnableAddonAfterStop (0.46s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/Stop (3.23s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p no-preload-098000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p no-preload-098000 --alsologtostderr -v=3: (3.230419789s)
--- PASS: TestStartStop/group/no-preload/serial/Stop (3.23s)

                                                
                                    
x
+
TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.33s)

                                                
                                                
=== RUN   TestStartStop/group/no-preload/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p no-preload-098000 -n no-preload-098000: exit status 7 (71.819034ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p no-preload-098000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/no-preload/serial/EnableAddonAfterStop (0.33s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/Stop (3.09s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p embed-certs-564000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p embed-certs-564000 --alsologtostderr -v=3: (3.093700142s)
--- PASS: TestStartStop/group/embed-certs/serial/Stop (3.09s)

                                                
                                    
x
+
TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.35s)

                                                
                                                
=== RUN   TestStartStop/group/embed-certs/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p embed-certs-564000 -n embed-certs-564000: exit status 7 (72.910985ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p embed-certs-564000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/embed-certs/serial/EnableAddonAfterStop (0.35s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/Stop (3.82s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p default-k8s-diff-port-190000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p default-k8s-diff-port-190000 --alsologtostderr -v=3: (3.821944283s)
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/Stop (3.82s)

                                                
                                    
x
+
TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.33s)

                                                
                                                
=== RUN   TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p default-k8s-diff-port-190000 -n default-k8s-diff-port-190000: exit status 7 (72.220217ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p default-k8s-diff-port-190000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/default-k8s-diff-port/serial/EnableAddonAfterStop (0.33s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/DeployApp (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/DeployApp
--- PASS: TestStartStop/group/newest-cni/serial/DeployApp (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.21s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonWhileActive
start_stop_delete_test.go:205: (dbg) Run:  out/minikube-darwin-amd64 addons enable metrics-server -p newest-cni-438000 --images=MetricsServer=registry.k8s.io/echoserver:1.4 --registries=MetricsServer=fake.domain
start_stop_delete_test.go:211: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonWhileActive (0.21s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/Stop (3.38s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/Stop
start_stop_delete_test.go:228: (dbg) Run:  out/minikube-darwin-amd64 stop -p newest-cni-438000 --alsologtostderr -v=3
start_stop_delete_test.go:228: (dbg) Done: out/minikube-darwin-amd64 stop -p newest-cni-438000 --alsologtostderr -v=3: (3.376025513s)
--- PASS: TestStartStop/group/newest-cni/serial/Stop (3.38s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.33s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/EnableAddonAfterStop
start_stop_delete_test.go:239: (dbg) Run:  out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-438000 -n newest-cni-438000
start_stop_delete_test.go:239: (dbg) Non-zero exit: out/minikube-darwin-amd64 status --format={{.Host}} -p newest-cni-438000 -n newest-cni-438000: exit status 7 (73.750462ms)

                                                
                                                
-- stdout --
	Stopped

                                                
                                                
-- /stdout --
start_stop_delete_test.go:239: status error: exit status 7 (may be ok)
start_stop_delete_test.go:246: (dbg) Run:  out/minikube-darwin-amd64 addons enable dashboard -p newest-cni-438000 --images=MetricsScraper=registry.k8s.io/echoserver:1.4
--- PASS: TestStartStop/group/newest-cni/serial/EnableAddonAfterStop (0.33s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop
start_stop_delete_test.go:273: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/UserAppExistsAfterStop (0.00s)

                                                
                                    
x
+
TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0s)

                                                
                                                
=== RUN   TestStartStop/group/newest-cni/serial/AddonExistsAfterStop
start_stop_delete_test.go:284: WARNING: cni mode requires additional setup before pods can schedule :(
--- PASS: TestStartStop/group/newest-cni/serial/AddonExistsAfterStop (0.00s)

                                                
                                    

Test skip (24/280)

x
+
TestDownloadOnly/v1.20.0/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.20.0/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.20.0/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.20.0/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.20.0/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.28.4/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.28.4/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.28.4/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.28.4/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/cached-images (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/cached-images
aaa_download_only_test.go:129: Preload exists, images won't be cached
--- SKIP: TestDownloadOnly/v1.29.0-rc.2/cached-images (0.00s)

                                                
                                    
x
+
TestDownloadOnly/v1.29.0-rc.2/binaries (0s)

                                                
                                                
=== RUN   TestDownloadOnly/v1.29.0-rc.2/binaries
aaa_download_only_test.go:151: Preload exists, binaries are present within.
--- SKIP: TestDownloadOnly/v1.29.0-rc.2/binaries (0.00s)

                                                
                                    
x
+
TestDownloadOnlyKic (0s)

                                                
                                                
=== RUN   TestDownloadOnlyKic
aaa_download_only_test.go:220: skipping, only for docker or podman driver
--- SKIP: TestDownloadOnlyKic (0.00s)

                                                
                                    
x
+
TestAddons/parallel/Olm (0s)

                                                
                                                
=== RUN   TestAddons/parallel/Olm
=== PAUSE TestAddons/parallel/Olm

                                                
                                                

                                                
                                                
=== CONT  TestAddons/parallel/Olm
addons_test.go:498: Skipping OLM addon test until https://github.com/operator-framework/operator-lifecycle-manager/issues/2534 is resolved
--- SKIP: TestAddons/parallel/Olm (0.00s)

                                                
                                    
x
+
TestDockerEnvContainerd (0s)

                                                
                                                
=== RUN   TestDockerEnvContainerd
docker_test.go:170: running with docker false darwin amd64
docker_test.go:172: skipping: TestDockerEnvContainerd can only be run with the containerd runtime on Docker driver
--- SKIP: TestDockerEnvContainerd (0.00s)

                                                
                                    
x
+
TestKVMDriverInstallOrUpdate (0s)

                                                
                                                
=== RUN   TestKVMDriverInstallOrUpdate
driver_install_or_update_test.go:41: Skip if not linux.
--- SKIP: TestKVMDriverInstallOrUpdate (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/PodmanEnv (0s)

                                                
                                                
=== RUN   TestFunctional/parallel/PodmanEnv
=== PAUSE TestFunctional/parallel/PodmanEnv

                                                
                                                

                                                
                                                
=== CONT  TestFunctional/parallel/PodmanEnv
functional_test.go:546: only validate podman env with docker container runtime, currently testing docker
--- SKIP: TestFunctional/parallel/PodmanEnv (0.00s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/any-port (11.25s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/any-port
functional_test_mount_test.go:73: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-550000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdany-port2246385125/001:/mount-9p --alsologtostderr -v=1]
functional_test_mount_test.go:107: wrote "test-1709848694676693000" to /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdany-port2246385125/001/created-by-test
functional_test_mount_test.go:107: wrote "test-1709848694676693000" to /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdany-port2246385125/001/created-by-test-removed-by-pod
functional_test_mount_test.go:107: wrote "test-1709848694676693000" to /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdany-port2246385125/001/test-1709848694676693000
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (219.226994ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (137.325279ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (142.769643ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (142.851959ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (139.316466ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (136.759662ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:115: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:115: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (141.831281ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:123: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:90: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:90: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "sudo umount -f /mount-9p": exit status 83 (137.108966ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:92: "out/minikube-darwin-amd64 -p functional-550000 ssh \"sudo umount -f /mount-9p\"": exit status 83
functional_test_mount_test.go:94: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-550000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdany-port2246385125/001:/mount-9p --alsologtostderr -v=1] ...
--- SKIP: TestFunctional/parallel/MountCmd/any-port (11.25s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/specific-port (12.75s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/specific-port
functional_test_mount_test.go:213: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-550000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdspecific-port2480218565/001:/mount-9p --alsologtostderr -v=1 --port 46464]
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (157.139324ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (136.70247ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (139.743847ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (139.104088ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (138.481323ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (163.047744ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:243: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p"
functional_test_mount_test.go:243: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T /mount-9p | grep 9p": exit status 83 (137.223683ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:251: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:230: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "sudo umount -f /mount-9p"
functional_test_mount_test.go:230: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "sudo umount -f /mount-9p": exit status 83 (138.879163ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:232: "out/minikube-darwin-amd64 -p functional-550000 ssh \"sudo umount -f /mount-9p\"": exit status 83
functional_test_mount_test.go:234: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-550000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdspecific-port2480218565/001:/mount-9p --alsologtostderr -v=1 --port 46464] ...
--- SKIP: TestFunctional/parallel/MountCmd/specific-port (12.75s)

                                                
                                    
x
+
TestFunctional/parallel/MountCmd/VerifyCleanup (11.78s)

                                                
                                                
=== RUN   TestFunctional/parallel/MountCmd/VerifyCleanup
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-550000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdVerifyCleanup535484483/001:/mount1 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-550000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdVerifyCleanup535484483/001:/mount2 --alsologtostderr -v=1]
functional_test_mount_test.go:298: (dbg) daemon: [out/minikube-darwin-amd64 mount -p functional-550000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdVerifyCleanup535484483/001:/mount3 --alsologtostderr -v=1]
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T" /mount1: exit status 83 (287.3615ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T" /mount1: exit status 83 (139.454965ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T" /mount1: exit status 83 (139.456739ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T" /mount1: exit status 83 (140.512614ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T" /mount1: exit status 83 (142.349235ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T" /mount1: exit status 83 (136.303123ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:325: (dbg) Run:  out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T" /mount1
functional_test_mount_test.go:325: (dbg) Non-zero exit: out/minikube-darwin-amd64 -p functional-550000 ssh "findmnt -T" /mount1: exit status 83 (137.209892ms)

                                                
                                                
-- stdout --
	* The control-plane node functional-550000 host is not running: state=Stopped
	  To start a cluster, run: "minikube start -p functional-550000"

                                                
                                                
-- /stdout --
functional_test_mount_test.go:340: skipping: mount did not appear, likely because macOS requires prompt to allow non-code signed binaries to listen on non-localhost port
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-550000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdVerifyCleanup535484483/001:/mount1 --alsologtostderr -v=1] ...
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-550000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdVerifyCleanup535484483/001:/mount2 --alsologtostderr -v=1] ...
functional_test_mount_test.go:313: (dbg) stopping [out/minikube-darwin-amd64 mount -p functional-550000 /var/folders/0y/_8hvl7v13q38_kkh25vpxkz00000gp/T/TestFunctionalparallelMountCmdVerifyCleanup535484483/001:/mount3 --alsologtostderr -v=1] ...
--- SKIP: TestFunctional/parallel/MountCmd/VerifyCleanup (11.78s)

                                                
                                    
x
+
TestGvisorAddon (0s)

                                                
                                                
=== RUN   TestGvisorAddon
gvisor_addon_test.go:34: skipping test because --gvisor=false
--- SKIP: TestGvisorAddon (0.00s)

                                                
                                    
x
+
TestKicCustomNetwork (0s)

                                                
                                                
=== RUN   TestKicCustomNetwork
kic_custom_network_test.go:34: only runs with docker driver
--- SKIP: TestKicCustomNetwork (0.00s)

                                                
                                    
x
+
TestKicExistingNetwork (0s)

                                                
                                                
=== RUN   TestKicExistingNetwork
kic_custom_network_test.go:73: only runs with docker driver
--- SKIP: TestKicExistingNetwork (0.00s)

                                                
                                    
x
+
TestKicCustomSubnet (0s)

                                                
                                                
=== RUN   TestKicCustomSubnet
kic_custom_network_test.go:102: only runs with docker/podman driver
--- SKIP: TestKicCustomSubnet (0.00s)

                                                
                                    
x
+
TestKicStaticIP (0s)

                                                
                                                
=== RUN   TestKicStaticIP
kic_custom_network_test.go:123: only run with docker/podman driver
--- SKIP: TestKicStaticIP (0.00s)

                                                
                                    
x
+
TestScheduledStopWindows (0s)

                                                
                                                
=== RUN   TestScheduledStopWindows
scheduled_stop_test.go:42: test only runs on windows
--- SKIP: TestScheduledStopWindows (0.00s)

                                                
                                    
x
+
TestInsufficientStorage (0s)

                                                
                                                
=== RUN   TestInsufficientStorage
status_test.go:38: only runs with docker driver
--- SKIP: TestInsufficientStorage (0.00s)

                                                
                                    
x
+
TestMissingContainerUpgrade (0s)

                                                
                                                
=== RUN   TestMissingContainerUpgrade
version_upgrade_test.go:284: This test is only for Docker
--- SKIP: TestMissingContainerUpgrade (0.00s)

                                                
                                    
x
+
TestNetworkPlugins/group/cilium (6.24s)

                                                
                                                
=== RUN   TestNetworkPlugins/group/cilium
net_test.go:102: Skipping the test as it's interfering with other tests and is outdated
panic.go:626: 
----------------------- debugLogs start: cilium-903000 [pass: true] --------------------------------
>>> netcat: nslookup kubernetes.default:
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> netcat: nslookup debug kubernetes.default a-records:
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> netcat: dig search kubernetes.default:
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local udp/53:
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> netcat: dig @10.96.0.10 kubernetes.default.svc.cluster.local tcp/53:
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 udp/53:
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> netcat: nc 10.96.0.10 tcp/53:
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> netcat: /etc/nsswitch.conf:
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> netcat: /etc/hosts:
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> netcat: /etc/resolv.conf:
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> host: /etc/nsswitch.conf:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: /etc/hosts:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: /etc/resolv.conf:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> k8s: nodes, services, endpoints, daemon sets, deployments and pods, :
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> host: crictl pods:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: crictl containers:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> k8s: describe netcat deployment:
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe netcat pod(s):
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: netcat logs:
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns deployment:
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe coredns pods:
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: coredns logs:
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe api server pod(s):
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: api server logs:
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> host: /etc/cni:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: ip a s:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: ip r s:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: iptables-save:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: iptables table nat:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set:
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium daemon set pod(s):
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (current):
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium daemon set container(s) logs (previous):
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment:
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> k8s: describe cilium deployment pod(s):
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (current):
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: cilium deployment container(s) logs (previous):
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy daemon set:
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: describe kube-proxy pod(s):
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> k8s: kube-proxy logs:
error: context "cilium-903000" does not exist

                                                
                                                

                                                
                                                
>>> host: kubelet daemon status:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: kubelet daemon config:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> k8s: kubelet logs:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: /etc/kubernetes/kubelet.conf:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: /var/lib/kubelet/config.yaml:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> k8s: kubectl config:
apiVersion: v1
clusters: null
contexts: null
current-context: ""
kind: Config
preferences: {}
users: null

                                                
                                                

                                                
                                                
>>> k8s: cms:
Error in configuration: context was not found for specified context: cilium-903000

                                                
                                                

                                                
                                                
>>> host: docker daemon status:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: docker daemon config:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: /etc/docker/daemon.json:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: docker system info:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon status:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: cri-docker daemon config:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: /etc/systemd/system/cri-docker.service.d/10-cni.conf:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: /usr/lib/systemd/system/cri-docker.service:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: cri-dockerd version:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon status:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: containerd daemon config:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: /lib/systemd/system/containerd.service:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: /etc/containerd/config.toml:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: containerd config dump:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: crio daemon status:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: crio daemon config:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: /etc/crio:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                

                                                
                                                
>>> host: crio config:
* Profile "cilium-903000" not found. Run "minikube profile list" to view all profiles.
To start a cluster, run: "minikube start -p cilium-903000"

                                                
                                                
----------------------- debugLogs end: cilium-903000 [took: 5.829917608s] --------------------------------
helpers_test.go:175: Cleaning up "cilium-903000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p cilium-903000
--- SKIP: TestNetworkPlugins/group/cilium (6.24s)

                                                
                                    
x
+
TestStartStop/group/disable-driver-mounts (0.38s)

                                                
                                                
=== RUN   TestStartStop/group/disable-driver-mounts
=== PAUSE TestStartStop/group/disable-driver-mounts

                                                
                                                

                                                
                                                
=== CONT  TestStartStop/group/disable-driver-mounts
start_stop_delete_test.go:103: skipping TestStartStop/group/disable-driver-mounts - only runs on virtualbox
helpers_test.go:175: Cleaning up "disable-driver-mounts-120000" profile ...
helpers_test.go:178: (dbg) Run:  out/minikube-darwin-amd64 delete -p disable-driver-mounts-120000
--- SKIP: TestStartStop/group/disable-driver-mounts (0.38s)

                                                
                                    
Copied to clipboard